Model parameters: d_model 2560 ffw_size 10240 kv_size 128 n_heads 20 n_layers 34 Megatron-DeepSpeed/pretrain_gpt.py --tensor-model-parallel-size 1 --pipeline-model-parallel-size 1 --num-layers 34 --hidden-size 2560 --num-attention-heads 20 --kv-channels 128 --ffn-hidden-size 10240 --seq-length 2048 --max-position-embeddings 2048 --micro-batch-size 2 --global-batch-size 512 --train-samples 1 --vocab-file gpt2/vocab.json --merge-file gpt2/merges.txt --clip-grad 1.0 --kill-switch-path kill-switch-2b855b18bval --bf16 --optimizer adam --adam-beta1 0.9 --adam-beta2 0.999 --adam-eps 1e-8 --lr 2e-4 --min-lr 2e-5 --lr-decay-style cosine --lr-decay-samples 1 --lr-warmup-samples 0 --clip-grad 1.0 --weight-decay 1e-1 --override-lr-scheduler --reset-progress --no-load-optim --log-interval 10 --save-interval 1000 --eval-interval 1 --eval-iters 100 --eval-only true --tensorboard-dir tensorboard_2b855b18bval --tensorboard-queue-size 5 --log-timers-to-tensorboard --log-batch-size-to-tensorboard --log-validation-ppl-to-tensorboard --save lm1-2b8-55b-c4-repetitions/2b855b18bc4 --load lm1-2b8-55b-c4-repetitions/2b855b18bc4 --train-weighted-split-paths-path train1b5.txt --valid-weighted-split-paths-path val.txt --data-impl mmap --deepspeed --deepspeed_config ds_configs/3432081.json --zero-stage 0 START 3432081: Sat 29 Apr 2023 05:19:34 PM EEST 0: 0: 0: ======================= ROCm System Management Interface ======================= 0: ================================= Concise Info ================================= 0: GPU Temp AvgPwr SCLK MCLK Fan Perf PwrCap VRAM% GPU% 0: 0 40.0c 92.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 0: 1 47.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 0: 2 42.0c 89.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 0: 3 46.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 0: 4 45.0c 82.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 0: 5 47.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 0: 6 42.0c 91.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 0: 7 46.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 0: ================================================================================ 0: ============================= End of ROCm SMI Log ============================== 8: 8: 8: ======================= ROCm System Management Interface ======================= 8: ================================= Concise Info ================================= 8: GPU Temp AvgPwr SCLK MCLK Fan Perf PwrCap VRAM% GPU% 8: 0 44.0c 97.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 8: 1 45.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 8: 2 39.0c 84.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 8: 3 44.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 8: 4 43.0c 93.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 8: 5 43.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 8: 6 39.0c 92.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 8: 7 43.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 8: ================================================================================ 8: ============================= End of ROCm SMI Log ============================== 5: 5: 5: ======================= ROCm System Management Interface ======================= 5: ================================= Concise Info ================================= 5: GPU Temp AvgPwr SCLK MCLK Fan Perf PwrCap VRAM% GPU% 5: 0 52.0c 91.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 5: 1 46.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 5: 2 37.0c 85.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 5: 3 47.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 5: 4 36.0c 88.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 5: 5 45.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 5: 6 34.0c 85.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 5: 7 46.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 5: ================================================================================ 5: ============================= End of ROCm SMI Log ============================== 19: 19: 19: ======================= ROCm System Management Interface ======================= 19: ================================= Concise Info ================================= 19: GPU Temp AvgPwr SCLK MCLK Fan Perf PwrCap VRAM% GPU% 19: 0 45.0c 92.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 19: 1 46.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 19: 2 40.0c 86.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 19: 3 44.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 19: 4 42.0c 84.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 19: 5 43.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 19: 6 44.0c 95.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 19: 7 42.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 19: ================================================================================ 19: ============================= End of ROCm SMI Log ============================== 4: 4: 4: ======================= ROCm System Management Interface ======================= 4: ================================= Concise Info ================================= 4: GPU Temp AvgPwr SCLK MCLK Fan Perf PwrCap VRAM% GPU% 4: 0 48.0c 88.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 4: 1 51.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 4: 2 45.0c 85.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 4: 3 49.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 4: 4 44.0c 88.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 4: 5 42.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 4: 6 41.0c 88.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 4: 7 42.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 4: ================================================================================ 4: ============================= End of ROCm SMI Log ============================== 13: 13: 13: ======================= ROCm System Management Interface ======================= 13: ================================= Concise Info ================================= 13: GPU Temp AvgPwr SCLK MCLK Fan Perf PwrCap VRAM% GPU% 13: 0 46.0c 89.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 13: 1 45.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 13: 2 40.0c 90.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 13: 3 47.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 13: 4 39.0c 87.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 13: 5 44.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 13: 6 44.0c 90.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 13: 7 38.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 13: ================================================================================ 13: ============================= End of ROCm SMI Log ============================== 11: 11: 11: ======================= ROCm System Management Interface ======================= 11: ================================= Concise Info ================================= 11: GPU Temp AvgPwr SCLK MCLK Fan Perf PwrCap VRAM% GPU% 11: 0 43.0c 93.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 11: 1 45.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 11: 2 40.0c 91.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 11: 3 44.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 11: 4 43.0c 90.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 11: 5 51.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 11: 6 43.0c 88.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 11: 7 40.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 11: ================================================================================ 11: ============================= End of ROCm SMI Log ============================== 27: 27: 27: ======================= ROCm System Management Interface ======================= 27: ================================= Concise Info ================================= 27: GPU Temp AvgPwr SCLK MCLK Fan Perf PwrCap VRAM% GPU% 27: 0 46.0c 89.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 27: 1 41.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 27: 2 39.0c 83.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 27: 3 47.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 27: 4 39.0c 86.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 27: 5 41.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 27: 6 34.0c 85.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 27: 7 39.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 27: ================================================================================ 27: ============================= End of ROCm SMI Log ============================== 25: 25: 25: ======================= ROCm System Management Interface ======================= 25: ================================= Concise Info ================================= 25: GPU Temp AvgPwr SCLK MCLK Fan Perf PwrCap VRAM% GPU% 25: 0 42.0c 89.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 25: 1 47.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 25: 2 43.0c 87.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 25: 3 44.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 25: 4 44.0c 89.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 25: 5 44.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 25: 6 36.0c 89.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 25: 7 42.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 25: ================================================================================ 25: ============================= End of ROCm SMI Log ============================== 10: 10: 10: ======================= ROCm System Management Interface ======================= 10: ================================= Concise Info ================================= 10: GPU Temp AvgPwr SCLK MCLK Fan Perf PwrCap VRAM% GPU% 10: 0 45.0c 93.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 10: 1 45.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 10: 2 39.0c 94.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 10: 3 48.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 10: 4 38.0c 91.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 10: 5 47.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 10: 6 43.0c 85.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 10: 7 53.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 10: ================================================================================ 10: ============================= End of ROCm SMI Log ============================== 20: 20: 20: ======================= ROCm System Management Interface ======================= 20: ================================= Concise Info ================================= 20: GPU Temp AvgPwr SCLK MCLK Fan Perf PwrCap VRAM% GPU% 20: 0 40.0c 96.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 20: 1 42.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 20: 2 42.0c 92.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 20: 3 49.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 20: 4 42.0c 90.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 20: 5 49.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 20: 6 40.0c 93.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 20: 7 42.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 20: ================================================================================ 20: ============================= End of ROCm SMI Log ============================== 16: 16: 16: ======================= ROCm System Management Interface ======================= 16: ================================= Concise Info ================================= 16: GPU Temp AvgPwr SCLK MCLK Fan Perf PwrCap VRAM% GPU% 16: 0 47.0c 86.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 16: 1 47.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 16: 2 38.0c 94.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 16: 3 45.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 16: 4 45.0c 87.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 16: 5 45.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 16: 6 40.0c 88.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 16: 7 37.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 16: ================================================================================ 16: ============================= End of ROCm SMI Log ============================== 2: 2: 2: ======================= ROCm System Management Interface ======================= 2: ================================= Concise Info ================================= 2: GPU Temp AvgPwr SCLK MCLK Fan Perf PwrCap VRAM% GPU% 2: 0 42.0c 89.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 2: 1 47.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 2: 2 40.0c 88.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 2: 3 46.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 2: 4 43.0c 92.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 2: 5 47.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 2: 6 48.0c 83.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 2: 7 46.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 2: ================================================================================ 2: ============================= End of ROCm SMI Log ============================== 7: 7: 7: ======================= ROCm System Management Interface ======================= 7: ================================= Concise Info ================================= 7: GPU Temp AvgPwr SCLK MCLK Fan Perf PwrCap VRAM% GPU% 7: 0 44.0c 94.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 7: 1 43.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 7: 2 36.0c 95.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 7: 3 42.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 7: 4 39.0c 92.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 7: 5 44.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 7: 6 43.0c 97.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 7: 7 43.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 7: ================================================================================ 7: ============================= End of ROCm SMI Log ============================== 14: 14: 14: ======================= ROCm System Management Interface ======================= 14: ================================= Concise Info ================================= 14: GPU Temp AvgPwr SCLK MCLK Fan Perf PwrCap VRAM% GPU% 14: 0 44.0c 90.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 14: 1 52.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 14: 2 44.0c 87.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 14: 3 41.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 14: 4 45.0c 88.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 14: 5 44.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 14: 6 38.0c 82.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 14: 7 46.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 14: ================================================================================ 14: ============================= End of ROCm SMI Log ============================== 15: 15: 15: ======================= ROCm System Management Interface ======================= 15: ================================= Concise Info ================================= 15: GPU Temp AvgPwr SCLK MCLK Fan Perf PwrCap VRAM% GPU% 15: 0 45.0c 93.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 15: 1 44.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 15: 2 44.0c 82.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 15: 3 41.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 15: 4 40.0c 87.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 15: 5 48.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 15: 6 42.0c 91.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 15: 7 44.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 15: ================================================================================ 15: ============================= End of ROCm SMI Log ============================== 26: 26: 26: ======================= ROCm System Management Interface ======================= 26: ================================= Concise Info ================================= 26: GPU Temp AvgPwr SCLK MCLK Fan Perf PwrCap VRAM% GPU% 26: 0 42.0c 95.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 26: 1 44.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 26: 2 38.0c 91.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 26: 3 46.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 26: 4 39.0c 85.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 26: 5 46.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 26: 6 36.0c 86.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 26: 7 44.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 26: ================================================================================ 26: ============================= End of ROCm SMI Log ============================== 23: 23: 23: ======================= ROCm System Management Interface ======================= 23: ================================= Concise Info ================================= 23: GPU Temp AvgPwr SCLK MCLK Fan Perf PwrCap VRAM% GPU% 23: 0 46.0c 89.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 23: 1 48.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 23: 2 39.0c 87.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 23: 3 46.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 23: 4 49.0c 86.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 23: 5 46.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 23: 6 39.0c 88.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 23: 7 42.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 23: ================================================================================ 23: ============================= End of ROCm SMI Log ============================== 6: 6: 6: ======================= ROCm System Management Interface ======================= 6: ================================= Concise Info ================================= 6: GPU Temp AvgPwr SCLK MCLK Fan Perf PwrCap VRAM% GPU% 6: 0 46.0c 97.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 6: 1 45.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 6: 2 40.0c 91.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 6: 3 43.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 6: 4 45.0c 83.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 6: 5 45.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 6: 6 40.0c 94.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 6: 7 43.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 6: ================================================================================ 6: ============================= End of ROCm SMI Log ============================== 31: 31: 31: ======================= ROCm System Management Interface ======================= 31: ================================= Concise Info ================================= 31: GPU Temp AvgPwr SCLK MCLK Fan Perf PwrCap VRAM% GPU% 31: 0 48.0c 83.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 31: 1 47.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 31: 2 42.0c 86.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 31: 3 45.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 31: 4 43.0c 83.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 31: 5 48.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 31: 6 39.0c 90.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 31: 7 42.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 31: ================================================================================ 31: ============================= End of ROCm SMI Log ============================== 30: 30: 30: ======================= ROCm System Management Interface ======================= 30: ================================= Concise Info ================================= 30: GPU Temp AvgPwr SCLK MCLK Fan Perf PwrCap VRAM% GPU% 30: 0 43.0c 95.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 30: 1 45.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 30: 2 40.0c 84.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 30: 3 43.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 30: 4 42.0c 92.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 30: 5 46.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 30: 6 31.0c 85.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 30: 7 44.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 30: ================================================================================ 30: ============================= End of ROCm SMI Log ============================== 24: 24: 24: ======================= ROCm System Management Interface ======================= 24: ================================= Concise Info ================================= 24: GPU Temp AvgPwr SCLK MCLK Fan Perf PwrCap VRAM% GPU% 24: 0 44.0c 84.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 24: 1 47.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 24: 2 37.0c 87.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 24: 3 47.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 24: 4 44.0c 87.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 24: 5 48.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 24: 6 40.0c 88.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 24: 7 42.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 24: ================================================================================ 24: ============================= End of ROCm SMI Log ============================== 9: 9: 9: ======================= ROCm System Management Interface ======================= 9: ================================= Concise Info ================================= 9: GPU Temp AvgPwr SCLK MCLK Fan Perf PwrCap VRAM% GPU% 9: 0 46.0c 93.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 9: 1 46.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 9: 2 42.0c 84.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 9: 3 48.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 9: 4 43.0c 94.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 9: 5 42.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 9: 6 39.0c 91.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 9: 7 44.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 9: ================================================================================ 9: ============================= End of ROCm SMI Log ============================== 17: 17: 17: ======================= ROCm System Management Interface ======================= 17: ================================= Concise Info ================================= 17: GPU Temp AvgPwr SCLK MCLK Fan Perf PwrCap VRAM% GPU% 17: 0 47.0c 88.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 17: 1 46.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 17: 2 36.0c 85.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 17: 3 45.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 17: 4 44.0c 84.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 17: 5 44.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 17: 6 43.0c 93.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 17: 7 38.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 17: ================================================================================ 17: ============================= End of ROCm SMI Log ============================== 1: 1: 1: ======================= ROCm System Management Interface ======================= 1: ================================= Concise Info ================================= 1: GPU Temp AvgPwr SCLK MCLK Fan Perf PwrCap VRAM% GPU% 1: 0 45.0c 94.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 1: 1 42.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 1: 2 40.0c 86.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 1: 3 47.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 1: 4 40.0c 84.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 1: 5 44.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 1: 6 40.0c 91.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 1: 7 48.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 1: ================================================================================ 1: ============================= End of ROCm SMI Log ============================== 21: 21: 21: ======================= ROCm System Management Interface ======================= 21: ================================= Concise Info ================================= 21: GPU Temp AvgPwr SCLK MCLK Fan Perf PwrCap VRAM% GPU% 21: 0 45.0c 89.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 21: 1 45.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 21: 2 40.0c 86.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 21: 3 36.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 21: 4 41.0c 90.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 21: 5 46.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 21: 6 43.0c 92.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 21: 7 43.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 21: ================================================================================ 21: ============================= End of ROCm SMI Log ============================== 3: 3: 3: ======================= ROCm System Management Interface ======================= 3: ================================= Concise Info ================================= 3: GPU Temp AvgPwr SCLK MCLK Fan Perf PwrCap VRAM% GPU% 3: 0 46.0c 88.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 3: 1 41.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 3: 2 43.0c 90.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 3: 3 50.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 3: 4 41.0c 85.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 3: 5 45.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 3: 6 37.0c 90.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 3: 7 46.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 3: ================================================================================ 3: ============================= End of ROCm SMI Log ============================== 18: 18: 18: ======================= ROCm System Management Interface ======================= 18: ================================= Concise Info ================================= 18: GPU Temp AvgPwr SCLK MCLK Fan Perf PwrCap VRAM% GPU% 18: 0 47.0c 93.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 18: 1 52.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 18: 2 39.0c 86.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 18: 3 45.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 18: 4 44.0c 88.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 18: 5 43.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 18: 6 41.0c 89.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 18: 7 42.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 18: ================================================================================ 18: ============================= End of ROCm SMI Log ============================== 22: 22: 22: ======================= ROCm System Management Interface ======================= 22: ================================= Concise Info ================================= 22: GPU Temp AvgPwr SCLK MCLK Fan Perf PwrCap VRAM% GPU% 22: 0 44.0c 92.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 22: 1 46.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 22: 2 42.0c 89.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 22: 3 43.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 22: 4 37.0c 87.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 22: 5 45.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 22: 6 45.0c 88.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 22: 7 48.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 22: ================================================================================ 22: ============================= End of ROCm SMI Log ============================== 28: 28: 28: ======================= ROCm System Management Interface ======================= 28: ================================= Concise Info ================================= 28: GPU Temp AvgPwr SCLK MCLK Fan Perf PwrCap VRAM% GPU% 28: 0 44.0c 92.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 28: 1 50.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 28: 2 41.0c 87.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 28: 3 41.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 28: 4 42.0c 89.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 28: 5 46.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 28: 6 44.0c 87.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 28: 7 40.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 28: ================================================================================ 28: ============================= End of ROCm SMI Log ============================== 12: 12: 12: ======================= ROCm System Management Interface ======================= 12: ================================= Concise Info ================================= 12: GPU Temp AvgPwr SCLK MCLK Fan Perf PwrCap VRAM% GPU% 12: 0 46.0c 89.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 12: 1 45.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 12: 2 41.0c 89.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 12: 3 43.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 12: 4 43.0c 85.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 12: 5 50.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 12: 6 41.0c 87.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 12: 7 44.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 12: ================================================================================ 12: ============================= End of ROCm SMI Log ============================== 29: 29: 29: ======================= ROCm System Management Interface ======================= 29: ================================= Concise Info ================================= 29: GPU Temp AvgPwr SCLK MCLK Fan Perf PwrCap VRAM% GPU% 29: 0 51.0c 88.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 29: 1 48.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 29: 2 37.0c 85.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 29: 3 41.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 29: 4 48.0c 90.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 29: 5 46.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 29: 6 38.0c 83.0W 800Mhz 1600Mhz 0% auto 560.0W 0% 0% 29: 7 44.0c N/A 800Mhz 1600Mhz 0% auto 0.0W 0% 0% 29: ================================================================================ 29: ============================= End of ROCm SMI Log ============================== 10: Launching on nid005869 (10/32), master nid005859 port 9999, GPUs 8, CUDA: True 31: Launching on nid006583 (31/32), master nid005859 port 9999, GPUs 8, CUDA: True 5: Launching on nid005864 (5/32), master nid005859 port 9999, GPUs 8, CUDA: True 23: Launching on nid006575 (23/32), master nid005859 port 9999, GPUs 8, CUDA: True 30: Launching on nid006582 (30/32), master nid005859 port 9999, GPUs 8, CUDA: True 26: Launching on nid006578 (26/32), master nid005859 port 9999, GPUs 8, CUDA: True 8: Launching on nid005867 (8/32), master nid005859 port 9999, GPUs 8, CUDA: True 16: Launching on nid005875 (16/32), master nid005859 port 9999, GPUs 8, CUDA: True 24: Launching on nid006576 (24/32), master nid005859 port 9999, GPUs 8, CUDA: True 25: Launching on nid006577 (25/32), master nid005859 port 9999, GPUs 8, CUDA: True 19: Launching on nid005878 (19/32), master nid005859 port 9999, GPUs 8, CUDA: True 7: Launching on nid005866 (7/32), master nid005859 port 9999, GPUs 8, CUDA: True 11: Launching on nid005870 (11/32), master nid005859 port 9999, GPUs 8, CUDA: True 13: Launching on nid005872 (13/32), master nid005859 port 9999, GPUs 8, CUDA: True 14: Launching on nid005873 (14/32), master nid005859 port 9999, GPUs 8, CUDA: True 27: Launching on nid006579 (27/32), master nid005859 port 9999, GPUs 8, CUDA: True 15: Launching on nid005874 (15/32), master nid005859 port 9999, GPUs 8, CUDA: True 4: Launching on nid005863 (4/32), master nid005859 port 9999, GPUs 8, CUDA: True 6: Launching on nid005865 (6/32), master nid005859 port 9999, GPUs 8, CUDA: True 20: Launching on nid006572 (20/32), master nid005859 port 9999, GPUs 8, CUDA: True 9: Launching on nid005868 (9/32), master nid005859 port 9999, GPUs 8, CUDA: True 2: Launching on nid005861 (2/32), master nid005859 port 9999, GPUs 8, CUDA: True 17: Launching on nid005876 (17/32), master nid005859 port 9999, GPUs 8, CUDA: True 3: Launching on nid005862 (3/32), master nid005859 port 9999, GPUs 8, CUDA: True 21: Launching on nid006573 (21/32), master nid005859 port 9999, GPUs 8, CUDA: True 29: Launching on nid006581 (29/32), master nid005859 port 9999, GPUs 8, CUDA: True 18: Launching on nid005877 (18/32), master nid005859 port 9999, GPUs 8, CUDA: True 22: Launching on nid006574 (22/32), master nid005859 port 9999, GPUs 8, CUDA: True 0: Launching on nid005859 (0/32), master nid005859 port 9999, GPUs 8, CUDA: True 1: Launching on nid005860 (1/32), master nid005859 port 9999, GPUs 8, CUDA: True 12: Launching on nid005871 (12/32), master nid005859 port 9999, GPUs 8, CUDA: True 28: Launching on nid006580 (28/32), master nid005859 port 9999, GPUs 8, CUDA: True 0: using world size: 256, data-parallel-size: 256, tensor-model-parallel size: 1, pipeline-model-parallel size: 1 0: accumulate and all-reduce gradients in fp32 for bfloat16 data type. 0: using torch.bfloat16 for parameters ... 0: ------------------------ arguments ------------------------ 0: abort_on_unmet_fused_kernel_constraints ......... False 0: accumulate_allreduce_grads_in_fp32 .............. True 0: adam_beta1 ...................................... 0.9 0: adam_beta2 ...................................... 0.999 0: adam_eps ........................................ 1e-08 0: adlr_autoresume ................................. False 0: adlr_autoresume_interval ........................ 1000 0: apply_query_key_layer_scaling ................... True 0: apply_residual_connection_post_layernorm ........ False 0: attention_dropout ............................... 0.1 0: attention_softmax_in_fp32 ....................... False 0: bert_binary_head ................................ True 0: bert_load ....................................... None 0: bf16 ............................................ True 0: bias_dropout_fusion ............................. True 0: bias_gelu_fusion ................................ True 0: biencoder_projection_dim ........................ 0 0: biencoder_shared_query_context_model ............ False 0: block_data_path ................................. None 0: checkpoint_activations .......................... False 0: checkpoint_in_cpu ............................... False 0: checkpoint_num_layers ........................... 1 0: clip_grad ....................................... 1.0 0: codecarbon_dir .................................. None 0: consumed_train_samples .......................... 0 0: consumed_train_tokens ........................... 0 0: consumed_valid_samples .......................... 0 0: contigious_checkpointing ........................ False 0: cpu_optimizer ................................... False 0: cpu_torch_adam .................................. False 0: curriculum_learning ............................. False 0: data_impl ....................................... mmap 0: data_parallel_size .............................. 256 0: data_path ....................................... None 0: dataloader_type ................................. single 0: DDP_impl ........................................ local 0: decoder_seq_length .............................. None 0: deepscale ....................................... False 0: deepscale_config ................................ None 0: deepspeed ....................................... True 0: deepspeed_activation_checkpointing .............. False 0: deepspeed_config ................................ ds_configs/3432081.json 0: deepspeed_mpi ................................... False 0: distribute_checkpointed_activations ............. False 0: distributed_backend ............................. nccl 0: embed_layernorm ................................. False 0: embedding_path .................................. None 0: encoder_seq_length .............................. 2048 0: eod_mask_loss ................................... False 0: eval_interval ................................... 1 0: eval_iters ...................................... 100 0: eval_only ....................................... True 0: evidence_data_path .............................. None 0: exit_duration_in_mins ........................... None 0: exit_interval ................................... None 0: ffn_hidden_size ................................. 10240 0: finetune ........................................ False 0: fp16 ............................................ False 0: fp16_lm_cross_entropy ........................... False 0: fp32_residual_connection ........................ False 0: gigaflos_no_embeds .............................. 0 0: global_batch_size ............................... 512 0: glu_activation .................................. None 0: hidden_dropout .................................. 0.1 0: hidden_size ..................................... 2560 0: hysteresis ...................................... 2 0: ict_head_size ................................... None 0: ict_load ........................................ None 0: img_dim ......................................... 224 0: indexer_batch_size .............................. 128 0: indexer_log_interval ............................ 1000 0: inference ....................................... False 0: init_method_std ................................. 0.02 0: init_method_xavier_uniform ...................... False 0: initial_loss_scale .............................. 4294967296 0: kill_switch_path ................................ kill-switch-2b855b18bval 0: kv_channels ..................................... 128 0: layer_norm_fusion ............................... True 0: layernorm_epsilon ............................... 1e-05 0: lazy_mpu_init ................................... None 0: load ............................................ lm1-2b8-55b-c4-repetitions/2b855b18bc4 0: local_rank ...................................... None 0: log_batch_size_to_tensorboard ................... True 0: log_interval .................................... 10 0: log_learning_rate_to_tensorboard ................ True 0: log_level ....................................... None 0: log_level_replica ............................... None 0: log_loss_scale_to_tensorboard ................... True 0: log_num_zeros_in_grad ........................... False 0: log_params_norm ................................. False 0: log_path ........................................ None 0: log_timers_to_tensorboard ....................... True 0: log_validation_ppl_to_tensorboard ............... True 0: loss_on_targets_only ............................ False 0: loss_scale ...................................... None 0: loss_scale_window ............................... 1000 0: lr .............................................. 0.0002 0: lr_decay_iters .................................. None 0: lr_decay_samples ................................ 1 0: lr_decay_style .................................. cosine 0: lr_decay_tokens ................................. None 0: lr_warmup_fraction .............................. None 0: lr_warmup_iters ................................. 0 0: lr_warmup_samples ............................... 0 0: make_vocab_size_divisible_by .................... 128 0: mask_prob ....................................... 0.15 0: masked_softmax_fusion ........................... True 0: max_position_embeddings ......................... 2048 0: mean_noise_span_length .......................... None 0: memory_centric_tiled_linear ..................... False 0: merge_file ...................................... gpt2/merges.txt 0: micro_batch_size ................................ 2 0: min_loss_scale .................................. 1.0 0: min_lr .......................................... 2e-05 0: mmap_warmup ..................................... False 0: no_load_optim ................................... True 0: no_load_rng ..................................... None 0: no_save_optim ................................... None 0: no_save_rng ..................................... None 0: noise_density ................................... None 0: num_attention_heads ............................. 20 0: num_channels .................................... 3 0: num_classes ..................................... 1000 0: num_layers ...................................... 34 0: num_layers_per_virtual_pipeline_stage ........... None 0: num_workers ..................................... 2 0: onnx_safe ....................................... None 0: openai_gelu ..................................... False 0: optimizer ....................................... adam 0: optimizer_fusion ................................ True 0: override_lr_scheduler ........................... True 0: pad_vocab_size_to ............................... None 0: params_dtype .................................... torch.bfloat16 0: partition_activations ........................... False 0: patch_dim ....................................... 16 0: pipeline_model_parallel_size .................... 1 0: position_embedding_type ......................... PositionEmbeddingType.absolute 0: pp_partition_method ............................. None 0: profile_backward ................................ False 0: query_in_block_prob ............................. 0.1 0: rampup_batch_size ............................... None 0: rank ............................................ 0 0: remote_device ................................... none 0: reset_attention_mask ............................ False 0: reset_position_ids .............................. False 0: reset_progress .................................. True 0: retriever_report_topk_accuracies ................ [] 0: retriever_score_scaling ......................... False 0: retriever_seq_length ............................ 256 0: reweight_loss_based_on_position_frequency ....... False 0: sample_rate ..................................... 1.0 0: save ............................................ lm1-2b8-55b-c4-repetitions/2b855b18bc4 0: save_interval ................................... 1000 0: scatter_gather_tensors_in_pipeline .............. True 0: scattered_embeddings ............................ False 0: seed ............................................ 1234 0: seq_length ...................................... 2048 0: sgd_momentum .................................... 0.9 0: short_seq_prob .................................. 0.1 0: skip_train_iteration_range ...................... None 0: split ........................................... None 0: split_transformers .............................. False 0: sync_tp_duplicated_parameters ................... False 0: synchronize_each_layer .......................... False 0: tensor_model_parallel_size ...................... 1 0: tensorboard_dir ................................. tensorboard_2b855b18bval 0: tensorboard_log_interval ........................ 1 0: tensorboard_queue_size .......................... 5 0: test_weighted_split_paths ....................... None 0: test_weighted_split_paths_path .................. None 0: tile_factor ..................................... 1 0: titles_data_path ................................ None 0: tokenizer_name_or_path .......................... None 0: tokenizer_type .................................. GPT2BPETokenizer 0: train_iters ..................................... None 0: train_samples ................................... 1 0: train_tokens .................................... None 0: train_weighted_split_names ...................... ['train'] 0: train_weighted_split_paths ...................... [['/scratch/project_462000119/data/c4_subsampled/gpt2tok_c4_en_1B5_text_document']] 0: train_weighted_split_paths_path ................. None 0: train_weighted_split_splits ..................... [['0:1']] 0: train_weighted_split_weights .................... [['1.0']] 0: universal_checkpoint ............................ False 0: use_bnb_optimizer ............................... False 0: use_checkpoint_lr_scheduler ..................... False 0: use_contiguous_buffers_in_ddp ................... True 0: use_cpu_initialization .......................... None 0: use_one_sent_docs ............................... False 0: use_pin_memory .................................. False 0: valid_num_workers ............................... 2 0: valid_weighted_split_names ...................... ['validation'] 0: valid_weighted_split_paths ...................... [['/scratch/project_462000119/data/c4_validation/gpt2tok_c4validation_rerun_text_document']] 0: valid_weighted_split_paths_path ................. None 0: valid_weighted_split_splits ..................... [['0:1']] 0: valid_weighted_split_weights .................... [['1.0']] 0: virtual_pipeline_model_parallel_size ............ None 0: vocab_extra_ids ................................. 0 0: vocab_file ...................................... gpt2/vocab.json 0: weight_decay .................................... 0.1 0: world_size ...................................... 256 0: zero_allgather_bucket_size ...................... 0.0 0: zero_contigious_gradients ....................... False 0: zero_reduce_bucket_size ......................... 0.0 0: zero_reduce_scatter ............................. False 0: zero_stage ...................................... 0 0: -------------------- end of arguments --------------------- 0: setting number of micro-batches to constant 1 0: > building GPT2BPETokenizer tokenizer ... 0: > padded vocab (size: 50257) with 47 dummy tokens (new size: 50304) 0: DeepSpeed general environment info: 0: torch install path ............... ['/pfs/lustrep4/scratch/project_462000119/muennighoff/nov-2022-bettercom/venv/lib/python3.9/site-packages/torch'] 0: torch version .................... 1.13.0+rocm5.2 0: torch cuda version ............... None 0: torch hip version ................ 5.2.21151-afdc89f8 0: nvcc version ..................... None 0: deepspeed install path ........... ['/pfs/lustrep4/scratch/project_462000119/muennighoff/nov-2022-bettercom/venv/lib/python3.9/site-packages/deepspeed'] 0: deepspeed info ................... 0.7.5, unknown, unknown 0: deepspeed wheel compiled w. ...... torch 1.13, hip 5.1 0: **** Git info for Megatron: git_hash=unknown git_branch=unknown **** 0: > initializing torch distributed ... 0: [2023-04-29 17:21:40,663] [INFO] [comm.py:633:init_distributed] Initializing TorchBackend in DeepSpeed with backend nccl 31: > setting tensorboard ... 0: > initializing tensor model parallel with size 1 0: > initializing pipeline model parallel with size 1 0: > setting random seeds to 1234 ... 0: > initializing model parallel cuda seeds on global rank 0, model parallel rank 0, and data parallel rank 0 with model parallel seed: 3952 and data parallel seed: 1234 0: > compiling dataset index builder ... 0: make: Entering directory '/pfs/lustrep4/scratch/project_462000119/muennighoff/nov-2022-bettercom/Megatron-DeepSpeed/megatron/data' 0: make: Nothing to be done for 'default'. 0: make: Leaving directory '/pfs/lustrep4/scratch/project_462000119/muennighoff/nov-2022-bettercom/Megatron-DeepSpeed/megatron/data' 0: >>> done with dataset index builder. Compilation time: 0.086 seconds 0: > compiling and loading fused kernels ... 0: /pfs/lustrep4/scratch/project_462000119/muennighoff/nov-2022-bettercom/Megatron-DeepSpeed/megatron/fused_kernels/scaled_masked_softmax.cpp -> /pfs/lustrep4/scratch/project_462000119/muennighoff/nov-2022-bettercom/Megatron-DeepSpeed/megatron/fused_kernels/scaled_masked_softmax_hip.cpp [skipped, already hipified] 0: /pfs/lustrep4/scratch/project_462000119/muennighoff/nov-2022-bettercom/Megatron-DeepSpeed/megatron/fused_kernels/scaled_masked_softmax.h -> /pfs/lustrep4/scratch/project_462000119/muennighoff/nov-2022-bettercom/Megatron-DeepSpeed/megatron/fused_kernels/scaled_masked_softmax_hip.h [skipped, already hipified] 0: /pfs/lustrep4/scratch/project_462000119/muennighoff/nov-2022-bettercom/Megatron-DeepSpeed/megatron/fused_kernels/compat.h -> /pfs/lustrep4/scratch/project_462000119/muennighoff/nov-2022-bettercom/Megatron-DeepSpeed/megatron/fused_kernels/compat.h [skipped, no changes] 0: /pfs/lustrep4/scratch/project_462000119/muennighoff/nov-2022-bettercom/Megatron-DeepSpeed/megatron/fused_kernels/type_shim.h -> /pfs/lustrep4/scratch/project_462000119/muennighoff/nov-2022-bettercom/Megatron-DeepSpeed/megatron/fused_kernels/type_shim.h [skipped, no changes] 0: /pfs/lustrep4/scratch/project_462000119/muennighoff/nov-2022-bettercom/Megatron-DeepSpeed/megatron/fused_kernels/scaled_masked_softmax_cuda.cu -> /pfs/lustrep4/scratch/project_462000119/muennighoff/nov-2022-bettercom/Megatron-DeepSpeed/megatron/fused_kernels/scaled_masked_softmax_hip.hip [skipped, already hipified] 0: /pfs/lustrep4/scratch/project_462000119/muennighoff/nov-2022-bettercom/Megatron-DeepSpeed/megatron/fused_kernels/type_shim.h -> /pfs/lustrep4/scratch/project_462000119/muennighoff/nov-2022-bettercom/Megatron-DeepSpeed/megatron/fused_kernels/type_shim.h [skipped, no changes] 0: /pfs/lustrep4/scratch/project_462000119/muennighoff/nov-2022-bettercom/Megatron-DeepSpeed/megatron/fused_kernels/compat.h -> /pfs/lustrep4/scratch/project_462000119/muennighoff/nov-2022-bettercom/Megatron-DeepSpeed/megatron/fused_kernels/compat.h [skipped, no changes] 0: /pfs/lustrep4/scratch/project_462000119/muennighoff/nov-2022-bettercom/Megatron-DeepSpeed/megatron/fused_kernels/scaled_upper_triang_masked_softmax.h -> /pfs/lustrep4/scratch/project_462000119/muennighoff/nov-2022-bettercom/Megatron-DeepSpeed/megatron/fused_kernels/scaled_upper_triang_masked_softmax_hip.h [skipped, already hipified] 0: /pfs/lustrep4/scratch/project_462000119/muennighoff/nov-2022-bettercom/Megatron-DeepSpeed/megatron/fused_kernels/scaled_masked_softmax.h -> /pfs/lustrep4/scratch/project_462000119/muennighoff/nov-2022-bettercom/Megatron-DeepSpeed/megatron/fused_kernels/scaled_masked_softmax_hip.h [skipped, already hipified] 0: Total number of unsupported CUDA function calls: 0 0: 0: 0: Total number of replaced kernel launches: 102 0: [1/1] c++ scaled_masked_softmax_hip.cuda.o scaled_masked_softmax_hip.o -shared -L/pfs/lustrep4/scratch/project_462000119/muennighoff/nov-2022-bettercom/venv/lib/python3.9/site-packages/torch/lib -lc10 -lc10_hip -ltorch_cpu -ltorch_hip -ltorch -ltorch_python -L/opt/rocm/lib -lamdhip64 -o scaled_masked_softmax_cuda.so 0: /pfs/lustrep4/scratch/project_462000119/muennighoff/nov-2022-bettercom/Megatron-DeepSpeed/megatron/fused_kernels/layer_norm_cuda.cpp -> /pfs/lustrep4/scratch/project_462000119/muennighoff/nov-2022-bettercom/Megatron-DeepSpeed/megatron/fused_kernels/layer_norm_cuda.cpp [skipped, no changes] 0: /pfs/lustrep4/scratch/project_462000119/muennighoff/nov-2022-bettercom/Megatron-DeepSpeed/megatron/fused_kernels/layer_norm_cuda_kernel.cu -> /pfs/lustrep4/scratch/project_462000119/muennighoff/nov-2022-bettercom/Megatron-DeepSpeed/megatron/fused_kernels/layer_norm_hip_kernel.hip [skipped, already hipified] 0: /pfs/lustrep4/scratch/project_462000119/muennighoff/nov-2022-bettercom/Megatron-DeepSpeed/megatron/fused_kernels/type_shim.h -> /pfs/lustrep4/scratch/project_462000119/muennighoff/nov-2022-bettercom/Megatron-DeepSpeed/megatron/fused_kernels/type_shim.h [skipped, no changes] 0: /pfs/lustrep4/scratch/project_462000119/muennighoff/nov-2022-bettercom/Megatron-DeepSpeed/megatron/fused_kernels/compat.h -> /pfs/lustrep4/scratch/project_462000119/muennighoff/nov-2022-bettercom/Megatron-DeepSpeed/megatron/fused_kernels/compat.h [skipped, no changes] 0: /pfs/lustrep4/scratch/project_462000119/muennighoff/nov-2022-bettercom/Megatron-DeepSpeed/megatron/fused_kernels/scaled_upper_triang_masked_softmax.h -> /pfs/lustrep4/scratch/project_462000119/muennighoff/nov-2022-bettercom/Megatron-DeepSpeed/megatron/fused_kernels/scaled_upper_triang_masked_softmax_hip.h [skipped, already hipified] 0: /pfs/lustrep4/scratch/project_462000119/muennighoff/nov-2022-bettercom/Megatron-DeepSpeed/megatron/fused_kernels/scaled_masked_softmax.h -> /pfs/lustrep4/scratch/project_462000119/muennighoff/nov-2022-bettercom/Megatron-DeepSpeed/megatron/fused_kernels/scaled_masked_softmax_hip.h [skipped, already hipified] 0: Total number of unsupported CUDA function calls: 0 0: 0: 0: Total number of replaced kernel launches: 67 0: ninja: no work to do. 0: >>> done with compiling and loading fused kernels. Compilation time: 50.069 seconds 0: time to initialize megatron (seconds): 49.913 0: [after megatron is initialized] datetime: 2023-04-29 17:22:41 0: building GPT model ... 0: [2023-04-29 17:22:42,056] [INFO] [utils.py:827:see_memory_usage] Before Building Model 0: [2023-04-29 17:22:42,057] [INFO] [utils.py:828:see_memory_usage] MA 0.0 GB Max_MA 0.0 GB CA 0.0 GB Max_CA 0 GB 0: [2023-04-29 17:22:42,057] [INFO] [utils.py:836:see_memory_usage] CPU Virtual Memory: used = 41.64 GB, percent = 8.3% 0: SEED_LAYERS=False BASE_SEED=1234 SEED_FN=None 0: Using topology: {ProcessCoord(pipe=0, data=0, model=0): 0, ProcessCoord(pipe=0, data=1, model=0): 1, ProcessCoord(pipe=0, data=2, model=0): 2, ProcessCoord(pipe=0, data=3, model=0): 3, ProcessCoord(pipe=0, data=4, model=0): 4, ProcessCoord(pipe=0, data=5, model=0): 5, ProcessCoord(pipe=0, data=6, model=0): 6, ProcessCoord(pipe=0, data=7, model=0): 7, ProcessCoord(pipe=0, data=8, model=0): 8, ProcessCoord(pipe=0, data=9, model=0): 9, ProcessCoord(pipe=0, data=10, model=0): 10, ProcessCoord(pipe=0, data=11, model=0): 11, ProcessCoord(pipe=0, data=12, model=0): 12, ProcessCoord(pipe=0, data=13, model=0): 13, ProcessCoord(pipe=0, data=14, model=0): 14, ProcessCoord(pipe=0, data=15, model=0): 15, ProcessCoord(pipe=0, data=16, model=0): 16, ProcessCoord(pipe=0, data=17, model=0): 17, ProcessCoord(pipe=0, data=18, model=0): 18, ProcessCoord(pipe=0, data=19, model=0): 19, ProcessCoord(pipe=0, data=20, model=0): 20, ProcessCoord(pipe=0, data=21, model=0): 21, ProcessCoord(pipe=0, data=22, model=0): 22, ProcessCoord(pi 0: pe=0, data=23, model=0): 23, ProcessCoord(pipe=0, data=24, model=0): 24, ProcessCoord(pipe=0, data=25, model=0): 25, ProcessCoord(pipe=0, data=26, model=0): 26, ProcessCoord(pipe=0, data=27, model=0): 27, ProcessCoord(pipe=0, data=28, model=0): 28, ProcessCoord(pipe=0, data=29, model=0): 29, ProcessCoord(pipe=0, data=30, model=0): 30, ProcessCoord(pipe=0, data=31, model=0): 31, ProcessCoord(pipe=0, data=32, model=0): 32, ProcessCoord(pipe=0, data=33, model=0): 33, ProcessCoord(pipe=0, data=34, model=0): 34, ProcessCoord(pipe=0, data=35, model=0): 35, ProcessCoord(pipe=0, data=36, model=0): 36, ProcessCoord(pipe=0, data=37, model=0): 37, ProcessCoord(pipe=0, data=38, model=0): 38, ProcessCoord(pipe=0, data=39, model=0): 39, ProcessCoord(pipe=0, data=40, model=0): 40, ProcessCoord(pipe=0, data=41, model=0): 41, ProcessCoord(pipe=0, data=42, model=0): 42, ProcessCoord(pipe=0, data=43, model=0): 43, ProcessCoord(pipe=0, data=44, model=0): 44, ProcessCoord(pipe=0, data=45, model=0): 45, ProcessCoord(pipe=0, data=4 0: 6, model=0): 46, ProcessCoord(pipe=0, data=47, model=0): 47, ProcessCoord(pipe=0, data=48, model=0): 48, ProcessCoord(pipe=0, data=49, model=0): 49, ProcessCoord(pipe=0, data=50, model=0): 50, ProcessCoord(pipe=0, data=51, model=0): 51, ProcessCoord(pipe=0, data=52, model=0): 52, ProcessCoord(pipe=0, data=53, model=0): 53, ProcessCoord(pipe=0, data=54, model=0): 54, ProcessCoord(pipe=0, data=55, model=0): 55, ProcessCoord(pipe=0, data=56, model=0): 56, ProcessCoord(pipe=0, data=57, model=0): 57, ProcessCoord(pipe=0, data=58, model=0): 58, ProcessCoord(pipe=0, data=59, model=0): 59, ProcessCoord(pipe=0, data=60, model=0): 60, ProcessCoord(pipe=0, data=61, model=0): 61, ProcessCoord(pipe=0, data=62, model=0): 62, ProcessCoord(pipe=0, data=63, model=0): 63, ProcessCoord(pipe=0, data=64, model=0): 64, ProcessCoord(pipe=0, data=65, model=0): 65, ProcessCoord(pipe=0, data=66, model=0): 66, ProcessCoord(pipe=0, data=67, model=0): 67, ProcessCoord(pipe=0, data=68, model=0): 68, ProcessCoord(pipe=0, data=69, model=0): 0: 69, ProcessCoord(pipe=0, data=70, model=0): 70, ProcessCoord(pipe=0, data=71, model=0): 71, ProcessCoord(pipe=0, data=72, model=0): 72, ProcessCoord(pipe=0, data=73, model=0): 73, ProcessCoord(pipe=0, data=74, model=0): 74, ProcessCoord(pipe=0, data=75, model=0): 75, ProcessCoord(pipe=0, data=76, model=0): 76, ProcessCoord(pipe=0, data=77, model=0): 77, ProcessCoord(pipe=0, data=78, model=0): 78, ProcessCoord(pipe=0, data=79, model=0): 79, ProcessCoord(pipe=0, data=80, model=0): 80, ProcessCoord(pipe=0, data=81, model=0): 81, ProcessCoord(pipe=0, data=82, model=0): 82, ProcessCoord(pipe=0, data=83, model=0): 83, ProcessCoord(pipe=0, data=84, model=0): 84, ProcessCoord(pipe=0, data=85, model=0): 85, ProcessCoord(pipe=0, data=86, model=0): 86, ProcessCoord(pipe=0, data=87, model=0): 87, ProcessCoord(pipe=0, data=88, model=0): 88, ProcessCoord(pipe=0, data=89, model=0): 89, ProcessCoord(pipe=0, data=90, model=0): 90, ProcessCoord(pipe=0, data=91, model=0): 91, ProcessCoord(pipe=0, data=92, model=0): 92, Process 0: Coord(pipe=0, data=93, model=0): 93, ProcessCoord(pipe=0, data=94, model=0): 94, ProcessCoord(pipe=0, data=95, model=0): 95, ProcessCoord(pipe=0, data=96, model=0): 96, ProcessCoord(pipe=0, data=97, model=0): 97, ProcessCoord(pipe=0, data=98, model=0): 98, ProcessCoord(pipe=0, data=99, model=0): 99, ProcessCoord(pipe=0, data=100, model=0): 100, ProcessCoord(pipe=0, data=101, model=0): 101, ProcessCoord(pipe=0, data=102, model=0): 102, ProcessCoord(pipe=0, data=103, model=0): 103, ProcessCoord(pipe=0, data=104, model=0): 104, ProcessCoord(pipe=0, data=105, model=0): 105, ProcessCoord(pipe=0, data=106, model=0): 106, ProcessCoord(pipe=0, data=107, model=0): 107, ProcessCoord(pipe=0, data=108, model=0): 108, ProcessCoord(pipe=0, data=109, model=0): 109, ProcessCoord(pipe=0, data=110, model=0): 110, ProcessCoord(pipe=0, data=111, model=0): 111, ProcessCoord(pipe=0, data=112, model=0): 112, ProcessCoord(pipe=0, data=113, model=0): 113, ProcessCoord(pipe=0, data=114, model=0): 114, ProcessCoord(pipe=0, data=115, mo 0: del=0): 115, ProcessCoord(pipe=0, data=116, model=0): 116, ProcessCoord(pipe=0, data=117, model=0): 117, ProcessCoord(pipe=0, data=118, model=0): 118, ProcessCoord(pipe=0, data=119, model=0): 119, ProcessCoord(pipe=0, data=120, model=0): 120, ProcessCoord(pipe=0, data=121, model=0): 121, ProcessCoord(pipe=0, data=122, model=0): 122, ProcessCoord(pipe=0, data=123, model=0): 123, ProcessCoord(pipe=0, data=124, model=0): 124, ProcessCoord(pipe=0, data=125, model=0): 125, ProcessCoord(pipe=0, data=126, model=0): 126, ProcessCoord(pipe=0, data=127, model=0): 127, ProcessCoord(pipe=0, data=128, model=0): 128, ProcessCoord(pipe=0, data=129, model=0): 129, ProcessCoord(pipe=0, data=130, model=0): 130, ProcessCoord(pipe=0, data=131, model=0): 131, ProcessCoord(pipe=0, data=132, model=0): 132, ProcessCoord(pipe=0, data=133, model=0): 133, ProcessCoord(pipe=0, data=134, model=0): 134, ProcessCoord(pipe=0, data=135, model=0): 135, ProcessCoord(pipe=0, data=136, model=0): 136, ProcessCoord(pipe=0, data=137, model=0): 137, 0: ProcessCoord(pipe=0, data=138, model=0): 138, ProcessCoord(pipe=0, data=139, model=0): 139, ProcessCoord(pipe=0, data=140, model=0): 140, ProcessCoord(pipe=0, data=141, model=0): 141, ProcessCoord(pipe=0, data=142, model=0): 142, ProcessCoord(pipe=0, data=143, model=0): 143, ProcessCoord(pipe=0, data=144, model=0): 144, ProcessCoord(pipe=0, data=145, model=0): 145, ProcessCoord(pipe=0, data=146, model=0): 146, ProcessCoord(pipe=0, data=147, model=0): 147, ProcessCoord(pipe=0, data=148, model=0): 148, ProcessCoord(pipe=0, data=149, model=0): 149, ProcessCoord(pipe=0, data=150, model=0): 150, ProcessCoord(pipe=0, data=151, model=0): 151, ProcessCoord(pipe=0, data=152, model=0): 152, ProcessCoord(pipe=0, data=153, model=0): 153, ProcessCoord(pipe=0, data=154, model=0): 154, ProcessCoord(pipe=0, data=155, model=0): 155, ProcessCoord(pipe=0, data=156, model=0): 156, ProcessCoord(pipe=0, data=157, model=0): 157, ProcessCoord(pipe=0, data=158, model=0): 158, ProcessCoord(pipe=0, data=159, model=0): 159, ProcessCoor 0: d(pipe=0, data=160, model=0): 160, ProcessCoord(pipe=0, data=161, model=0): 161, ProcessCoord(pipe=0, data=162, model=0): 162, ProcessCoord(pipe=0, data=163, model=0): 163, ProcessCoord(pipe=0, data=164, model=0): 164, ProcessCoord(pipe=0, data=165, model=0): 165, ProcessCoord(pipe=0, data=166, model=0): 166, ProcessCoord(pipe=0, data=167, model=0): 167, ProcessCoord(pipe=0, data=168, model=0): 168, ProcessCoord(pipe=0, data=169, model=0): 169, ProcessCoord(pipe=0, data=170, model=0): 170, ProcessCoord(pipe=0, data=171, model=0): 171, ProcessCoord(pipe=0, data=172, model=0): 172, ProcessCoord(pipe=0, data=173, model=0): 173, ProcessCoord(pipe=0, data=174, model=0): 174, ProcessCoord(pipe=0, data=175, model=0): 175, ProcessCoord(pipe=0, data=176, model=0): 176, ProcessCoord(pipe=0, data=177, model=0): 177, ProcessCoord(pipe=0, data=178, model=0): 178, ProcessCoord(pipe=0, data=179, model=0): 179, ProcessCoord(pipe=0, data=180, model=0): 180, ProcessCoord(pipe=0, data=181, model=0): 181, ProcessCoord(pipe=0, da 0: ta=182, model=0): 182, ProcessCoord(pipe=0, data=183, model=0): 183, ProcessCoord(pipe=0, data=184, model=0): 184, ProcessCoord(pipe=0, data=185, model=0): 185, ProcessCoord(pipe=0, data=186, model=0): 186, ProcessCoord(pipe=0, data=187, model=0): 187, ProcessCoord(pipe=0, data=188, model=0): 188, ProcessCoord(pipe=0, data=189, model=0): 189, ProcessCoord(pipe=0, data=190, model=0): 190, ProcessCoord(pipe=0, data=191, model=0): 191, ProcessCoord(pipe=0, data=192, model=0): 192, ProcessCoord(pipe=0, data=193, model=0): 193, ProcessCoord(pipe=0, data=194, model=0): 194, ProcessCoord(pipe=0, data=195, model=0): 195, ProcessCoord(pipe=0, data=196, model=0): 196, ProcessCoord(pipe=0, data=197, model=0): 197, ProcessCoord(pipe=0, data=198, model=0): 198, ProcessCoord(pipe=0, data=199, model=0): 199, ProcessCoord(pipe=0, data=200, model=0): 200, ProcessCoord(pipe=0, data=201, model=0): 201, ProcessCoord(pipe=0, data=202, model=0): 202, ProcessCoord(pipe=0, data=203, model=0): 203, ProcessCoord(pipe=0, data=204, mode 0: l=0): 204, ProcessCoord(pipe=0, data=205, model=0): 205, ProcessCoord(pipe=0, data=206, model=0): 206, ProcessCoord(pipe=0, data=207, model=0): 207, ProcessCoord(pipe=0, data=208, model=0): 208, ProcessCoord(pipe=0, data=209, model=0): 209, ProcessCoord(pipe=0, data=210, model=0): 210, ProcessCoord(pipe=0, data=211, model=0): 211, ProcessCoord(pipe=0, data=212, model=0): 212, ProcessCoord(pipe=0, data=213, model=0): 213, ProcessCoord(pipe=0, data=214, model=0): 214, ProcessCoord(pipe=0, data=215, model=0): 215, ProcessCoord(pipe=0, data=216, model=0): 216, ProcessCoord(pipe=0, data=217, model=0): 217, ProcessCoord(pipe=0, data=218, model=0): 218, ProcessCoord(pipe=0, data=219, model=0): 219, ProcessCoord(pipe=0, data=220, model=0): 220, ProcessCoord(pipe=0, data=221, model=0): 221, ProcessCoord(pipe=0, data=222, model=0): 222, ProcessCoord(pipe=0, data=223, model=0): 223, ProcessCoord(pipe=0, data=224, model=0): 224, ProcessCoord(pipe=0, data=225, model=0): 225, ProcessCoord(pipe=0, data=226, model=0): 226, P 0: rocessCoord(pipe=0, data=227, model=0): 227, ProcessCoord(pipe=0, data=228, model=0): 228, ProcessCoord(pipe=0, data=229, model=0): 229, ProcessCoord(pipe=0, data=230, model=0): 230, ProcessCoord(pipe=0, data=231, model=0): 231, ProcessCoord(pipe=0, data=232, model=0): 232, ProcessCoord(pipe=0, data=233, model=0): 233, ProcessCoord(pipe=0, data=234, model=0): 234, ProcessCoord(pipe=0, data=235, model=0): 235, ProcessCoord(pipe=0, data=236, model=0): 236, ProcessCoord(pipe=0, data=237, model=0): 237, ProcessCoord(pipe=0, data=238, model=0): 238, ProcessCoord(pipe=0, data=239, model=0): 239, ProcessCoord(pipe=0, data=240, model=0): 240, ProcessCoord(pipe=0, data=241, model=0): 241, ProcessCoord(pipe=0, data=242, model=0): 242, ProcessCoord(pipe=0, data=243, model=0): 243, ProcessCoord(pipe=0, data=244, model=0): 244, ProcessCoord(pipe=0, data=245, model=0): 245, ProcessCoord(pipe=0, data=246, model=0): 246, ProcessCoord(pipe=0, data=247, model=0): 247, ProcessCoord(pipe=0, data=248, model=0): 248, ProcessCoord( 0: pipe=0, data=249, model=0): 249, ProcessCoord(pipe=0, data=250, model=0): 250, ProcessCoord(pipe=0, data=251, model=0): 251, ProcessCoord(pipe=0, data=252, model=0): 252, ProcessCoord(pipe=0, data=253, model=0): 253, ProcessCoord(pipe=0, data=254, model=0): 254, ProcessCoord(pipe=0, data=255, model=0): 255} 0: [2023-04-29 17:22:50,240] [INFO] [module.py:366:_partition_layers] Partitioning pipeline stages with method type:transformer 0: stage=0 layers=41 0: 0: _to_float16 0: 1: EmbeddingPipe 0: 2: 0: 3: ParallelTransformerLayerPipe 0: 4: ParallelTransformerLayerPipe 0: 5: ParallelTransformerLayerPipe 0: 6: ParallelTransformerLayerPipe 0: 7: ParallelTransformerLayerPipe 0: 8: ParallelTransformerLayerPipe 0: 9: ParallelTransformerLayerPipe 0: 10: ParallelTransformerLayerPipe 0: 11: ParallelTransformerLayerPipe 0: 12: ParallelTransformerLayerPipe 0: 13: ParallelTransformerLayerPipe 0: 14: ParallelTransformerLayerPipe 0: 15: ParallelTransformerLayerPipe 0: 16: ParallelTransformerLayerPipe 0: 17: ParallelTransformerLayerPipe 0: 18: ParallelTransformerLayerPipe 0: 19: ParallelTransformerLayerPipe 0: 20: ParallelTransformerLayerPipe 0: 21: ParallelTransformerLayerPipe 0: 22: ParallelTransformerLayerPipe 0: 23: ParallelTransformerLayerPipe 0: 24: ParallelTransformerLayerPipe 0: 25: ParallelTransformerLayerPipe 0: 26: ParallelTransformerLayerPipe 0: 27: ParallelTransformerLayerPipe 0: 28: ParallelTransformerLayerPipe 0: 29: ParallelTransformerLayerPipe 0: 30: ParallelTransformerLayerPipe 0: 31: ParallelTransformerLayerPipe 0: 32: ParallelTransformerLayerPipe 0: 33: ParallelTransformerLayerPipe 0: 34: ParallelTransformerLayerPipe 0: 35: ParallelTransformerLayerPipe 0: 36: ParallelTransformerLayerPipe 0: 37: undo 0: 38: MixedFusedLayerNorm 0: 39: EmbeddingPipe 0: 40: float16_to_fp32 0: loss: CrossEntropy 0: [2023-04-29 17:22:50,634] [INFO] [utils.py:827:see_memory_usage] After Building Model 0: [2023-04-29 17:22:50,635] [INFO] [utils.py:828:see_memory_usage] MA 5.26 GB Max_MA 5.26 GB CA 5.31 GB Max_CA 5 GB 0: [2023-04-29 17:22:50,635] [INFO] [utils.py:836:see_memory_usage] CPU Virtual Memory: used = 41.8 GB, percent = 8.3% 0: setting training iterations to 0 0: > learning rate decay style: cosine 0: DeepSpeed is enabled. 0: [2023-04-29 17:22:50,638] [INFO] [logging.py:68:log_dist] [Rank 0] DeepSpeed info: version=0.7.5, git-hash=unknown, git-branch=unknown 0: [2023-04-29 17:23:14,828] [INFO] [logging.py:68:log_dist] [Rank 0] DeepSpeed Flops Profiler Enabled: False 0: [2023-04-29 17:23:14,829] [INFO] [logging.py:68:log_dist] [Rank 0] Removing param_group that has no 'params' in the client Optimizer 0: [2023-04-29 17:23:14,829] [INFO] [logging.py:68:log_dist] [Rank 0] Using client Optimizer as basic optimizer 0: [2023-04-29 17:23:14,847] [INFO] [logging.py:68:log_dist] [Rank 0] DeepSpeed Basic Optimizer = FusedAdam 0: [2023-04-29 17:23:14,847] [INFO] [logging.py:68:log_dist] [Rank 0] Creating BF16 optimizer 0: [2023-04-29 17:23:14,973] [INFO] [utils.py:827:see_memory_usage] begin bf16_optimizer 0: [2023-04-29 17:23:14,973] [INFO] [utils.py:828:see_memory_usage] MA 5.25 GB Max_MA 5.27 GB CA 5.32 GB Max_CA 5 GB 0: [2023-04-29 17:23:14,974] [INFO] [utils.py:836:see_memory_usage] CPU Virtual Memory: used = 42.44 GB, percent = 8.4% 0: ninja: no work to do. 0: Time to load utils op: 0.3739035129547119 seconds 0: Time to load utils op: 0.37711572647094727 seconds 0: Time to load utils op: 0.0005733966827392578 seconds 0: Time to load utils op: 0.0004799365997314453 seconds 3: Time to load utils op: 0.6219236850738525 seconds 3: Time to load utils op: 0.6219372749328613 seconds 3: Time to load utils op: 0.6219563484191895 secondsTime to load utils op: 0.621821403503418 secondsTime to load utils op: 0.621955394744873 seconds 3: Time to load utils op: 0.6219601631164551 seconds 3: Time to load utils op: 0.6218373775482178 seconds 3: 3: 3: Time to load utils op: 0.6219706535339355 seconds 0: Time to load utils op: 0.629636287689209 secondsTime to load utils op: 0.6296119689941406 seconds 0: 0: Time to load utils op: 0.6289937496185303 seconds 0: Time to load utils op: 0.6297862529754639 seconds 0: Time to load utils op: 0.6302139759063721 seconds 0: Time to load utils op: 0.6056714057922363 seconds 2: Time to load utils op: 0.6491332054138184 seconds 2: Time to load utils op: 0.6487917900085449 seconds 2: Time to load utils op: 0.6484832763671875 seconds 2: Time to load utils op: 0.6490507125854492 secondsTime to load utils op: 0.6497924327850342 seconds 2: 2: Time to load utils op: 0.6479315757751465 seconds 2: Time to load utils op: 0.6486806869506836 seconds 2: Time to load utils op: 0.6484715938568115 seconds 0: Time to load utils op: 0.0005800724029541016 seconds 0: Time to load utils op: 0.0005323886871337891 seconds 9: Time to load utils op: 0.6371252536773682 secondsTime to load utils op: 0.6371326446533203 seconds 9: 9: Time to load utils op: 0.6371538639068604 secondsTime to load utils op: 0.6371521949768066 seconds 9: 9: Time to load utils op: 0.6371860504150391 seconds 9: Time to load utils op: 0.6371781826019287 secondsTime to load utils op: 0.6371746063232422 seconds 9: 9: Time to load utils op: 0.6371889114379883 seconds 0: Time to load utils op: 0.0004119873046875 seconds 0: Time to load utils op: 0.00043487548828125 seconds 0: Time to load utils op: 0.0004088878631591797 seconds 8: Time to load utils op: 0.6396529674530029 secondsTime to load utils op: 0.6396582126617432 seconds 8: 8: Time to load utils op: 0.6396920680999756 seconds 8: Time to load utils op: 0.6397016048431396 seconds 8: Time to load utils op: 0.6397178173065186 seconds 8: Time to load utils op: 0.6397128105163574 seconds 8: Time to load utils op: 0.6397109031677246 secondsTime to load utils op: 0.6397116184234619 seconds 8: 6: Time to load utils op: 0.643946647644043 seconds 6: Time to load utils op: 0.6439616680145264 seconds 6: Time to load utils op: 0.6439723968505859 seconds 6: Time to load utils op: 0.643998384475708 seconds 6: Time to load utils op: 0.644010066986084 secondsTime to load utils op: 0.644000768661499 seconds 6: 6: Time to load utils op: 0.6440167427062988 seconds 6: Time to load utils op: 0.6440262794494629 seconds 5: Time to load utils op: 0.6447134017944336 seconds 5: Time to load utils op: 0.6447539329528809 seconds 5: Time to load utils op: 0.6447598934173584 seconds 5: Time to load utils op: 0.6447939872741699 secondsTime to load utils op: 0.6447937488555908 seconds 5: 5: Time to load utils op: 0.6447873115539551 secondsTime to load utils op: 0.6447892189025879 seconds 5: Time to load utils op: 0.644782543182373 seconds 5: 1: Time to load utils op: 0.6472232341766357 secondsTime to load utils op: 0.6470563411712646 secondsTime to load utils op: 0.6472156047821045 seconds 1: 1: 4: Time to load utils op: 0.6442511081695557 seconds 4: Time to load utils op: 0.6442651748657227 seconds 1: Time to load utils op: 0.6472468376159668 seconds 4: Time to load utils op: 0.6443238258361816 seconds 4: Time to load utils op: 0.6443436145782471 seconds 4: Time to load utils op: 0.6442263126373291 seconds 1: Time to load utils op: 0.6472651958465576 seconds 4: Time to load utils op: 0.6443476676940918 secondsTime to load utils op: 0.6443600654602051 seconds 4: 4: Time to load utils op: 0.6443641185760498 seconds 1: Time to load utils op: 0.6472673416137695 seconds 1: Time to load utils op: 0.6472628116607666 seconds 1: Time to load utils op: 0.6472773551940918 seconds 7: Time to load utils op: 0.647930383682251 secondsTime to load utils op: 0.6496446132659912 seconds 7: 7: Time to load utils op: 0.64949631690979 seconds 7: Time to load utils op: 0.6494629383087158 secondsTime to load utils op: 0.6495552062988281 secondsTime to load utils op: 0.6494705677032471 seconds 7: 7: 7: Time to load utils op: 0.6496939659118652 seconds 7: Time to load utils op: 0.649559736251831 seconds 10: Time to load utils op: 0.6420233249664307 seconds 10: Time to load utils op: 0.6420509815216064 seconds 10: Time to load utils op: 0.642071008682251 seconds 10: Time to load utils op: 0.6420903205871582 seconds 10: Time to load utils op: 0.6421215534210205 secondsTime to load utils op: 0.6421103477478027 secondsTime to load utils op: 0.642115592956543 seconds 10: 10: 10: Time to load utils op: 0.6421213150024414 seconds 11: Time to load utils op: 0.6414353847503662 secondsTime to load utils op: 0.6414358615875244 seconds 11: 11: Time to load utils op: 0.6414525508880615 seconds 11: Time to load utils op: 0.6414475440979004 seconds 11: Time to load utils op: 0.6414680480957031 secondsTime to load utils op: 0.6414623260498047 seconds 11: Time to load utils op: 0.6414692401885986 seconds 11: Time to load utils op: 0.6414735317230225 seconds 11: 12: Time to load utils op: 0.6424844264984131 seconds 12: Time to load utils op: 0.6424965858459473 seconds 12: Time to load utils op: 0.6425075531005859 seconds 12: Time to load utils op: 0.6425395011901855 seconds 12: Time to load utils op: 0.6425337791442871 seconds 12: Time to load utils op: 0.6425511837005615 seconds 12: Time to load utils op: 0.6425526142120361 seconds 12: Time to load utils op: 0.6425595283508301 seconds 13: Time to load utils op: 0.6414849758148193 secondsTime to load utils op: 0.641486406326294 seconds 13: 13: Time to load utils op: 0.6414968967437744 seconds 13: Time to load utils op: 0.6415395736694336 seconds 13: Time to load utils op: 0.6415307521820068 secondsTime to load utils op: 0.6415355205535889 seconds 13: 13: Time to load utils op: 0.6415438652038574 seconds 13: Time to load utils op: 0.6415495872497559 seconds 17: Time to load utils op: 0.6372232437133789 seconds 17: Time to load utils op: 0.6372394561767578 seconds 17: Time to load utils op: 0.6372551918029785 seconds 17: Time to load utils op: 0.6372714042663574 seconds 17: Time to load utils op: 0.6372876167297363 secondsTime to load utils op: 0.6372859477996826 seconds 17: 17: Time to load utils op: 0.637291669845581 seconds 17: Time to load utils op: 0.6372876167297363 seconds 24: Time to load utils op: 0.6344010829925537 seconds 24: Time to load utils op: 0.636608362197876 secondsTime to load utils op: 0.6355190277099609 seconds 24: 24: Time to load utils op: 0.6363186836242676 secondsTime to load utils op: 0.635066032409668 seconds 24: 24: Time to load utils op: 0.6359057426452637 seconds 24: Time to load utils op: 0.6349804401397705 seconds 24: Time to load utils op: 0.6341819763183594 seconds 18: Time to load utils op: 0.638012170791626 secondsTime to load utils op: 0.6380126476287842 seconds 18: 18: Time to load utils op: 0.6380383968353271 seconds 18: Time to load utils op: 0.6380431652069092 secondsTime to load utils op: 0.6380579471588135 seconds 18: 18: Time to load utils op: 0.6380610466003418 secondsTime to load utils op: 0.6380622386932373 secondsTime to load utils op: 0.6380560398101807 seconds 18: 18: 14: Time to load utils op: 0.6429927349090576 seconds 14: Time to load utils op: 0.6430232524871826 seconds 14: Time to load utils op: 0.6430635452270508 secondsTime to load utils op: 0.6430695056915283 seconds 14: 14: Time to load utils op: 0.6430728435516357 seconds 14: Time to load utils op: 0.6430461406707764 seconds 14: Time to load utils op: 0.6430835723876953 seconds 14: Time to load utils op: 0.64308762550354 seconds 20: Time to load utils op: 0.6423101425170898 seconds 23: Time to load utils op: 0.6385457515716553 seconds 23: Time to load utils op: 0.6384634971618652 seconds 23: Time to load utils op: 0.638709545135498 seconds 20: Time to load utils op: 0.6435034275054932 seconds 20: Time to load utils op: 0.6423690319061279 seconds 20: Time to load utils op: 0.6438720226287842 secondsTime to load utils op: 0.6433939933776855 seconds 20: 20: Time to load utils op: 0.6428713798522949 seconds 20: Time to load utils op: 0.6426973342895508 seconds 20: Time to load utils op: 0.6439683437347412 seconds 23: Time to load utils op: 0.6403255462646484 secondsTime to load utils op: 0.6395120620727539 seconds 23: 23: Time to load utils op: 0.6397037506103516 secondsTime to load utils op: 0.6400256156921387 seconds 23: 23: Time to load utils op: 0.6390080451965332 seconds 19: Time to load utils op: 0.6368246078491211 seconds 19: Time to load utils op: 0.6368529796600342 seconds 19: Time to load utils op: 0.6368722915649414 seconds 19: Time to load utils op: 0.6368722915649414 seconds 19: Time to load utils op: 0.636883020401001 seconds 19: Time to load utils op: 0.6368927955627441 secondsTime to load utils op: 0.6369082927703857 seconds 19: 19: Time to load utils op: 0.6368992328643799 seconds 16: Time to load utils op: 0.6395130157470703 seconds 16: Time to load utils op: 0.639519453048706 seconds 16: Time to load utils op: 0.6393520832061768 seconds 16: Time to load utils op: 0.6395537853240967 secondsTime to load utils op: 0.6395525932312012 seconds 16: 16: Time to load utils op: 0.6395509243011475 seconds 16: Time to load utils op: 0.6395564079284668 seconds 15: Time to load utils op: 0.6406142711639404 secondsTime to load utils op: 0.6406159400939941 secondsTime to load utils op: 0.6406288146972656 seconds 15: 15: 16: Time to load utils op: 0.6395606994628906 seconds 15: Time to load utils op: 0.6435391902923584 secondsTime to load utils op: 0.6406221389770508 seconds 15: 15: Time to load utils op: 0.640648603439331 seconds 15: Time to load utils op: 0.6422276496887207 secondsTime to load utils op: 0.6435580253601074 seconds 15: 26: Time to load utils op: 0.6357691287994385 secondsTime to load utils op: 0.6353039741516113 seconds 26: 26: Time to load utils op: 0.6353421211242676 seconds 26: Time to load utils op: 0.6353697776794434 seconds 26: Time to load utils op: 0.6351077556610107 seconds 26: Time to load utils op: 0.635343074798584 secondsTime to load utils op: 0.6356918811798096 seconds 26: 26: Time to load utils op: 0.6355829238891602 seconds 30: Time to load utils op: 0.6258904933929443 secondsTime to load utils op: 0.6259033679962158 seconds 30: 30: Time to load utils op: 0.6259477138519287 seconds 30: Time to load utils op: 0.6259374618530273 secondsTime to load utils op: 0.625938892364502 seconds 30: 30: Time to load utils op: 0.6259498596191406 secondsTime to load utils op: 0.6259407997131348 seconds 30: 30: Time to load utils op: 0.6259558200836182 seconds 25: Time to load utils op: 0.6333849430084229 secondsTime to load utils op: 0.63340163230896 secondsTime to load utils op: 0.6334083080291748 seconds 25: 25: 25: Time to load utils op: 0.6334228515625 seconds 25: Time to load utils op: 0.6334292888641357 seconds 25: Time to load utils op: 0.6334342956542969 secondsTime to load utils op: 0.6334428787231445 seconds 25: 25: Time to load utils op: 0.6334402561187744 seconds 31: Time to load utils op: 0.6258845329284668 seconds 31: Time to load utils op: 0.6259109973907471 seconds 31: Time to load utils op: 0.6259400844573975 secondsTime to load utils op: 0.6259458065032959 seconds 31: 31: Time to load utils op: 0.6259503364562988 secondsTime to load utils op: 0.6259489059448242 seconds 31: 31: Time to load utils op: 0.6259572505950928 seconds 31: Time to load utils op: 0.6259677410125732 seconds 21: Time to load utils op: 0.6353175640106201 seconds 21: Time to load utils op: 0.6353409290313721 seconds 21: Time to load utils op: 0.6353461742401123 seconds 21: Time to load utils op: 0.6353514194488525 seconds 21: Time to load utils op: 0.6353867053985596 secondsTime to load utils op: 0.635383129119873 seconds 21: 21: Time to load utils op: 0.6353933811187744 seconds 21: Time to load utils op: 0.6353862285614014 seconds 22: Time to load utils op: 0.6335391998291016 secondsTime to load utils op: 0.6335029602050781 seconds 22: 22: Time to load utils op: 0.6335394382476807 seconds 22: Time to load utils op: 0.6335523128509521 seconds 22: Time to load utils op: 0.6335623264312744 secondsTime to load utils op: 0.6335623264312744 seconds 22: Time to load utils op: 0.6335718631744385 seconds 22: 22: Time to load utils op: 0.6335718631744385 seconds 29: Time to load utils op: 0.627260684967041 seconds 29: Time to load utils op: 0.6272680759429932 seconds 29: Time to load utils op: 0.6272814273834229 seconds 29: Time to load utils op: 0.6272749900817871 seconds 29: Time to load utils op: 0.627295970916748 seconds 29: Time to load utils op: 0.6273031234741211 secondsTime to load utils op: 0.6273143291473389 seconds 29: 29: Time to load utils op: 0.6273057460784912 seconds 28: Time to load utils op: 0.6297614574432373 secondsTime to load utils op: 0.6297650337219238 seconds 28: 28: Time to load utils op: 0.6297593116760254 secondsTime to load utils op: 0.6297664642333984 seconds 28: 28: Time to load utils op: 0.6297886371612549 seconds 28: Time to load utils op: 0.6297867298126221 secondsTime to load utils op: 0.6297919750213623 secondsTime to load utils op: 0.6297922134399414 seconds 28: 28: 27: Time to load utils op: 0.6317563056945801 seconds 27: Time to load utils op: 0.6317625045776367 seconds 27: Time to load utils op: 0.6317648887634277 seconds 27: Time to load utils op: 0.6317996978759766 secondsTime to load utils op: 0.631807804107666 seconds 27: 27: Time to load utils op: 0.6318128108978271 seconds 27: Time to load utils op: 0.6318137645721436 seconds 27: Time to load utils op: 0.6318247318267822 seconds 5: Time to load utils op: 0.0009546279907226562 seconds 5: Time to load utils op: 0.0010833740234375 seconds 5: Time to load utils op: 0.0012323856353759766 seconds 5: Time to load utils op: 0.001245260238647461 seconds 5: Time to load utils op: 0.0013766288757324219 secondsTime to load utils op: 0.001131296157836914 seconds 5: 5: Time to load utils op: 0.0014121532440185547 seconds 5: Time to load utils op: 0.001416921615600586 seconds 6: Time to load utils op: 0.0008244514465332031 seconds 6: Time to load utils op: 0.0008728504180908203 seconds 6: Time to load utils op: 0.0011093616485595703 seconds 6: Time to load utils op: 0.0010013580322265625 seconds 6: Time to load utils op: 0.0009713172912597656 seconds 11: Time to load utils op: 0.0011432170867919922 seconds 11: Time to load utils op: 0.0011889934539794922 seconds 6: Time to load utils op: 0.0012328624725341797 seconds 6: Time to load utils op: 0.0012159347534179688 seconds 6: Time to load utils op: 0.0014061927795410156 seconds 11: Time to load utils op: 0.0017063617706298828 seconds 11: Time to load utils op: 0.0017154216766357422 secondsTime to load utils op: 0.00171661376953125 seconds 11: 11: Time to load utils op: 0.001737833023071289 seconds 11: Time to load utils op: 0.0017092227935791016 seconds 11: Time to load utils op: 0.001795053482055664 seconds 4: Time to load utils op: 0.0012774467468261719 seconds 4: Time to load utils op: 0.0012600421905517578 seconds 9: Time to load utils op: 0.0013239383697509766 seconds 4: Time to load utils op: 0.0018405914306640625 seconds 4: Time to load utils op: 0.0017805099487304688 secondsTime to load utils op: 0.0018041133880615234 seconds 4: 4: Time to load utils op: 0.0018663406372070312 seconds 4: Time to load utils op: 0.0017819404602050781 seconds 3: Time to load utils op: 0.0014903545379638672 seconds 7: Time to load utils op: 0.0014154911041259766 seconds 4: Time to load utils op: 0.0019459724426269531 seconds 9: Time to load utils op: 0.0019812583923339844 seconds 9: Time to load utils op: 0.0019845962524414062 seconds 9: Time to load utils op: 0.001997709274291992 seconds 9: Time to load utils op: 0.0019474029541015625 seconds 9: Time to load utils op: 0.0019412040710449219 seconds 9: Time to load utils op: 0.001970052719116211 seconds 9: Time to load utils op: 0.0017027854919433594 seconds 7: Time to load utils op: 0.0017452239990234375 seconds 3: Time to load utils op: 0.001796722412109375 secondsTime to load utils op: 0.0017392635345458984 seconds 3: 3: Time to load utils op: 0.0017650127410888672 seconds 3: Time to load utils op: 0.0018281936645507812 seconds 3: Time to load utils op: 0.001764059066772461 seconds 3: Time to load utils op: 0.0017533302307128906 seconds 3: Time to load utils op: 0.0018155574798583984 seconds 7: Time to load utils op: 0.0018131732940673828 seconds 7: Time to load utils op: 0.0017337799072265625 seconds 7: Time to load utils op: 0.001821756362915039 seconds 7: Time to load utils op: 0.0017981529235839844 seconds 7: Time to load utils op: 0.0017888545989990234 seconds 7: Time to load utils op: 0.0018830299377441406 seconds 1: Time to load utils op: 0.0012121200561523438 seconds 1: Time to load utils op: 0.0012023448944091797 seconds 1: Time to load utils op: 0.0015304088592529297 seconds 10: Time to load utils op: 0.0007429122924804688 seconds 10: Time to load utils op: 0.0009300708770751953 seconds 8: Time to load utils op: 0.0009014606475830078 secondsTime to load utils op: 0.0008869171142578125 seconds 8: 10: Time to load utils op: 0.0011780261993408203 seconds 2: Time to load utils op: 0.0009398460388183594 seconds 2: Time to load utils op: 0.0009915828704833984 seconds 1: Time to load utils op: 0.0021009445190429688 secondsTime to load utils op: 0.0020880699157714844 seconds 1: 8: Time to load utils op: 0.0012078285217285156 seconds 8: Time to load utils op: 0.0012009143829345703 seconds 8: Time to load utils op: 0.0011377334594726562 seconds 1: Time to load utils op: 0.0020933151245117188 seconds 10: Time to load utils op: 0.0014085769653320312 seconds 10: Time to load utils op: 0.0014281272888183594 seconds 1: Time to load utils op: 0.0020825862884521484 seconds 8: Time to load utils op: 0.0012516975402832031 seconds 8: Time to load utils op: 0.0011200904846191406 seconds 10: Time to load utils op: 0.0013511180877685547 secondsTime to load utils op: 0.0013804435729980469 seconds 10: 1: Time to load utils op: 0.002125978469848633 seconds 8: Time to load utils op: 0.0011889934539794922 seconds 10: Time to load utils op: 0.001428842544555664 seconds 2: Time to load utils op: 0.0014739036560058594 secondsTime to load utils op: 0.0014071464538574219 secondsTime to load utils op: 0.001485586166381836 seconds 2: 2: 2: Time to load utils op: 0.001394510269165039 seconds 2: Time to load utils op: 0.0014109611511230469 seconds 2: Time to load utils op: 0.0014476776123046875 seconds 13: Time to load utils op: 0.0005402565002441406 seconds 13: Time to load utils op: 0.0006325244903564453 secondsTime to load utils op: 0.0006189346313476562 seconds 13: 13: Time to load utils op: 0.0006434917449951172 seconds 13: Time to load utils op: 0.0006437301635742188 seconds 13: Time to load utils op: 0.0006577968597412109 seconds 13: Time to load utils op: 0.0007083415985107422 secondsTime to load utils op: 0.0006709098815917969 seconds 13: 24: Time to load utils op: 0.0010464191436767578 seconds 24: Time to load utils op: 0.0012087821960449219 seconds 12: Time to load utils op: 0.0011310577392578125 seconds 12: Time to load utils op: 0.0014007091522216797 seconds 12: Time to load utils op: 0.0019927024841308594 seconds 24: Time to load utils op: 0.002348661422729492 seconds 14: Time to load utils op: 0.0028367042541503906 seconds 14: Time to load utils op: 0.0033140182495117188 seconds 24: Time to load utils op: 0.0034265518188476562 secondsTime to load utils op: 0.003398418426513672 seconds 24: 24: Time to load utils op: 0.003345966339111328 seconds 24: Time to load utils op: 0.003370523452758789 seconds 24: Time to load utils op: 0.0034389495849609375 seconds 12: Time to load utils op: 0.0035400390625 secondsTime to load utils op: 0.0036597251892089844 seconds 12: Time to load utils op: 0.0034537315368652344 seconds 12: 12: Time to load utils op: 0.0036094188690185547 seconds 12: Time to load utils op: 0.0036051273345947266 seconds 14: Time to load utils op: 0.004449605941772461 seconds 14: Time to load utils op: 0.004387378692626953 seconds 14: Time to load utils op: 0.0043506622314453125 seconds 14: Time to load utils op: 0.004410266876220703 seconds 14: Time to load utils op: 0.004407644271850586 seconds 14: Time to load utils op: 0.0044403076171875 seconds 29: Time to load utils op: 0.0005316734313964844 secondsTime to load utils op: 0.0005505084991455078 seconds 29: 29: Time to load utils op: 0.0005311965942382812 seconds 29: Time to load utils op: 0.0004444122314453125 seconds 29: Time to load utils op: 0.0005042552947998047 seconds 29: Time to load utils op: 0.0004830360412597656 secondsTime to load utils op: 0.000484466552734375 seconds 29: 29: Time to load utils op: 0.0004405975341796875 seconds 20: Time to load utils op: 0.0012731552124023438 seconds 20: Time to load utils op: 0.001177072525024414 seconds 20: Time to load utils op: 0.0015931129455566406 seconds 20: Time to load utils op: 0.0015227794647216797 secondsTime to load utils op: 0.00159454345703125 seconds 20: 20: Time to load utils op: 0.0015304088592529297 seconds 20: Time to load utils op: 0.0015676021575927734 seconds 20: Time to load utils op: 0.0016393661499023438 seconds 25: Time to load utils op: 0.0009887218475341797 seconds 25: Time to load utils op: 0.0012805461883544922 seconds 25: Time to load utils op: 0.0014400482177734375 seconds 25: Time to load utils op: 0.001491546630859375 seconds 25: Time to load utils op: 0.0014209747314453125 secondsTime to load utils op: 0.0014243125915527344 secondsTime to load utils op: 0.0014157295227050781 seconds 25: 25: 25: Time to load utils op: 0.0014543533325195312 seconds 31: Time to load utils op: 0.0010383129119873047 secondsTime to load utils op: 0.0010061264038085938 seconds 31: 31: Time to load utils op: 0.0015954971313476562 seconds 31: Time to load utils op: 0.0015506744384765625 seconds 31: Time to load utils op: 0.0015254020690917969 seconds 23: Time to load utils op: 0.0011320114135742188 seconds 31: Time to load utils op: 0.0022287368774414062 seconds 31: Time to load utils op: 0.002209186553955078 seconds 31: Time to load utils op: 0.002305269241333008 seconds 16: Time to load utils op: 0.001074075698852539 seconds 16: Time to load utils op: 0.0010399818420410156 seconds 23: Time to load utils op: 0.0015985965728759766 seconds 16: Time to load utils op: 0.0012793540954589844 seconds 23: Time to load utils op: 0.0020301342010498047 seconds 23: Time to load utils op: 0.002019643783569336 seconds 23: Time to load utils op: 0.0019237995147705078 seconds 23: Time to load utils op: 0.002012968063354492 secondsTime to load utils op: 0.00202178955078125 seconds 23: 23: Time to load utils op: 0.002057790756225586 seconds 16: Time to load utils op: 0.0017426013946533203 seconds 16: Time to load utils op: 0.0022318363189697266 seconds 16: Time to load utils op: 0.0022008419036865234 seconds 16: Time to load utils op: 0.002124786376953125 seconds 26: Time to load utils op: 0.0005984306335449219 seconds 16: Time to load utils op: 0.002171754837036133 seconds 26: Time to load utils op: 0.0008172988891601562 seconds 27: Time to load utils op: 0.001055002212524414 seconds 28: Time to load utils op: 0.0008854866027832031 seconds 26: Time to load utils op: 0.0009105205535888672 seconds 26: Time to load utils op: 0.0008909702301025391 seconds 27: Time to load utils op: 0.0010929107666015625 seconds 27: Time to load utils op: 0.0011589527130126953 seconds 27: Time to load utils op: 0.0014238357543945312 secondsTime to load utils op: 0.0012819766998291016 seconds 27: 28: Time to load utils op: 0.0011565685272216797 seconds 27: Time to load utils op: 0.0013289451599121094 seconds 27: Time to load utils op: 0.0013055801391601562 seconds 27: Time to load utils op: 0.0012674331665039062 seconds 26: Time to load utils op: 0.0013561248779296875 seconds 26: Time to load utils op: 0.0013270378112792969 seconds 26: Time to load utils op: 0.0012428760528564453 seconds 26: Time to load utils op: 0.0012848377227783203 seconds 19: Time to load utils op: 0.0008778572082519531 seconds 19: Time to load utils op: 0.0011794567108154297 seconds 28: Time to load utils op: 0.001741170883178711 secondsTime to load utils op: 0.0017328262329101562 seconds 28: 28: Time to load utils op: 0.0017468929290771484 seconds 28: Time to load utils op: 0.0017216205596923828 seconds 28: Time to load utils op: 0.0018184185028076172 seconds 28: Time to load utils op: 0.0018298625946044922 seconds 19: Time to load utils op: 0.0013403892517089844 seconds 19: Time to load utils op: 0.001421213150024414 secondsTime to load utils op: 0.0014715194702148438 seconds 19: Time to load utils op: 0.001401662826538086 seconds 19: 30: Time to load utils op: 0.0010976791381835938 seconds 19: Time to load utils op: 0.0014722347259521484 seconds 19: Time to load utils op: 0.0014729499816894531 seconds 17: Time to load utils op: 0.0011131763458251953 seconds 18: Time to load utils op: 0.0011248588562011719 seconds 30: Time to load utils op: 0.0010941028594970703 seconds 17: Time to load utils op: 0.001316070556640625 seconds 17: Time to load utils op: 0.001743316650390625 seconds 17: Time to load utils op: 0.0016734600067138672 seconds 17: Time to load utils op: 0.0016086101531982422 seconds 17: Time to load utils op: 0.0016179084777832031 seconds 17: Time to load utils op: 0.0016200542449951172 seconds 17: Time to load utils op: 0.001706838607788086 seconds 15: Time to load utils op: 0.0012202262878417969 seconds 30: Time to load utils op: 0.0019936561584472656 seconds 30: Time to load utils op: 0.0019974708557128906 seconds 18: Time to load utils op: 0.002149343490600586 seconds 30: Time to load utils op: 0.0019960403442382812 seconds 30: Time to load utils op: 0.001980304718017578 seconds 30: Time to load utils op: 0.001985788345336914 seconds 18: Time to load utils op: 0.0021681785583496094 seconds 18: Time to load utils op: 0.002122163772583008 secondsTime to load utils op: 0.0021109580993652344 seconds 18: 30: Time to load utils op: 0.002018451690673828 seconds 18: Time to load utils op: 0.0021545886993408203 secondsTime to load utils op: 0.0021550655364990234 seconds 18: 18: Time to load utils op: 0.0021500587463378906 seconds 15: Time to load utils op: 0.001850128173828125 seconds 22: Time to load utils op: 0.0022153854370117188 seconds 15: Time to load utils op: 0.002309083938598633 seconds 22: Time to load utils op: 0.0026578903198242188 seconds 15: Time to load utils op: 0.00243377685546875 secondsTime to load utils op: 0.002424478530883789 seconds 15: 15: Time to load utils op: 0.002444028854370117 secondsTime to load utils op: 0.002412557601928711 seconds 15: 15: Time to load utils op: 0.002443075180053711 seconds 22: Time to load utils op: 0.0027556419372558594 seconds 22: Time to load utils op: 0.0027484893798828125 seconds 22: Time to load utils op: 0.002805948257446289 seconds 22: Time to load utils op: 0.0027685165405273438 seconds 22: Time to load utils op: 0.002789735794067383 seconds 22: Time to load utils op: 0.002820730209350586 seconds 21: Time to load utils op: 0.0008246898651123047 seconds 21: Time to load utils op: 0.0012362003326416016 secondsTime to load utils op: 0.0010662078857421875 seconds 21: 21: Time to load utils op: 0.0012764930725097656 secondsTime to load utils op: 0.001375436782836914 secondsTime to load utils op: 0.0012488365173339844 seconds 21: 21: 21: Time to load utils op: 0.001394510269165039 seconds 21: Time to load utils op: 0.001413583755493164 seconds 0: [2023-04-29 17:23:15,709] [INFO] [utils.py:827:see_memory_usage] before initializing group 0 0: [2023-04-29 17:23:15,710] [INFO] [utils.py:828:see_memory_usage] MA 5.25 GB Max_MA 5.25 GB CA 5.32 GB Max_CA 5 GB 0: [2023-04-29 17:23:15,710] [INFO] [utils.py:836:see_memory_usage] CPU Virtual Memory: used = 42.6 GB, percent = 8.5% 0: [2023-04-29 17:23:15,827] [INFO] [utils.py:827:see_memory_usage] after initializing group 0 0: [2023-04-29 17:23:15,828] [INFO] [utils.py:828:see_memory_usage] MA 10.64 GB Max_MA 10.64 GB CA 13.39 GB Max_CA 13 GB 0: [2023-04-29 17:23:15,828] [INFO] [utils.py:836:see_memory_usage] CPU Virtual Memory: used = 42.6 GB, percent = 8.5% 0: [2023-04-29 17:23:15,930] [INFO] [utils.py:827:see_memory_usage] before initializing group 1 0: [2023-04-29 17:23:15,931] [INFO] [utils.py:828:see_memory_usage] MA 10.64 GB Max_MA 10.64 GB CA 13.39 GB Max_CA 13 GB 0: [2023-04-29 17:23:15,931] [INFO] [utils.py:836:see_memory_usage] CPU Virtual Memory: used = 42.6 GB, percent = 8.5% 0: [2023-04-29 17:23:16,036] [INFO] [utils.py:827:see_memory_usage] after initializing group 1 0: [2023-04-29 17:23:16,037] [INFO] [utils.py:828:see_memory_usage] MA 15.73 GB Max_MA 15.73 GB CA 21.01 GB Max_CA 21 GB 0: [2023-04-29 17:23:16,037] [INFO] [utils.py:836:see_memory_usage] CPU Virtual Memory: used = 42.61 GB, percent = 8.5% 0: [2023-04-29 17:23:16,139] [INFO] [utils.py:827:see_memory_usage] before initializing group 2 0: [2023-04-29 17:23:16,140] [INFO] [utils.py:828:see_memory_usage] MA 15.73 GB Max_MA 15.73 GB CA 21.01 GB Max_CA 21 GB 0: [2023-04-29 17:23:16,140] [INFO] [utils.py:836:see_memory_usage] CPU Virtual Memory: used = 42.61 GB, percent = 8.5% 0: [2023-04-29 17:23:16,248] [INFO] [utils.py:827:see_memory_usage] after initializing group 2 0: [2023-04-29 17:23:16,248] [INFO] [utils.py:828:see_memory_usage] MA 15.74 GB Max_MA 15.74 GB CA 21.01 GB Max_CA 21 GB 0: [2023-04-29 17:23:16,248] [INFO] [utils.py:836:see_memory_usage] CPU Virtual Memory: used = 42.61 GB, percent = 8.5% 0: [2023-04-29 17:23:16,350] [INFO] [utils.py:827:see_memory_usage] before initialize_optimizer 0: [2023-04-29 17:23:16,350] [INFO] [utils.py:828:see_memory_usage] MA 15.74 GB Max_MA 15.74 GB CA 21.01 GB Max_CA 21 GB 0: [2023-04-29 17:23:16,350] [INFO] [utils.py:836:see_memory_usage] CPU Virtual Memory: used = 42.61 GB, percent = 8.5% 0: [2023-04-29 17:23:16,458] [INFO] [utils.py:827:see_memory_usage] end initialize_optimizer 0: [2023-04-29 17:23:16,459] [INFO] [utils.py:828:see_memory_usage] MA 15.82 GB Max_MA 15.82 GB CA 21.01 GB Max_CA 21 GB 0: [2023-04-29 17:23:16,459] [INFO] [utils.py:836:see_memory_usage] CPU Virtual Memory: used = 42.61 GB, percent = 8.5% 0: [2023-04-29 17:23:16,562] [INFO] [utils.py:827:see_memory_usage] end bf16_optimizer 0: [2023-04-29 17:23:16,562] [INFO] [utils.py:828:see_memory_usage] MA 15.82 GB Max_MA 15.82 GB CA 21.01 GB Max_CA 21 GB 0: [2023-04-29 17:23:16,562] [INFO] [utils.py:836:see_memory_usage] CPU Virtual Memory: used = 42.61 GB, percent = 8.5% 0: [2023-04-29 17:23:16,562] [INFO] [logging.py:68:log_dist] [Rank 0] DeepSpeed Final Optimizer = FusedAdam 0: [2023-04-29 17:23:16,563] [INFO] [logging.py:68:log_dist] [Rank 0] DeepSpeed using client LR scheduler 0: [2023-04-29 17:23:16,563] [INFO] [logging.py:68:log_dist] [Rank 0] DeepSpeed LR Scheduler = 0: [2023-04-29 17:23:16,563] [INFO] [logging.py:68:log_dist] [Rank 0] step=0, skipped=0, lr=[0.0002, 0.0002, 0.0002], mom=[(0.9, 0.999), (0.9, 0.999), (0.9, 0.999)] 0: [2023-04-29 17:23:16,563] [INFO] [config.py:1007:print] DeepSpeedEngine configuration: 0: [2023-04-29 17:23:16,564] [INFO] [config.py:1011:print] activation_checkpointing_config { 0: "partition_activations": false, 0: "contiguous_memory_optimization": false, 0: "cpu_checkpointing": false, 0: "number_checkpoints": null, 0: "synchronize_checkpoint_boundary": false, 0: "profile": false 0: } 0: [2023-04-29 17:23:16,564] [INFO] [config.py:1011:print] aio_config ................... {'block_size': 1048576, 'queue_depth': 8, 'thread_count': 1, 'single_submit': False, 'overlap_events': True} 0: [2023-04-29 17:23:16,564] [INFO] [config.py:1011:print] amp_enabled .................. False 0: [2023-04-29 17:23:16,564] [INFO] [config.py:1011:print] amp_params ................... False 0: [2023-04-29 17:23:16,564] [INFO] [config.py:1011:print] autotuning_config ............ { 0: "enabled": false, 0: "start_step": null, 0: "end_step": null, 0: "metric_path": null, 0: "arg_mappings": null, 0: "metric": "throughput", 0: "model_info": null, 0: "results_dir": "/pfs/lustrep4/scratch/project_462000119/muennighoff/nov-2022-bettercom/autotuning_results", 0: "exps_dir": "/pfs/lustrep4/scratch/project_462000119/muennighoff/nov-2022-bettercom/autotuning_exps", 0: "overwrite": true, 0: "fast": true, 0: "start_profile_step": 3, 0: "end_profile_step": 5, 0: "tuner_type": "gridsearch", 0: "tuner_early_stopping": 5, 0: "tuner_num_trials": 50, 0: "model_info_path": null, 0: "mp_size": 1, 0: "max_train_batch_size": null, 0: "min_train_batch_size": 1, 0: "max_train_micro_batch_size_per_gpu": 1.024000e+03, 0: "min_train_micro_batch_size_per_gpu": 1, 0: "num_tuning_micro_batch_sizes": 3 0: } 0: [2023-04-29 17:23:16,564] [INFO] [config.py:1011:print] bfloat16_enabled ............. True 0: [2023-04-29 17:23:16,564] [INFO] [config.py:1011:print] checkpoint_parallel_write_pipeline False 0: [2023-04-29 17:23:16,564] [INFO] [config.py:1011:print] checkpoint_tag_validation_enabled True 0: [2023-04-29 17:23:16,564] [INFO] [config.py:1011:print] checkpoint_tag_validation_fail False 0: [2023-04-29 17:23:16,564] [INFO] [config.py:1011:print] comms_config ................. 0: [2023-04-29 17:23:16,564] [INFO] [config.py:1011:print] communication_data_type ...... None 0: [2023-04-29 17:23:16,565] [INFO] [config.py:1011:print] compression_config ........... {'weight_quantization': {'shared_parameters': {'enabled': False, 'quantizer_kernel': False, 'schedule_offset': 0, 'quantize_groups': 1, 'quantize_verbose': False, 'quantization_type': 'symmetric', 'quantize_weight_in_forward': False, 'rounding': 'nearest', 'fp16_mixed_quantize': False, 'quantize_change_ratio': 0.001}, 'different_groups': {}}, 'activation_quantization': {'shared_parameters': {'enabled': False, 'quantization_type': 'symmetric', 'range_calibration': 'dynamic', 'schedule_offset': 1000}, 'different_groups': {}}, 'sparse_pruning': {'shared_parameters': {'enabled': False, 'method': 'l1', 'schedule_offset': 1000}, 'different_groups': {}}, 'row_pruning': {'shared_parameters': {'enabled': False, 'method': 'l1', 'schedule_offset': 1000}, 'different_groups': {}}, 'head_pruning': {'shared_parameters': {'enabled': False, 'method': 'topk', 'schedule_offset': 1000}, 'different_groups': {}}, 'channel_pruning': {'shared_pa 0: rameters': {'enabled': False, 'method': 'l1', 'schedule_offset': 1000}, 'different_groups': {}}, 'layer_reduction': {'enabled': False}} 0: [2023-04-29 17:23:16,565] [INFO] [config.py:1011:print] curriculum_enabled ........... False 0: [2023-04-29 17:23:16,565] [INFO] [config.py:1011:print] curriculum_params ............ False 0: [2023-04-29 17:23:16,565] [INFO] [config.py:1011:print] dataloader_drop_last ......... False 0: [2023-04-29 17:23:16,565] [INFO] [config.py:1011:print] disable_allgather ............ False 0: [2023-04-29 17:23:16,565] [INFO] [config.py:1011:print] dump_state ................... False 0: [2023-04-29 17:23:16,565] [INFO] [config.py:1011:print] dynamic_loss_scale_args ...... None 0: [2023-04-29 17:23:16,565] [INFO] [config.py:1011:print] eigenvalue_enabled ........... False 0: [2023-04-29 17:23:16,565] [INFO] [config.py:1011:print] eigenvalue_gas_boundary_resolution 1 0: [2023-04-29 17:23:16,565] [INFO] [config.py:1011:print] eigenvalue_layer_name ........ bert.encoder.layer 0: [2023-04-29 17:23:16,565] [INFO] [config.py:1011:print] eigenvalue_layer_num ......... 0 0: [2023-04-29 17:23:16,565] [INFO] [config.py:1011:print] eigenvalue_max_iter .......... 100 0: [2023-04-29 17:23:16,565] [INFO] [config.py:1011:print] eigenvalue_stability ......... 1e-06 0: [2023-04-29 17:23:16,565] [INFO] [config.py:1011:print] eigenvalue_tol ............... 0.01 0: [2023-04-29 17:23:16,565] [INFO] [config.py:1011:print] eigenvalue_verbose ........... False 0: [2023-04-29 17:23:16,565] [INFO] [config.py:1011:print] elasticity_enabled ........... False 0: [2023-04-29 17:23:16,565] [INFO] [config.py:1011:print] flops_profiler_config ........ { 0: "enabled": false, 0: "profile_step": 1, 0: "module_depth": -1, 0: "top_modules": 1, 0: "detailed": true, 0: "output_file": null 0: } 0: [2023-04-29 17:23:16,565] [INFO] [config.py:1011:print] fp16_auto_cast ............... None 0: [2023-04-29 17:23:16,565] [INFO] [config.py:1011:print] fp16_enabled ................. False 0: [2023-04-29 17:23:16,565] [INFO] [config.py:1011:print] fp16_master_weights_and_gradients False 0: [2023-04-29 17:23:16,565] [INFO] [config.py:1011:print] global_rank .................. 0 0: [2023-04-29 17:23:16,565] [INFO] [config.py:1011:print] gradient_accumulation_steps .. 1 0: [2023-04-29 17:23:16,565] [INFO] [config.py:1011:print] gradient_clipping ............ 1.0 0: [2023-04-29 17:23:16,565] [INFO] [config.py:1011:print] gradient_predivide_factor .... 1.0 0: [2023-04-29 17:23:16,565] [INFO] [config.py:1011:print] initial_dynamic_scale ........ 1 0: [2023-04-29 17:23:16,565] [INFO] [config.py:1011:print] load_universal_checkpoint .... False 0: [2023-04-29 17:23:16,566] [INFO] [config.py:1011:print] loss_scale ................... 1.0 0: [2023-04-29 17:23:16,566] [INFO] [config.py:1011:print] memory_breakdown ............. False 0: [2023-04-29 17:23:16,566] [INFO] [config.py:1011:print] monitor_config ............... 0: [2023-04-29 17:23:16,566] [INFO] [config.py:1011:print] nebula_config ................ { 0: "enabled": false, 0: "persistent_storage_path": null, 0: "persistent_time_interval": 100, 0: "num_of_version_in_retention": 2, 0: "enable_nebula_load": true, 0: "load_path": null 0: } 0: [2023-04-29 17:23:16,566] [INFO] [config.py:1011:print] optimizer_legacy_fusion ...... False 0: [2023-04-29 17:23:16,566] [INFO] [config.py:1011:print] optimizer_name ............... None 0: [2023-04-29 17:23:16,566] [INFO] [config.py:1011:print] optimizer_params ............. None 0: [2023-04-29 17:23:16,566] [INFO] [config.py:1011:print] pipeline ..................... {'stages': 'auto', 'partition': 'best', 'seed_layers': False, 'activation_checkpoint_interval': 0} 0: [2023-04-29 17:23:16,566] [INFO] [config.py:1011:print] pld_enabled .................. False 0: [2023-04-29 17:23:16,566] [INFO] [config.py:1011:print] pld_params ................... False 0: [2023-04-29 17:23:16,566] [INFO] [config.py:1011:print] prescale_gradients ........... False 0: [2023-04-29 17:23:16,566] [INFO] [config.py:1011:print] scheduler_name ............... None 0: [2023-04-29 17:23:16,566] [INFO] [config.py:1011:print] scheduler_params ............. None 0: [2023-04-29 17:23:16,566] [INFO] [config.py:1011:print] sparse_attention ............. None 0: [2023-04-29 17:23:16,566] [INFO] [config.py:1011:print] sparse_gradients_enabled ..... False 0: [2023-04-29 17:23:16,566] [INFO] [config.py:1011:print] steps_per_print .............. 2000 0: [2023-04-29 17:23:16,566] [INFO] [config.py:1011:print] train_batch_size ............. 512 0: [2023-04-29 17:23:16,566] [INFO] [config.py:1011:print] train_micro_batch_size_per_gpu 2 0: [2023-04-29 17:23:16,566] [INFO] [config.py:1011:print] use_node_local_storage ....... False 0: [2023-04-29 17:23:16,566] [INFO] [config.py:1011:print] wall_clock_breakdown ......... False 0: [2023-04-29 17:23:16,566] [INFO] [config.py:1011:print] world_size ................... 256 0: [2023-04-29 17:23:16,566] [INFO] [config.py:1011:print] zero_allow_untested_optimizer False 0: [2023-04-29 17:23:16,566] [INFO] [config.py:1011:print] zero_config .................. stage=0 contiguous_gradients=True reduce_scatter=True reduce_bucket_size=500000000 allgather_partitions=True allgather_bucket_size=500000000 overlap_comm=False load_from_fp32_weights=True elastic_checkpoint=False offload_param=None offload_optimizer=None sub_group_size=1000000000 cpu_offload_param=None cpu_offload_use_pin_memory=None cpu_offload=None prefetch_bucket_size=50000000 param_persistence_threshold=100000 model_persistence_threshold=9223372036854775807 max_live_parameters=1000000000 max_reuse_distance=1000000000 gather_16bit_weights_on_model_save=False stage3_gather_fp16_weights_on_model_save=False ignore_unused_parameters=True legacy_stage1=False round_robin_gradients=False 0: [2023-04-29 17:23:16,566] [INFO] [config.py:1011:print] zero_enabled ................. False 0: [2023-04-29 17:23:16,567] [INFO] [config.py:1011:print] zero_optimization_stage ...... 0 0: [2023-04-29 17:23:16,567] [INFO] [config.py:996:print_user_config] json = { 0: "train_micro_batch_size_per_gpu": 2, 0: "train_batch_size": 512, 0: "gradient_clipping": 1.0, 0: "zero_optimization": { 0: "stage": 0 0: }, 0: "bf16": { 0: "enabled": true 0: }, 0: "steps_per_print": 2.000000e+03, 0: "wall_clock_breakdown": false 0: } 0: Time to load utils op: 0.00047326087951660156 seconds 0: [2023-04-29 17:23:16,567] [INFO] [engine.py:87:__init__] CONFIG: micro_batches=1 micro_batch_size=2 0: [2023-04-29 17:23:16,580] [INFO] [engine.py:145:__init__] RANK=0 STAGE=0 LAYERS=41 [0, 41) STAGE_PARAMS=2809026560 (2809.027M) TOTAL_PARAMS=2809026560 (2809.027M) UNIQUE_PARAMS=2809026560 (2809.027M) 15: [2023-04-29 17:23:16,590] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 15: [2023-04-29 17:23:16,590] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 15: [2023-04-29 17:23:16,590] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 15: [2023-04-29 17:23:16,590] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 15: [2023-04-29 17:23:16,590] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 15: [2023-04-29 17:23:16,590] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 15: [2023-04-29 17:23:16,590] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 30: [2023-04-29 17:23:16,590] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 30: [2023-04-29 17:23:16,590] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 30: [2023-04-29 17:23:16,590] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 30: [2023-04-29 17:23:16,590] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 30: [2023-04-29 17:23:16,590] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 30: [2023-04-29 17:23:16,590] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 30: [2023-04-29 17:23:16,590] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 0: [2023-04-29 17:23:16,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 0: [2023-04-29 17:23:16,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 16: [2023-04-29 17:23:16,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 10: [2023-04-29 17:23:16,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 10: [2023-04-29 17:23:16,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 20: [2023-04-29 17:23:16,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 20: [2023-04-29 17:23:16,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 20: [2023-04-29 17:23:16,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 20: [2023-04-29 17:23:16,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 20: [2023-04-29 17:23:16,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 20: [2023-04-29 17:23:16,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 20: [2023-04-29 17:23:16,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 16: [2023-04-29 17:23:16,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 10: [2023-04-29 17:23:16,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 10: [2023-04-29 17:23:16,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 10: [2023-04-29 17:23:16,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 31: [2023-04-29 17:23:16,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 30: [2023-04-29 17:23:16,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 10: [2023-04-29 17:23:16,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 31: [2023-04-29 17:23:16,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 16: [2023-04-29 17:23:16,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 16: [2023-04-29 17:23:16,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 16: [2023-04-29 17:23:16,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 16: [2023-04-29 17:23:16,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 16: [2023-04-29 17:23:16,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 0: [2023-04-29 17:23:16,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 0: [2023-04-29 17:23:16,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 15: [2023-04-29 17:23:16,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 31: [2023-04-29 17:23:16,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 10: [2023-04-29 17:23:16,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 0: [2023-04-29 17:23:16,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 31: [2023-04-29 17:23:16,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 31: [2023-04-29 17:23:16,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 0: [2023-04-29 17:23:16,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 31: [2023-04-29 17:23:16,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 31: [2023-04-29 17:23:16,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 0: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 16: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 0: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 13: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 13: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 13: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 13: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 20: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 23: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 23: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 23: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 23: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 31: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 24: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 24: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 29: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 6: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 13: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 8: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 12: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 12: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 6: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 6: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 12: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 12: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 12: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 12: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 13: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 13: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 24: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 24: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 6: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 12: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 23: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 29: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 29: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 29: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 29: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 29: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 23: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 23: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 24: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 24: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 29: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 8: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 8: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 8: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 6: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 6: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 6: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 24: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 8: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 8: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 10: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 8: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 13: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 11: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 11: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 11: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 11: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 11: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 11: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 11: [2023-04-29 17:23:16,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 25: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 29: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 6: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 23: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 24: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 12: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 25: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 25: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 25: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 25: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 25: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 27: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 25: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 28: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 27: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 27: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 27: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 27: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 27: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 27: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 28: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 25: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 8: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 28: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 28: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 28: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 7: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 14: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 28: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 28: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 21: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 21: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 21: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 21: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 21: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 21: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 21: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 7: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 7: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 7: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 7: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 14: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 14: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 14: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 14: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 14: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 11: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 7: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 7: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 14: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 18: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 18: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 18: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 18: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 18: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 2: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 18: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 18: [2023-04-29 17:23:16,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 27: [2023-04-29 17:23:16,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 2: [2023-04-29 17:23:16,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 2: [2023-04-29 17:23:16,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 2: [2023-04-29 17:23:16,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 2: [2023-04-29 17:23:16,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 2: [2023-04-29 17:23:16,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 22: [2023-04-29 17:23:16,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 22: [2023-04-29 17:23:16,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 22: [2023-04-29 17:23:16,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 22: [2023-04-29 17:23:16,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 22: [2023-04-29 17:23:16,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 2: [2023-04-29 17:23:16,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 22: [2023-04-29 17:23:16,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 22: [2023-04-29 17:23:16,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 3: [2023-04-29 17:23:16,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 21: [2023-04-29 17:23:16,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 7: [2023-04-29 17:23:16,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 14: [2023-04-29 17:23:16,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 18: [2023-04-29 17:23:16,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 19: [2023-04-29 17:23:16,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 19: [2023-04-29 17:23:16,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 19: [2023-04-29 17:23:16,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 28: [2023-04-29 17:23:16,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 19: [2023-04-29 17:23:16,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 3: [2023-04-29 17:23:16,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 3: [2023-04-29 17:23:16,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 3: [2023-04-29 17:23:16,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 3: [2023-04-29 17:23:16,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 3: [2023-04-29 17:23:16,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 4: [2023-04-29 17:23:16,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 4: [2023-04-29 17:23:16,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 4: [2023-04-29 17:23:16,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 4: [2023-04-29 17:23:16,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 4: [2023-04-29 17:23:16,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 4: [2023-04-29 17:23:16,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 4: [2023-04-29 17:23:16,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 19: [2023-04-29 17:23:16,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 19: [2023-04-29 17:23:16,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 19: [2023-04-29 17:23:16,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 3: [2023-04-29 17:23:16,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 22: [2023-04-29 17:23:16,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 9: [2023-04-29 17:23:16,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 2: [2023-04-29 17:23:16,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 1: [2023-04-29 17:23:16,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 1: [2023-04-29 17:23:16,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 4: [2023-04-29 17:23:16,595] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 9: [2023-04-29 17:23:16,595] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 9: [2023-04-29 17:23:16,595] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 9: [2023-04-29 17:23:16,595] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 9: [2023-04-29 17:23:16,595] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 19: [2023-04-29 17:23:16,595] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 1: [2023-04-29 17:23:16,595] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 9: [2023-04-29 17:23:16,595] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 9: [2023-04-29 17:23:16,595] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 1: [2023-04-29 17:23:16,595] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 17: [2023-04-29 17:23:16,595] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 3: [2023-04-29 17:23:16,595] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 26: [2023-04-29 17:23:16,595] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 26: [2023-04-29 17:23:16,595] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 1: [2023-04-29 17:23:16,595] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 1: [2023-04-29 17:23:16,595] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 1: [2023-04-29 17:23:16,595] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 26: [2023-04-29 17:23:16,595] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 9: [2023-04-29 17:23:16,595] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 26: [2023-04-29 17:23:16,595] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 26: [2023-04-29 17:23:16,595] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 26: [2023-04-29 17:23:16,595] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 26: [2023-04-29 17:23:16,595] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 26: [2023-04-29 17:23:16,595] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 1: [2023-04-29 17:23:16,595] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 17: [2023-04-29 17:23:16,595] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 17: [2023-04-29 17:23:16,595] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 17: [2023-04-29 17:23:16,595] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 17: [2023-04-29 17:23:16,595] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 17: [2023-04-29 17:23:16,595] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 5: [2023-04-29 17:23:16,595] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 5: [2023-04-29 17:23:16,595] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 5: [2023-04-29 17:23:16,595] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 5: [2023-04-29 17:23:16,595] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 5: [2023-04-29 17:23:16,595] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 17: [2023-04-29 17:23:16,595] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 5: [2023-04-29 17:23:16,595] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 5: [2023-04-29 17:23:16,595] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 17: [2023-04-29 17:23:16,595] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 5: [2023-04-29 17:23:16,595] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 13: [2023-04-29 17:23:16,616] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 13: [2023-04-29 17:23:16,616] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 13: [2023-04-29 17:23:16,616] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 13: [2023-04-29 17:23:16,616] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 15: [2023-04-29 17:23:16,616] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 15: [2023-04-29 17:23:16,616] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 13: [2023-04-29 17:23:16,616] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 13: [2023-04-29 17:23:16,616] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 13: [2023-04-29 17:23:16,616] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 13: [2023-04-29 17:23:16,616] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 13: [2023-04-29 17:23:16,616] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 13: [2023-04-29 17:23:16,616] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 15: [2023-04-29 17:23:16,616] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 15: [2023-04-29 17:23:16,616] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 15: [2023-04-29 17:23:16,616] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 15: [2023-04-29 17:23:16,616] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 15: [2023-04-29 17:23:16,616] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 13: [2023-04-29 17:23:16,616] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 15: [2023-04-29 17:23:16,616] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 15: [2023-04-29 17:23:16,616] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 15: [2023-04-29 17:23:16,616] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 15: [2023-04-29 17:23:16,616] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 13: [2023-04-29 17:23:16,616] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 13: [2023-04-29 17:23:16,616] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 13: [2023-04-29 17:23:16,616] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 15: [2023-04-29 17:23:16,616] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 15: [2023-04-29 17:23:16,616] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 15: [2023-04-29 17:23:16,616] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 15: [2023-04-29 17:23:16,616] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 15: [2023-04-29 17:23:16,616] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 13: [2023-04-29 17:23:16,616] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 13: [2023-04-29 17:23:16,616] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 13: [2023-04-29 17:23:16,617] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 15: [2023-04-29 17:23:16,617] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 15: [2023-04-29 17:23:16,617] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 13: [2023-04-29 17:23:16,617] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 15: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 13: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 15: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 13: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 30: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 13: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 30: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 30: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 30: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 30: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 30: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 30: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 30: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 13: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 15: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 13: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 30: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 30: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 30: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 30: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 30: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 15: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 15: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 30: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 30: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 13: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 30: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 12: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 12: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 12: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 15: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 15: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 13: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 13: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 20: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 20: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 20: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 20: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 20: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 15: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 12: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 12: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 12: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 12: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 12: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 12: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 15: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 13: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 20: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 20: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 12: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 20: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 20: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 16: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 16: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 16: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 16: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 20: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 12: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 12: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 12: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 12: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 16: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 16: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 16: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 20: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 20: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 20: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 20: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 10: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 10: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 10: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 10: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 10: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 12: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 15: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 16: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 13: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 20: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 10: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 10: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 16: [2023-04-29 17:23:16,618] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 12: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 15: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 13: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 13: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 10: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 10: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 20: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 10: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 16: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 16: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 16: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 15: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 10: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 16: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 16: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 10: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 10: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 10: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 10: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 16: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 16: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 10: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 13: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 13: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 24: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 24: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 24: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 15: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 24: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 31: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 31: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 31: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 31: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 31: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 24: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 24: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 24: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 23: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 23: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 23: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 23: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 23: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 24: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 31: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 31: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 24: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 24: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 24: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 23: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 23: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 24: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 24: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 24: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 15: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 31: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 31: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 8: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 8: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 8: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 8: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 8: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 23: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 23: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 23: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 23: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 31: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 23: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 23: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 23: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 31: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 31: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 24: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 31: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 8: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 23: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 31: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 8: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 8: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 8: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 8: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 8: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 8: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 23: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 31: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 24: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 8: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 8: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 31: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 30: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 8: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 30: [2023-04-29 17:23:16,619] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 8: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 30: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 0: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 0: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 0: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 0: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 0: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 0: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 0: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 0: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 0: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 20: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 20: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 0: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 0: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 30: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 0: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 0: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 0: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 0: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 16: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 10: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 30: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 0: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 30: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 10: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 20: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 30: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 30: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 30: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 16: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 30: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 24: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 10: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 16: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 30: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 14: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 14: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 14: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 20: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 30: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 14: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 14: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 14: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 14: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 23: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 10: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 16: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 12: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 14: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 14: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 14: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 20: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 20: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 31: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 10: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 14: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 14: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 14: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 8: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 14: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 10: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 24: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 14: [2023-04-29 17:23:16,620] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 30: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 16: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 20: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 14: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 10: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 20: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 31: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 12: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 20: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 23: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 30: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 10: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 16: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 16: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 24: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 30: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 23: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 23: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 30: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 16: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 20: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 23: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 10: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 6: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 6: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 6: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 16: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 8: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 24: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 16: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 6: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 6: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 6: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 6: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 6: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 6: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 20: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 10: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 8: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 23: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 31: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 31: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 6: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 20: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 10: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 0: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 16: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 0: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 6: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 6: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 6: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 0: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 6: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 10: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 16: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 20: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 23: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 24: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 24: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 8: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 6: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 23: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 31: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 24: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 23: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 10: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 6: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 20: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 24: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 24: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 24: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 0: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 31: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 0: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 7: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 7: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 7: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 12: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 0: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 0: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 10: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 16: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 8: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 8: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 11: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 11: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 11: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 11: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 11: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 7: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 23: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 7: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 16: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 24: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 7: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 23: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 23: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 31: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 31: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 11: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 11: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 7: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 8: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 23: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 11: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 11: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 11: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 7: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 7: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 7: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 7: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 7: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 20: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 31: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 10: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 16: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 26: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 26: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 26: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 26: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 26: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 24: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 8: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 11: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 11: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 11: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 7: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 7: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 12: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 11: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 20: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 26: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 26: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 0: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 8: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 8: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 8: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 23: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 31: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 31: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 31: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 26: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 26: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 11: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 7: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 10: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 26: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 11: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 12: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 7: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 12: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 26: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 26: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 26: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 26: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 26: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 23: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 16: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 12: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 12: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 8: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 24: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 12: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 19: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 19: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 19: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 19: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 19: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 26: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 19: [2023-04-29 17:23:16,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 24: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 19: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 31: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 12: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 23: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 19: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 19: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 19: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 19: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 19: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 19: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 19: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 31: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 24: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 24: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 0: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 14: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 0: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 8: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 14: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 31: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 0: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 0: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 0: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 8: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 2: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 2: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 2: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 2: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 2: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 31: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 0: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 0: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 18: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 18: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 18: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 18: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 18: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 2: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 2: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 19: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 8: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 8: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 2: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 2: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 2: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 14: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 14: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 18: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 18: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 2: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 18: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 18: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 0: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 19: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 14: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 18: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 2: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 2: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 2: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 12: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 18: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 18: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 18: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 18: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 18: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 14: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 6: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 2: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 2: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 12: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 14: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 18: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 6: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 12: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 14: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 25: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 25: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 25: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 25: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 25: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 14: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 25: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 25: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 6: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 12: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 25: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 25: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 25: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 6: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 25: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 25: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 17: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 17: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 17: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 17: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 17: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 25: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 25: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 17: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 7: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 17: [2023-04-29 17:23:16,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 6: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 4: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 4: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 4: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 14: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 14: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 14: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 14: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 12: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 17: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 17: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 11: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 11: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 17: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 17: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 17: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 21: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 21: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 21: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 21: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 21: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 14: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 17: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 25: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 27: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 4: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 4: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 4: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 12: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 17: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 4: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 27: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 21: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 21: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 4: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 17: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 27: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 6: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 4: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 27: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 27: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 27: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 21: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 21: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 21: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 27: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 22: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 22: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 22: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 22: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 22: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 21: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 21: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 21: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 21: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 1: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 1: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 1: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 1: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 25: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 27: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 6: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 6: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 6: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 4: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 4: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 11: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 9: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 9: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 9: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 14: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 17: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 1: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 1: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 1: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 4: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 4: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 7: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 27: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 27: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 27: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 27: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 27: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 22: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 22: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 4: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 26: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 1: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 1: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 1: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 1: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 9: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 9: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 9: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 9: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 14: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 27: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 1: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 1: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 1: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 6: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 9: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 9: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 27: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 22: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 22: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 22: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 22: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 4: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 22: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 22: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 22: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 4: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 9: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 21: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 1: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 6: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 5: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 5: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 5: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 5: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 9: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 9: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 9: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 9: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 22: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 9: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 27: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 6: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 19: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 21: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 5: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 5: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 5: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 7: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 22: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 29: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 29: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 29: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 5: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 5: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 9: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 5: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 11: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 29: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 29: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 1: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 6: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 5: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 29: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 29: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 26: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 11: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 7: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 29: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 29: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 5: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 5: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 5: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 26: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 29: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 28: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 28: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 28: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 28: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 3: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 3: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 3: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 3: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 3: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 28: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 28: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 28: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 5: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 7: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 7: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 29: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 29: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 29: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 29: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 6: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 19: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 7: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 3: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 3: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 28: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 28: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 28: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 28: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 6: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 19: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 28: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 28: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 28: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 5: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 7: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 3: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 3: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 3: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 29: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 18: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 6: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 3: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 3: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 3: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 11: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 26: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 3: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 7: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 29: [2023-04-29 17:23:16,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 7: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 19: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 26: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 11: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 3: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 18: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 28: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 7: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 19: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 26: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 19: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 18: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 11: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 11: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 3: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 11: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 28: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt... 7: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 19: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 19: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 26: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 26: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 26: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 26: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 18: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 2: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 2: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 2: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 19: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 18: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 11: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 7: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 11: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 11: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 7: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 2: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 19: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 2: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 17: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 18: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 19: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 26: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 26: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 11: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 7: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 18: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 4: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 17: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 7: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 26: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 11: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 19: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 19: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 18: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 18: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 25: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 21: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 11: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 19: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 17: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 18: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 2: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 4: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 18: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 19: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 1: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 26: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 18: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 25: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 1: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 17: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 26: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 18: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 19: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 21: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 2: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 17: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 18: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 2: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 17: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 22: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 22: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 4: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 26: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 29: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 9: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 21: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 25: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 27: [2023-04-29 17:23:16,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 27: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 9: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 18: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 1: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 2: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 9: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 27: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 4: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 17: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 2: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 25: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 22: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 17: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 18: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 2: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 4: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 21: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 1: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 4: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 3: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 2: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 2: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 25: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 29: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 2: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 4: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 17: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 17: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 17: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 25: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 21: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 21: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 17: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 21: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 3: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 21: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 17: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 1: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 4: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 4: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 9: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 25: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 25: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 25: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 29: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 2: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 5: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 17: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 29: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 1: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 27: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 22: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 21: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 1: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 4: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 21: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 22: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 29: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 29: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 1: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 25: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 25: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 4: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 4: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 21: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 1: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 22: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 9: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 17: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 27: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 29: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 3: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 22: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 1: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 9: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 9: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 9: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 27: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 27: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 22: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 21: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 1: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 2: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 3: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 25: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 22: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 29: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 29: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 3: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 22: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 28: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 1: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 5: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 4: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 9: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 9: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 25: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 27: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 27: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 21: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 29: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 17: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 5: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 9: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 21: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 27: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 4: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 22: [2023-04-29 17:23:16,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 9: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 25: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 25: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 28: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 1: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 3: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 3: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 22: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 21: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 29: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 29: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 27: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 28: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 4: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 3: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 5: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 5: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 27: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 22: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 21: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 1: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 5: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 4: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 25: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 29: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 29: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 9: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 9: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 3: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 22: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 27: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 1: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 5: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 3: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 27: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 3: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 3: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 22: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 29: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 28: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 5: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 27: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 9: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 3: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 1: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 5: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 29: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 5: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 28: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 22: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 28: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 9: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 5: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 3: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 28: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 5: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 27: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 5: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 28: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 3: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 28: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 28: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 28: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/mp_rank_00_model_states.pt. 5: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 3: [2023-04-29 17:23:16,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 5: [2023-04-29 17:23:16,627] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 28: [2023-04-29 17:23:16,627] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 5: [2023-04-29 17:23:16,627] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 28: [2023-04-29 17:23:16,627] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 28: [2023-04-29 17:23:16,627] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 28: [2023-04-29 17:23:16,627] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 28: [2023-04-29 17:23:16,627] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 11: [2023-04-29 17:23:17,324] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 11: [2023-04-29 17:23:17,324] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 11: [2023-04-29 17:23:17,324] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 11: [2023-04-29 17:23:17,325] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 11: [2023-04-29 17:23:17,325] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 11: [2023-04-29 17:23:17,325] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 11: [2023-04-29 17:23:17,325] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 11: [2023-04-29 17:23:17,326] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 11: [2023-04-29 17:23:17,332] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 11: [2023-04-29 17:23:17,332] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 11: [2023-04-29 17:23:17,332] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 21: [2023-04-29 17:23:17,333] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 21: [2023-04-29 17:23:17,333] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 21: [2023-04-29 17:23:17,333] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 21: [2023-04-29 17:23:17,333] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 21: [2023-04-29 17:23:17,333] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 21: [2023-04-29 17:23:17,333] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 21: [2023-04-29 17:23:17,334] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 21: [2023-04-29 17:23:17,334] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 23: [2023-04-29 17:23:17,337] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 23: [2023-04-29 17:23:17,338] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 23: [2023-04-29 17:23:17,339] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 23: [2023-04-29 17:23:17,339] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 23: [2023-04-29 17:23:17,339] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 23: [2023-04-29 17:23:17,339] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 11: [2023-04-29 17:23:17,339] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 11: [2023-04-29 17:23:17,339] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 23: [2023-04-29 17:23:17,340] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 11: [2023-04-29 17:23:17,340] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 11: [2023-04-29 17:23:17,341] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 23: [2023-04-29 17:23:17,341] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 21: [2023-04-29 17:23:17,342] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 21: [2023-04-29 17:23:17,342] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 21: [2023-04-29 17:23:17,342] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 11: [2023-04-29 17:23:17,342] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 21: [2023-04-29 17:23:17,344] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 21: [2023-04-29 17:23:17,344] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 21: [2023-04-29 17:23:17,345] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 21: [2023-04-29 17:23:17,345] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 21: [2023-04-29 17:23:17,345] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 23: [2023-04-29 17:23:17,346] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 2: [2023-04-29 17:23:17,345] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 2: [2023-04-29 17:23:17,345] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 2: [2023-04-29 17:23:17,346] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 2: [2023-04-29 17:23:17,346] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 2: [2023-04-29 17:23:17,346] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 2: [2023-04-29 17:23:17,346] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 2: [2023-04-29 17:23:17,346] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 2: [2023-04-29 17:23:17,346] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 27: [2023-04-29 17:23:17,347] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 27: [2023-04-29 17:23:17,347] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 27: [2023-04-29 17:23:17,348] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 27: [2023-04-29 17:23:17,348] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 27: [2023-04-29 17:23:17,348] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 27: [2023-04-29 17:23:17,348] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 27: [2023-04-29 17:23:17,348] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 27: [2023-04-29 17:23:17,348] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 23: [2023-04-29 17:23:17,350] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 7: [2023-04-29 17:23:17,350] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 7: [2023-04-29 17:23:17,350] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 22: [2023-04-29 17:23:17,351] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 22: [2023-04-29 17:23:17,351] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 7: [2023-04-29 17:23:17,352] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 7: [2023-04-29 17:23:17,352] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 7: [2023-04-29 17:23:17,352] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 7: [2023-04-29 17:23:17,352] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 7: [2023-04-29 17:23:17,352] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 22: [2023-04-29 17:23:17,352] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 7: [2023-04-29 17:23:17,352] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 22: [2023-04-29 17:23:17,352] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 22: [2023-04-29 17:23:17,352] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 22: [2023-04-29 17:23:17,352] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 22: [2023-04-29 17:23:17,352] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 22: [2023-04-29 17:23:17,352] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 0: [2023-04-29 17:23:17,352] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 1: [2023-04-29 17:23:17,352] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 1: [2023-04-29 17:23:17,352] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 1: [2023-04-29 17:23:17,352] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 1: [2023-04-29 17:23:17,352] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 1: [2023-04-29 17:23:17,352] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 1: [2023-04-29 17:23:17,352] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 1: [2023-04-29 17:23:17,352] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 0: [2023-04-29 17:23:17,353] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 1: [2023-04-29 17:23:17,353] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 0: [2023-04-29 17:23:17,353] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 0: [2023-04-29 17:23:17,353] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 0: [2023-04-29 17:23:17,353] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 0: [2023-04-29 17:23:17,353] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 0: [2023-04-29 17:23:17,353] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 2: [2023-04-29 17:23:17,353] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 2: [2023-04-29 17:23:17,353] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 2: [2023-04-29 17:23:17,354] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 6: [2023-04-29 17:23:17,354] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 6: [2023-04-29 17:23:17,354] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 6: [2023-04-29 17:23:17,354] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 6: [2023-04-29 17:23:17,354] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 6: [2023-04-29 17:23:17,354] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 6: [2023-04-29 17:23:17,354] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 6: [2023-04-29 17:23:17,354] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 16: [2023-04-29 17:23:17,354] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 16: [2023-04-29 17:23:17,354] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 16: [2023-04-29 17:23:17,354] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 6: [2023-04-29 17:23:17,354] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 0: [2023-04-29 17:23:17,355] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 23: [2023-04-29 17:23:17,355] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 31: [2023-04-29 17:23:17,355] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 31: [2023-04-29 17:23:17,355] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 31: [2023-04-29 17:23:17,355] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 31: [2023-04-29 17:23:17,355] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 16: [2023-04-29 17:23:17,355] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 16: [2023-04-29 17:23:17,355] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 16: [2023-04-29 17:23:17,355] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 16: [2023-04-29 17:23:17,355] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 31: [2023-04-29 17:23:17,355] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 31: [2023-04-29 17:23:17,356] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 31: [2023-04-29 17:23:17,356] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 16: [2023-04-29 17:23:17,356] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 23: [2023-04-29 17:23:17,356] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 23: [2023-04-29 17:23:17,356] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 27: [2023-04-29 17:23:17,356] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 23: [2023-04-29 17:23:17,356] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 31: [2023-04-29 17:23:17,357] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 23: [2023-04-29 17:23:17,357] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 15: [2023-04-29 17:23:17,358] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 15: [2023-04-29 17:23:17,357] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 15: [2023-04-29 17:23:17,358] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 15: [2023-04-29 17:23:17,358] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 15: [2023-04-29 17:23:17,357] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 15: [2023-04-29 17:23:17,358] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 15: [2023-04-29 17:23:17,357] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 27: [2023-04-29 17:23:17,358] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 15: [2023-04-29 17:23:17,358] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 7: [2023-04-29 17:23:17,358] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 7: [2023-04-29 17:23:17,358] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 23: [2023-04-29 17:23:17,358] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 7: [2023-04-29 17:23:17,359] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 22: [2023-04-29 17:23:17,359] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 22: [2023-04-29 17:23:17,359] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 2: [2023-04-29 17:23:17,360] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 2: [2023-04-29 17:23:17,360] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 1: [2023-04-29 17:23:17,361] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 1: [2023-04-29 17:23:17,361] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 1: [2023-04-29 17:23:17,361] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 2: [2023-04-29 17:23:17,361] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 1: [2023-04-29 17:23:17,362] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 6: [2023-04-29 17:23:17,362] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 6: [2023-04-29 17:23:17,362] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 7: [2023-04-29 17:23:17,362] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 7: [2023-04-29 17:23:17,362] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 2: [2023-04-29 17:23:17,362] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 7: [2023-04-29 17:23:17,362] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 7: [2023-04-29 17:23:17,362] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 7: [2023-04-29 17:23:17,363] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 31: [2023-04-29 17:23:17,363] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 31: [2023-04-29 17:23:17,363] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 31: [2023-04-29 17:23:17,363] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 2: [2023-04-29 17:23:17,363] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 1: [2023-04-29 17:23:17,364] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 1: [2023-04-29 17:23:17,364] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 1: [2023-04-29 17:23:17,365] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 31: [2023-04-29 17:23:17,365] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 31: [2023-04-29 17:23:17,365] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 16: [2023-04-29 17:23:17,366] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 16: [2023-04-29 17:23:17,366] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 16: [2023-04-29 17:23:17,366] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 16: [2023-04-29 17:23:17,366] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 1: [2023-04-29 17:23:17,366] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 16: [2023-04-29 17:23:17,366] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 31: [2023-04-29 17:23:17,366] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 31: [2023-04-29 17:23:17,366] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 16: [2023-04-29 17:23:17,366] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 16: [2023-04-29 17:23:17,367] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 16: [2023-04-29 17:23:17,367] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 31: [2023-04-29 17:23:17,367] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 6: [2023-04-29 17:23:17,371] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 27: [2023-04-29 17:23:17,370] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 27: [2023-04-29 17:23:17,372] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 6: [2023-04-29 17:23:17,372] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 27: [2023-04-29 17:23:17,372] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 6: [2023-04-29 17:23:17,372] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 22: [2023-04-29 17:23:17,372] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 6: [2023-04-29 17:23:17,372] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 0: [2023-04-29 17:23:17,373] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 0: [2023-04-29 17:23:17,373] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 27: [2023-04-29 17:23:17,373] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 6: [2023-04-29 17:23:17,373] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 18: [2023-04-29 17:23:17,373] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 18: [2023-04-29 17:23:17,373] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 18: [2023-04-29 17:23:17,373] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 27: [2023-04-29 17:23:17,373] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 6: [2023-04-29 17:23:17,373] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 0: [2023-04-29 17:23:17,374] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 27: [2023-04-29 17:23:17,374] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 18: [2023-04-29 17:23:17,374] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 18: [2023-04-29 17:23:17,374] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 18: [2023-04-29 17:23:17,374] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 18: [2023-04-29 17:23:17,374] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 18: [2023-04-29 17:23:17,375] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 22: [2023-04-29 17:23:17,375] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 22: [2023-04-29 17:23:17,375] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 0: [2023-04-29 17:23:17,375] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 22: [2023-04-29 17:23:17,376] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 0: [2023-04-29 17:23:17,377] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 0: [2023-04-29 17:23:17,377] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 22: [2023-04-29 17:23:17,377] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 0: [2023-04-29 17:23:17,378] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 0: [2023-04-29 17:23:17,378] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 22: [2023-04-29 17:23:17,378] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 26: [2023-04-29 17:23:17,380] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 26: [2023-04-29 17:23:17,380] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 26: [2023-04-29 17:23:17,380] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 26: [2023-04-29 17:23:17,380] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 26: [2023-04-29 17:23:17,380] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 26: [2023-04-29 17:23:17,380] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 26: [2023-04-29 17:23:17,381] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 26: [2023-04-29 17:23:17,381] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 15: [2023-04-29 17:23:17,382] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 13: [2023-04-29 17:23:17,382] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 13: [2023-04-29 17:23:17,382] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 15: [2023-04-29 17:23:17,382] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 15: [2023-04-29 17:23:17,383] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 10: [2023-04-29 17:23:17,383] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 10: [2023-04-29 17:23:17,383] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 10: [2023-04-29 17:23:17,383] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 10: [2023-04-29 17:23:17,383] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 10: [2023-04-29 17:23:17,383] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 10: [2023-04-29 17:23:17,383] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 10: [2023-04-29 17:23:17,383] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 10: [2023-04-29 17:23:17,383] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 15: [2023-04-29 17:23:17,383] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 13: [2023-04-29 17:23:17,383] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 13: [2023-04-29 17:23:17,383] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 13: [2023-04-29 17:23:17,383] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 13: [2023-04-29 17:23:17,384] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 13: [2023-04-29 17:23:17,384] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 13: [2023-04-29 17:23:17,384] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 15: [2023-04-29 17:23:17,384] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 15: [2023-04-29 17:23:17,385] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 17: [2023-04-29 17:23:17,384] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 17: [2023-04-29 17:23:17,384] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 17: [2023-04-29 17:23:17,385] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 15: [2023-04-29 17:23:17,385] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 15: [2023-04-29 17:23:17,385] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 17: [2023-04-29 17:23:17,386] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 17: [2023-04-29 17:23:17,386] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 17: [2023-04-29 17:23:17,386] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 17: [2023-04-29 17:23:17,386] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 17: [2023-04-29 17:23:17,386] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 26: [2023-04-29 17:23:17,390] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 13: [2023-04-29 17:23:17,391] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 18: [2023-04-29 17:23:17,390] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 18: [2023-04-29 17:23:17,390] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 18: [2023-04-29 17:23:17,392] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 10: [2023-04-29 17:23:17,392] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 10: [2023-04-29 17:23:17,392] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 10: [2023-04-29 17:23:17,392] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 10: [2023-04-29 17:23:17,392] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 17: [2023-04-29 17:23:17,393] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 13: [2023-04-29 17:23:17,393] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 18: [2023-04-29 17:23:17,393] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 26: [2023-04-29 17:23:17,393] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 26: [2023-04-29 17:23:17,394] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 26: [2023-04-29 17:23:17,394] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 26: [2023-04-29 17:23:17,394] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 26: [2023-04-29 17:23:17,394] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 26: [2023-04-29 17:23:17,394] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 26: [2023-04-29 17:23:17,394] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 18: [2023-04-29 17:23:17,394] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 17: [2023-04-29 17:23:17,395] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 10: [2023-04-29 17:23:17,396] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 18: [2023-04-29 17:23:17,396] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 18: [2023-04-29 17:23:17,396] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 10: [2023-04-29 17:23:17,397] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 18: [2023-04-29 17:23:17,397] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 10: [2023-04-29 17:23:17,397] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 10: [2023-04-29 17:23:17,399] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 13: [2023-04-29 17:23:17,400] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 29: [2023-04-29 17:23:17,399] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 29: [2023-04-29 17:23:17,400] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 13: [2023-04-29 17:23:17,401] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 29: [2023-04-29 17:23:17,401] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 17: [2023-04-29 17:23:17,400] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 17: [2023-04-29 17:23:17,400] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 13: [2023-04-29 17:23:17,401] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 29: [2023-04-29 17:23:17,402] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 29: [2023-04-29 17:23:17,402] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 29: [2023-04-29 17:23:17,402] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 29: [2023-04-29 17:23:17,402] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 17: [2023-04-29 17:23:17,402] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 17: [2023-04-29 17:23:17,402] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 29: [2023-04-29 17:23:17,402] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 13: [2023-04-29 17:23:17,403] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 17: [2023-04-29 17:23:17,403] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 17: [2023-04-29 17:23:17,403] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 13: [2023-04-29 17:23:17,404] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 13: [2023-04-29 17:23:17,404] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 29: [2023-04-29 17:23:17,406] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 11: [2023-04-29 17:23:17,415] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 11: [2023-04-29 17:23:17,415] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 11: [2023-04-29 17:23:17,415] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 29: [2023-04-29 17:23:17,415] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 29: [2023-04-29 17:23:17,416] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 12: [2023-04-29 17:23:17,416] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 12: [2023-04-29 17:23:17,416] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 19: [2023-04-29 17:23:17,417] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 19: [2023-04-29 17:23:17,417] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 28: [2023-04-29 17:23:17,417] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 28: [2023-04-29 17:23:17,417] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 28: [2023-04-29 17:23:17,417] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 19: [2023-04-29 17:23:17,417] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 19: [2023-04-29 17:23:17,417] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 19: [2023-04-29 17:23:17,417] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 28: [2023-04-29 17:23:17,418] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 28: [2023-04-29 17:23:17,418] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 28: [2023-04-29 17:23:17,418] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 28: [2023-04-29 17:23:17,418] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 19: [2023-04-29 17:23:17,418] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 19: [2023-04-29 17:23:17,418] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 28: [2023-04-29 17:23:17,418] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 19: [2023-04-29 17:23:17,419] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 29: [2023-04-29 17:23:17,419] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 29: [2023-04-29 17:23:17,419] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 29: [2023-04-29 17:23:17,420] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 29: [2023-04-29 17:23:17,420] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 12: [2023-04-29 17:23:17,421] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 12: [2023-04-29 17:23:17,421] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 12: [2023-04-29 17:23:17,421] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 12: [2023-04-29 17:23:17,421] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 12: [2023-04-29 17:23:17,421] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 29: [2023-04-29 17:23:17,421] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 12: [2023-04-29 17:23:17,423] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 19: [2023-04-29 17:23:17,425] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 19: [2023-04-29 17:23:17,425] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 19: [2023-04-29 17:23:17,425] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 21: [2023-04-29 17:23:17,426] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 21: [2023-04-29 17:23:17,426] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 21: [2023-04-29 17:23:17,428] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 12: [2023-04-29 17:23:17,429] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 12: [2023-04-29 17:23:17,429] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 19: [2023-04-29 17:23:17,430] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 23: [2023-04-29 17:23:17,430] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 19: [2023-04-29 17:23:17,431] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 19: [2023-04-29 17:23:17,431] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 12: [2023-04-29 17:23:17,431] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 12: [2023-04-29 17:23:17,431] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 19: [2023-04-29 17:23:17,432] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 19: [2023-04-29 17:23:17,432] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 12: [2023-04-29 17:23:17,433] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 12: [2023-04-29 17:23:17,434] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 28: [2023-04-29 17:23:17,434] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 12: [2023-04-29 17:23:17,434] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 23: [2023-04-29 17:23:17,435] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 28: [2023-04-29 17:23:17,435] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 28: [2023-04-29 17:23:17,436] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 11: [2023-04-29 17:23:17,436] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 11: [2023-04-29 17:23:17,436] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 11: [2023-04-29 17:23:17,436] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 2: [2023-04-29 17:23:17,436] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 2: [2023-04-29 17:23:17,436] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 2: [2023-04-29 17:23:17,436] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 28: [2023-04-29 17:23:17,438] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 28: [2023-04-29 17:23:17,438] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 28: [2023-04-29 17:23:17,438] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 12: [2023-04-29 17:23:17,438] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 28: [2023-04-29 17:23:17,439] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 28: [2023-04-29 17:23:17,439] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 7: [2023-04-29 17:23:17,440] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 7: [2023-04-29 17:23:17,440] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 7: [2023-04-29 17:23:17,440] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 6: [2023-04-29 17:23:17,443] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 6: [2023-04-29 17:23:17,443] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 11: [2023-04-29 17:23:17,444] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 11: [2023-04-29 17:23:17,444] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 11: [2023-04-29 17:23:17,444] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 31: [2023-04-29 17:23:17,445] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 31: [2023-04-29 17:23:17,445] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 31: [2023-04-29 17:23:17,445] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 22: [2023-04-29 17:23:17,445] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 22: [2023-04-29 17:23:17,445] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 21: [2023-04-29 17:23:17,445] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 21: [2023-04-29 17:23:17,445] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 21: [2023-04-29 17:23:17,445] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 21: [2023-04-29 17:23:17,445] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 21: [2023-04-29 17:23:17,445] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 1: [2023-04-29 17:23:17,448] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 1: [2023-04-29 17:23:17,448] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 1: [2023-04-29 17:23:17,448] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 1: [2023-04-29 17:23:17,448] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 16: [2023-04-29 17:23:17,450] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 16: [2023-04-29 17:23:17,451] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 16: [2023-04-29 17:23:17,451] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 20: [2023-04-29 17:23:17,451] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 20: [2023-04-29 17:23:17,451] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 5: [2023-04-29 17:23:17,452] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 20: [2023-04-29 17:23:17,452] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 20: [2023-04-29 17:23:17,452] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 20: [2023-04-29 17:23:17,452] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 20: [2023-04-29 17:23:17,452] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 5: [2023-04-29 17:23:17,452] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 20: [2023-04-29 17:23:17,453] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 20: [2023-04-29 17:23:17,454] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 5: [2023-04-29 17:23:17,454] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 5: [2023-04-29 17:23:17,454] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 5: [2023-04-29 17:23:17,454] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 5: [2023-04-29 17:23:17,454] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 5: [2023-04-29 17:23:17,454] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 5: [2023-04-29 17:23:17,454] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 1: [2023-04-29 17:23:17,455] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 1: [2023-04-29 17:23:17,455] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 1: [2023-04-29 17:23:17,455] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 8: [2023-04-29 17:23:17,457] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 8: [2023-04-29 17:23:17,457] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 8: [2023-04-29 17:23:17,457] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 8: [2023-04-29 17:23:17,457] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 8: [2023-04-29 17:23:17,457] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 8: [2023-04-29 17:23:17,457] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 8: [2023-04-29 17:23:17,457] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 8: [2023-04-29 17:23:17,458] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 2: [2023-04-29 17:23:17,458] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 2: [2023-04-29 17:23:17,458] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 11: [2023-04-29 17:23:17,458] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 27: [2023-04-29 17:23:17,459] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 4: [2023-04-29 17:23:17,459] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 4: [2023-04-29 17:23:17,459] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 11: [2023-04-29 17:23:17,459] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 3: [2023-04-29 17:23:17,459] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 3: [2023-04-29 17:23:17,459] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 23: [2023-04-29 17:23:17,460] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 21: [2023-04-29 17:23:17,460] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 21: [2023-04-29 17:23:17,460] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 5: [2023-04-29 17:23:17,460] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 5: [2023-04-29 17:23:17,460] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 4: [2023-04-29 17:23:17,460] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 4: [2023-04-29 17:23:17,460] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 4: [2023-04-29 17:23:17,460] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 4: [2023-04-29 17:23:17,460] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 4: [2023-04-29 17:23:17,460] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 4: [2023-04-29 17:23:17,460] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 27: [2023-04-29 17:23:17,461] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 21: [2023-04-29 17:23:17,461] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 23: [2023-04-29 17:23:17,461] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 20: [2023-04-29 17:23:17,462] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 1: [2023-04-29 17:23:17,462] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 7: [2023-04-29 17:23:17,462] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 7: [2023-04-29 17:23:17,462] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 7: [2023-04-29 17:23:17,462] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 7: [2023-04-29 17:23:17,462] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 7: [2023-04-29 17:23:17,462] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 3: [2023-04-29 17:23:17,462] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 3: [2023-04-29 17:23:17,462] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 3: [2023-04-29 17:23:17,462] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 3: [2023-04-29 17:23:17,462] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 3: [2023-04-29 17:23:17,462] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 20: [2023-04-29 17:23:17,462] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 3: [2023-04-29 17:23:17,462] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 23: [2023-04-29 17:23:17,462] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 23: [2023-04-29 17:23:17,463] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 20: [2023-04-29 17:23:17,463] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 2: [2023-04-29 17:23:17,463] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 25: [2023-04-29 17:23:17,463] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 25: [2023-04-29 17:23:17,463] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 14: [2023-04-29 17:23:17,463] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 14: [2023-04-29 17:23:17,463] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 31: [2023-04-29 17:23:17,464] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 31: [2023-04-29 17:23:17,464] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 31: [2023-04-29 17:23:17,464] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 31: [2023-04-29 17:23:17,464] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 31: [2023-04-29 17:23:17,464] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 14: [2023-04-29 17:23:17,464] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 2: [2023-04-29 17:23:17,465] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 25: [2023-04-29 17:23:17,465] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 25: [2023-04-29 17:23:17,465] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 25: [2023-04-29 17:23:17,465] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 25: [2023-04-29 17:23:17,465] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 25: [2023-04-29 17:23:17,465] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 23: [2023-04-29 17:23:17,464] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 25: [2023-04-29 17:23:17,465] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 14: [2023-04-29 17:23:17,465] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 14: [2023-04-29 17:23:17,465] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 14: [2023-04-29 17:23:17,465] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 14: [2023-04-29 17:23:17,465] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 20: [2023-04-29 17:23:17,466] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 14: [2023-04-29 17:23:17,466] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 16: [2023-04-29 17:23:17,466] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 16: [2023-04-29 17:23:17,466] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 16: [2023-04-29 17:23:17,466] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 16: [2023-04-29 17:23:17,466] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 2: [2023-04-29 17:23:17,466] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 20: [2023-04-29 17:23:17,466] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 2: [2023-04-29 17:23:17,466] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 2: [2023-04-29 17:23:17,466] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 2: [2023-04-29 17:23:17,466] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 4: [2023-04-29 17:23:17,467] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 4: [2023-04-29 17:23:17,467] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 3: [2023-04-29 17:23:17,466] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 3: [2023-04-29 17:23:17,467] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 16: [2023-04-29 17:23:17,467] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 8: [2023-04-29 17:23:17,467] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 9: [2023-04-29 17:23:17,467] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 9: [2023-04-29 17:23:17,467] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 9: [2023-04-29 17:23:17,467] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 9: [2023-04-29 17:23:17,467] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 9: [2023-04-29 17:23:17,467] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 9: [2023-04-29 17:23:17,467] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 9: [2023-04-29 17:23:17,467] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 7: [2023-04-29 17:23:17,468] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 9: [2023-04-29 17:23:17,468] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 20: [2023-04-29 17:23:17,468] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 7: [2023-04-29 17:23:17,468] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 6: [2023-04-29 17:23:17,468] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 8: [2023-04-29 17:23:17,468] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 8: [2023-04-29 17:23:17,469] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 6: [2023-04-29 17:23:17,469] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 20: [2023-04-29 17:23:17,469] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 20: [2023-04-29 17:23:17,470] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 24: [2023-04-29 17:23:17,469] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 7: [2023-04-29 17:23:17,470] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 24: [2023-04-29 17:23:17,470] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 24: [2023-04-29 17:23:17,470] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 24: [2023-04-29 17:23:17,470] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 24: [2023-04-29 17:23:17,470] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 24: [2023-04-29 17:23:17,470] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 24: [2023-04-29 17:23:17,470] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 14: [2023-04-29 17:23:17,470] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 24: [2023-04-29 17:23:17,470] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 5: [2023-04-29 17:23:17,471] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 5: [2023-04-29 17:23:17,471] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 5: [2023-04-29 17:23:17,471] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 8: [2023-04-29 17:23:17,471] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 11: [2023-04-29 17:23:17,472] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 8: [2023-04-29 17:23:17,472] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 11: [2023-04-29 17:23:17,472] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 5: [2023-04-29 17:23:17,472] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 8: [2023-04-29 17:23:17,473] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 5: [2023-04-29 17:23:17,473] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 5: [2023-04-29 17:23:17,473] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 26: [2023-04-29 17:23:17,473] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 25: [2023-04-29 17:23:17,473] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 25: [2023-04-29 17:23:17,473] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 3: [2023-04-29 17:23:17,474] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 3: [2023-04-29 17:23:17,474] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 23: [2023-04-29 17:23:17,474] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 8: [2023-04-29 17:23:17,474] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 3: [2023-04-29 17:23:17,474] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 11: [2023-04-29 17:23:17,474] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 3: [2023-04-29 17:23:17,474] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 3: [2023-04-29 17:23:17,474] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 8: [2023-04-29 17:23:17,475] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 3: [2023-04-29 17:23:17,475] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 31: [2023-04-29 17:23:17,475] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 23: [2023-04-29 17:23:17,476] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 13: [2023-04-29 17:23:17,475] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 31: [2023-04-29 17:23:17,476] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 31: [2023-04-29 17:23:17,476] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 17: [2023-04-29 17:23:17,476] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 9: [2023-04-29 17:23:17,476] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 9: [2023-04-29 17:23:17,477] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 9: [2023-04-29 17:23:17,477] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 9: [2023-04-29 17:23:17,477] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 9: [2023-04-29 17:23:17,477] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 9: [2023-04-29 17:23:17,477] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 9: [2023-04-29 17:23:17,477] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 22: [2023-04-29 17:23:17,477] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 24: [2023-04-29 17:23:17,477] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 21: [2023-04-29 17:23:17,477] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 27: [2023-04-29 17:23:17,477] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 27: [2023-04-29 17:23:17,477] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 9: [2023-04-29 17:23:17,478] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 27: [2023-04-29 17:23:17,478] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 13: [2023-04-29 17:23:17,478] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 11: [2023-04-29 17:23:17,478] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 4: [2023-04-29 17:23:17,478] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 4: [2023-04-29 17:23:17,478] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 4: [2023-04-29 17:23:17,478] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 22: [2023-04-29 17:23:17,478] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 4: [2023-04-29 17:23:17,478] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 22: [2023-04-29 17:23:17,478] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 11: [2023-04-29 17:23:17,479] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 6: [2023-04-29 17:23:17,479] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 6: [2023-04-29 17:23:17,479] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 22: [2023-04-29 17:23:17,479] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 6: [2023-04-29 17:23:17,479] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 22: [2023-04-29 17:23:17,479] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 4: [2023-04-29 17:23:17,479] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 6: [2023-04-29 17:23:17,479] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 6: [2023-04-29 17:23:17,479] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 14: [2023-04-29 17:23:17,478] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 1: [2023-04-29 17:23:17,479] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 21: [2023-04-29 17:23:17,479] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 21: [2023-04-29 17:23:17,479] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 4: [2023-04-29 17:23:17,480] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 17: [2023-04-29 17:23:17,480] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 10: [2023-04-29 17:23:17,480] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 10: [2023-04-29 17:23:17,480] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 10: [2023-04-29 17:23:17,480] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 10: [2023-04-29 17:23:17,480] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 26: [2023-04-29 17:23:17,480] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 23: [2023-04-29 17:23:17,481] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 1: [2023-04-29 17:23:17,482] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 26: [2023-04-29 17:23:17,482] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 30: [2023-04-29 17:23:17,482] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 16: [2023-04-29 17:23:17,483] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 14: [2023-04-29 17:23:17,483] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 14: [2023-04-29 17:23:17,483] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 14: [2023-04-29 17:23:17,483] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 14: [2023-04-29 17:23:17,483] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 14: [2023-04-29 17:23:17,484] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 1: [2023-04-29 17:23:17,484] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 16: [2023-04-29 17:23:17,484] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 1: [2023-04-29 17:23:17,484] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 21: [2023-04-29 17:23:17,484] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 21: [2023-04-29 17:23:17,485] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 14: [2023-04-29 17:23:17,485] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 30: [2023-04-29 17:23:17,485] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 25: [2023-04-29 17:23:17,484] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 16: [2023-04-29 17:23:17,485] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 25: [2023-04-29 17:23:17,485] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 30: [2023-04-29 17:23:17,486] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 30: [2023-04-29 17:23:17,486] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 30: [2023-04-29 17:23:17,486] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 30: [2023-04-29 17:23:17,486] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 30: [2023-04-29 17:23:17,486] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 29: [2023-04-29 17:23:17,486] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 25: [2023-04-29 17:23:17,486] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 25: [2023-04-29 17:23:17,487] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 2: [2023-04-29 17:23:17,487] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 30: [2023-04-29 17:23:17,487] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 2: [2023-04-29 17:23:17,488] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 1: [2023-04-29 17:23:17,488] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 27: [2023-04-29 17:23:17,488] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 27: [2023-04-29 17:23:17,488] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 27: [2023-04-29 17:23:17,489] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 25: [2023-04-29 17:23:17,489] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 1: [2023-04-29 17:23:17,489] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 24: [2023-04-29 17:23:17,489] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 1: [2023-04-29 17:23:17,490] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 24: [2023-04-29 17:23:17,490] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 22: [2023-04-29 17:23:17,490] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 22: [2023-04-29 17:23:17,490] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 25: [2023-04-29 17:23:17,490] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 24: [2023-04-29 17:23:17,490] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 24: [2023-04-29 17:23:17,490] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 22: [2023-04-29 17:23:17,490] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 24: [2023-04-29 17:23:17,491] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 10: [2023-04-29 17:23:17,491] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 10: [2023-04-29 17:23:17,491] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 10: [2023-04-29 17:23:17,491] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 10: [2023-04-29 17:23:17,491] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 24: [2023-04-29 17:23:17,492] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 24: [2023-04-29 17:23:17,492] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 1: [2023-04-29 17:23:17,493] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 0: [2023-04-29 17:23:17,494] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 0: [2023-04-29 17:23:17,494] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 7: [2023-04-29 17:23:17,495] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 7: [2023-04-29 17:23:17,495] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 30: [2023-04-29 17:23:17,495] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 7: [2023-04-29 17:23:17,495] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 26: [2023-04-29 17:23:17,495] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 26: [2023-04-29 17:23:17,495] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 26: [2023-04-29 17:23:17,495] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 26: [2023-04-29 17:23:17,496] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 26: [2023-04-29 17:23:17,496] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 31: [2023-04-29 17:23:17,496] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 31: [2023-04-29 17:23:17,497] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 23: [2023-04-29 17:23:17,498] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 31: [2023-04-29 17:23:17,499] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 16: [2023-04-29 17:23:17,499] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 27: [2023-04-29 17:23:17,499] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 31: [2023-04-29 17:23:17,499] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 23: [2023-04-29 17:23:17,500] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 7: [2023-04-29 17:23:17,501] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 2: [2023-04-29 17:23:17,501] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 2: [2023-04-29 17:23:17,501] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 7: [2023-04-29 17:23:17,501] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 23: [2023-04-29 17:23:17,501] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 27: [2023-04-29 17:23:17,501] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 31: [2023-04-29 17:23:17,501] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 16: [2023-04-29 17:23:17,502] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 16: [2023-04-29 17:23:17,503] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 13: [2023-04-29 17:23:17,503] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 30: [2023-04-29 17:23:17,503] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 30: [2023-04-29 17:23:17,503] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 2: [2023-04-29 17:23:17,503] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 16: [2023-04-29 17:23:17,503] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 30: [2023-04-29 17:23:17,503] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 30: [2023-04-29 17:23:17,504] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 26: [2023-04-29 17:23:17,504] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 13: [2023-04-29 17:23:17,504] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 30: [2023-04-29 17:23:17,504] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 30: [2023-04-29 17:23:17,504] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 15: [2023-04-29 17:23:17,504] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 15: [2023-04-29 17:23:17,504] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 15: [2023-04-29 17:23:17,504] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 15: [2023-04-29 17:23:17,504] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 30: [2023-04-29 17:23:17,505] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt... 17: [2023-04-29 17:23:17,505] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 6: [2023-04-29 17:23:17,505] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 16: [2023-04-29 17:23:17,506] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 23: [2023-04-29 17:23:17,506] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 17: [2023-04-29 17:23:17,507] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 17: [2023-04-29 17:23:17,507] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 13: [2023-04-29 17:23:17,507] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 15: [2023-04-29 17:23:17,507] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 15: [2023-04-29 17:23:17,507] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 15: [2023-04-29 17:23:17,507] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 15: [2023-04-29 17:23:17,507] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 17: [2023-04-29 17:23:17,508] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 18: [2023-04-29 17:23:17,508] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 19: [2023-04-29 17:23:17,508] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 19: [2023-04-29 17:23:17,508] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 19: [2023-04-29 17:23:17,508] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 13: [2023-04-29 17:23:17,509] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 18: [2023-04-29 17:23:17,509] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 18: [2023-04-29 17:23:17,509] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 13: [2023-04-29 17:23:17,509] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 26: [2023-04-29 17:23:17,510] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 29: [2023-04-29 17:23:17,511] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 23: [2023-04-29 17:23:17,511] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 10: [2023-04-29 17:23:17,512] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 6: [2023-04-29 17:23:17,512] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 26: [2023-04-29 17:23:17,513] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 6: [2023-04-29 17:23:17,514] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 13: [2023-04-29 17:23:17,515] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 13: [2023-04-29 17:23:17,515] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 0: [2023-04-29 17:23:17,515] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 13: [2023-04-29 17:23:17,515] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 0: [2023-04-29 17:23:17,515] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 0: [2023-04-29 17:23:17,515] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 0: [2023-04-29 17:23:17,515] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 0: [2023-04-29 17:23:17,515] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 12: [2023-04-29 17:23:17,516] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 17: [2023-04-29 17:23:17,516] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 17: [2023-04-29 17:23:17,516] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 12: [2023-04-29 17:23:17,517] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 27: [2023-04-29 17:23:17,517] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 22: [2023-04-29 17:23:17,517] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 27: [2023-04-29 17:23:17,517] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 23: [2023-04-29 17:23:17,518] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 27: [2023-04-29 17:23:17,518] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 6: [2023-04-29 17:23:17,518] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 17: [2023-04-29 17:23:17,518] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 17: [2023-04-29 17:23:17,518] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 10: [2023-04-29 17:23:17,518] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 6: [2023-04-29 17:23:17,518] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 10: [2023-04-29 17:23:17,518] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 6: [2023-04-29 17:23:17,519] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 10: [2023-04-29 17:23:17,519] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 0: [2023-04-29 17:23:17,519] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 22: [2023-04-29 17:23:17,520] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 22: [2023-04-29 17:23:17,521] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 12: [2023-04-29 17:23:17,522] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 0: [2023-04-29 17:23:17,522] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 10: [2023-04-29 17:23:17,525] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 10: [2023-04-29 17:23:17,526] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 10: [2023-04-29 17:23:17,526] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 0: [2023-04-29 17:23:17,526] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 27: [2023-04-29 17:23:17,526] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 27: [2023-04-29 17:23:17,527] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 19: [2023-04-29 17:23:17,527] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 10: [2023-04-29 17:23:17,528] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 26: [2023-04-29 17:23:17,529] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 26: [2023-04-29 17:23:17,529] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 22: [2023-04-29 17:23:17,529] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 29: [2023-04-29 17:23:17,529] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 29: [2023-04-29 17:23:17,529] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 22: [2023-04-29 17:23:17,530] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 12: [2023-04-29 17:23:17,530] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 12: [2023-04-29 17:23:17,530] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 12: [2023-04-29 17:23:17,530] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 12: [2023-04-29 17:23:17,530] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 27: [2023-04-29 17:23:17,531] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 22: [2023-04-29 17:23:17,532] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 6: [2023-04-29 17:23:17,532] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 19: [2023-04-29 17:23:17,532] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 19: [2023-04-29 17:23:17,532] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 19: [2023-04-29 17:23:17,532] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 19: [2023-04-29 17:23:17,532] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 18: [2023-04-29 17:23:17,537] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 18: [2023-04-29 17:23:17,537] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 19: [2023-04-29 17:23:17,538] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 5: [2023-04-29 17:23:17,538] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 26: [2023-04-29 17:23:17,539] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 26: [2023-04-29 17:23:17,539] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 26: [2023-04-29 17:23:17,539] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 18: [2023-04-29 17:23:17,539] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 5: [2023-04-29 17:23:17,539] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 18: [2023-04-29 17:23:17,540] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 18: [2023-04-29 17:23:17,540] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 18: [2023-04-29 17:23:17,540] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 18: [2023-04-29 17:23:17,540] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 18: [2023-04-29 17:23:17,540] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 29: [2023-04-29 17:23:17,540] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 29: [2023-04-29 17:23:17,540] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 29: [2023-04-29 17:23:17,540] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 29: [2023-04-29 17:23:17,540] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 29: [2023-04-29 17:23:17,540] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 19: [2023-04-29 17:23:17,540] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 17: [2023-04-29 17:23:17,541] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 17: [2023-04-29 17:23:17,542] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 12: [2023-04-29 17:23:17,542] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 19: [2023-04-29 17:23:17,544] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 13: [2023-04-29 17:23:17,545] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 4: [2023-04-29 17:23:17,545] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 4: [2023-04-29 17:23:17,545] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 20: [2023-04-29 17:23:17,546] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 20: [2023-04-29 17:23:17,546] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 13: [2023-04-29 17:23:17,547] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 15: [2023-04-29 17:23:17,549] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 14: [2023-04-29 17:23:17,550] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 13: [2023-04-29 17:23:17,551] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 20: [2023-04-29 17:23:17,552] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 8: [2023-04-29 17:23:17,552] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 8: [2023-04-29 17:23:17,553] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 8: [2023-04-29 17:23:17,553] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 13: [2023-04-29 17:23:17,553] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 28: [2023-04-29 17:23:17,553] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 13: [2023-04-29 17:23:17,554] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 28: [2023-04-29 17:23:17,554] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 28: [2023-04-29 17:23:17,554] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 0: [2023-04-29 17:23:17,554] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 13: [2023-04-29 17:23:17,555] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 25: [2023-04-29 17:23:17,555] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 25: [2023-04-29 17:23:17,555] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 15: [2023-04-29 17:23:17,555] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 15: [2023-04-29 17:23:17,555] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 24: [2023-04-29 17:23:17,558] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 12: [2023-04-29 17:23:17,548] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 17: [2023-04-29 17:23:17,550] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 3: [2023-04-29 17:23:17,548] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 3: [2023-04-29 17:23:17,548] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 15: [2023-04-29 17:23:17,559] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 12: [2023-04-29 17:23:17,550] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 17: [2023-04-29 17:23:17,555] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 12: [2023-04-29 17:23:17,555] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 17: [2023-04-29 17:23:17,555] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 17: [2023-04-29 17:23:17,556] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 0: [2023-04-29 17:23:17,559] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 15: [2023-04-29 17:23:17,561] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 15: [2023-04-29 17:23:17,561] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 0: [2023-04-29 17:23:17,561] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 0: [2023-04-29 17:23:17,562] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 15: [2023-04-29 17:23:17,562] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 15: [2023-04-29 17:23:17,563] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 5: [2023-04-29 17:23:17,564] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 5: [2023-04-29 17:23:17,565] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 0: [2023-04-29 17:23:17,565] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 9: [2023-04-29 17:23:17,565] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 9: [2023-04-29 17:23:17,565] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 19: [2023-04-29 17:23:17,565] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 0: [2023-04-29 17:23:17,565] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 20: [2023-04-29 17:23:17,566] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 20: [2023-04-29 17:23:17,566] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 19: [2023-04-29 17:23:17,566] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 19: [2023-04-29 17:23:17,567] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 12: [2023-04-29 17:23:17,567] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 19: [2023-04-29 17:23:17,567] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 12: [2023-04-29 17:23:17,567] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 29: [2023-04-29 17:23:17,568] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 29: [2023-04-29 17:23:17,568] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 12: [2023-04-29 17:23:17,569] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 18: [2023-04-29 17:23:17,570] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 9: [2023-04-29 17:23:17,570] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 9: [2023-04-29 17:23:17,570] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 9: [2023-04-29 17:23:17,570] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 9: [2023-04-29 17:23:17,570] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 9: [2023-04-29 17:23:17,570] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 9: [2023-04-29 17:23:17,570] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 8: [2023-04-29 17:23:17,570] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 20: [2023-04-29 17:23:17,571] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 20: [2023-04-29 17:23:17,571] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 20: [2023-04-29 17:23:17,571] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 8: [2023-04-29 17:23:17,571] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 12: [2023-04-29 17:23:17,571] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 19: [2023-04-29 17:23:17,571] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 4: [2023-04-29 17:23:17,572] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 8: [2023-04-29 17:23:17,573] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 8: [2023-04-29 17:23:17,573] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 18: [2023-04-29 17:23:17,573] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 8: [2023-04-29 17:23:17,573] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 14: [2023-04-29 17:23:17,574] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 3: [2023-04-29 17:23:17,575] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 4: [2023-04-29 17:23:17,575] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 5: [2023-04-29 17:23:17,576] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 5: [2023-04-29 17:23:17,576] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 5: [2023-04-29 17:23:17,576] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 5: [2023-04-29 17:23:17,576] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 12: [2023-04-29 17:23:17,576] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 3: [2023-04-29 17:23:17,576] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 29: [2023-04-29 17:23:17,576] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 18: [2023-04-29 17:23:17,579] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 18: [2023-04-29 17:23:17,579] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 18: [2023-04-29 17:23:17,579] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 3: [2023-04-29 17:23:17,580] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 3: [2023-04-29 17:23:17,580] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 3: [2023-04-29 17:23:17,580] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 3: [2023-04-29 17:23:17,580] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 3: [2023-04-29 17:23:17,580] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 3: [2023-04-29 17:23:17,580] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 20: [2023-04-29 17:23:17,582] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 8: [2023-04-29 17:23:17,582] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 28: [2023-04-29 17:23:17,582] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 28: [2023-04-29 17:23:17,582] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 28: [2023-04-29 17:23:17,582] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 28: [2023-04-29 17:23:17,582] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 28: [2023-04-29 17:23:17,582] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 4: [2023-04-29 17:23:17,583] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 4: [2023-04-29 17:23:17,583] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 4: [2023-04-29 17:23:17,584] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 4: [2023-04-29 17:23:17,584] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 28: [2023-04-29 17:23:17,584] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 28: [2023-04-29 17:23:17,584] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 29: [2023-04-29 17:23:17,584] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 20: [2023-04-29 17:23:17,585] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 29: [2023-04-29 17:23:17,585] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 29: [2023-04-29 17:23:17,585] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 29: [2023-04-29 17:23:17,585] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 24: [2023-04-29 17:23:17,586] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 28: [2023-04-29 17:23:17,586] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 25: [2023-04-29 17:23:17,587] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 20: [2023-04-29 17:23:17,587] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 8: [2023-04-29 17:23:17,589] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 8: [2023-04-29 17:23:17,589] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 25: [2023-04-29 17:23:17,589] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 25: [2023-04-29 17:23:17,590] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 25: [2023-04-29 17:23:17,590] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 25: [2023-04-29 17:23:17,590] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 25: [2023-04-29 17:23:17,590] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 5: [2023-04-29 17:23:17,590] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 5: [2023-04-29 17:23:17,590] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 20: [2023-04-29 17:23:17,597] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 14: [2023-04-29 17:23:17,598] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 9: [2023-04-29 17:23:17,600] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 9: [2023-04-29 17:23:17,600] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 20: [2023-04-29 17:23:17,600] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 9: [2023-04-29 17:23:17,601] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 9: [2023-04-29 17:23:17,602] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 9: [2023-04-29 17:23:17,602] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 14: [2023-04-29 17:23:17,602] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 14: [2023-04-29 17:23:17,602] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 14: [2023-04-29 17:23:17,602] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 9: [2023-04-29 17:23:17,603] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 14: [2023-04-29 17:23:17,603] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 9: [2023-04-29 17:23:17,603] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 4: [2023-04-29 17:23:17,604] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 4: [2023-04-29 17:23:17,604] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 20: [2023-04-29 17:23:17,604] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 14: [2023-04-29 17:23:17,604] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 20: [2023-04-29 17:23:17,604] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 24: [2023-04-29 17:23:17,605] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 24: [2023-04-29 17:23:17,605] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 9: [2023-04-29 17:23:17,606] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 14: [2023-04-29 17:23:17,606] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 20: [2023-04-29 17:23:17,606] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 24: [2023-04-29 17:23:17,607] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 8: [2023-04-29 17:23:17,610] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 8: [2023-04-29 17:23:17,610] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 4: [2023-04-29 17:23:17,611] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 5: [2023-04-29 17:23:17,613] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 5: [2023-04-29 17:23:17,613] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 30: [2023-04-29 17:23:17,613] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 8: [2023-04-29 17:23:17,613] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 8: [2023-04-29 17:23:17,613] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 8: [2023-04-29 17:23:17,613] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 25: [2023-04-29 17:23:17,614] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 25: [2023-04-29 17:23:17,614] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 24: [2023-04-29 17:23:17,614] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 24: [2023-04-29 17:23:17,614] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 24: [2023-04-29 17:23:17,614] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 24: [2023-04-29 17:23:17,614] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 28: [2023-04-29 17:23:17,616] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 28: [2023-04-29 17:23:17,616] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 28: [2023-04-29 17:23:17,618] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 3: [2023-04-29 17:23:17,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 4: [2023-04-29 17:23:17,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 3: [2023-04-29 17:23:17,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 5: [2023-04-29 17:23:17,620] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 5: [2023-04-29 17:23:17,620] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 5: [2023-04-29 17:23:17,620] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 3: [2023-04-29 17:23:17,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 25: [2023-04-29 17:23:17,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 28: [2023-04-29 17:23:17,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 25: [2023-04-29 17:23:17,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 5: [2023-04-29 17:23:17,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 28: [2023-04-29 17:23:17,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 3: [2023-04-29 17:23:17,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 4: [2023-04-29 17:23:17,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 3: [2023-04-29 17:23:17,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 4: [2023-04-29 17:23:17,627] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 25: [2023-04-29 17:23:17,628] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 25: [2023-04-29 17:23:17,629] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 3: [2023-04-29 17:23:17,630] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 4: [2023-04-29 17:23:17,634] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 4: [2023-04-29 17:23:17,636] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 30: [2023-04-29 17:23:17,639] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 30: [2023-04-29 17:23:17,639] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 30: [2023-04-29 17:23:17,639] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 30: [2023-04-29 17:23:17,639] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 24: [2023-04-29 17:23:17,639] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 30: [2023-04-29 17:23:17,639] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 30: [2023-04-29 17:23:17,639] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 30: [2023-04-29 17:23:17,639] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_01-model_00-model_states.pt. 30: [2023-04-29 17:23:17,640] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 14: [2023-04-29 17:23:17,640] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 14: [2023-04-29 17:23:17,641] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 14: [2023-04-29 17:23:17,642] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 14: [2023-04-29 17:23:17,644] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 25: [2023-04-29 17:23:17,646] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 24: [2023-04-29 17:23:17,648] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 25: [2023-04-29 17:23:17,649] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 14: [2023-04-29 17:23:17,650] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 14: [2023-04-29 17:23:17,651] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 24: [2023-04-29 17:23:17,652] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 24: [2023-04-29 17:23:17,652] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 24: [2023-04-29 17:23:17,654] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 14: [2023-04-29 17:23:17,655] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 24: [2023-04-29 17:23:17,658] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 24: [2023-04-29 17:23:17,660] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 30: [2023-04-29 17:23:17,676] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 30: [2023-04-29 17:23:17,676] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 30: [2023-04-29 17:23:17,677] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 30: [2023-04-29 17:23:17,684] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 30: [2023-04-29 17:23:17,685] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 30: [2023-04-29 17:23:17,687] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 30: [2023-04-29 17:23:17,687] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 19: [2023-04-29 17:23:17,904] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 19: [2023-04-29 17:23:17,905] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 19: [2023-04-29 17:23:17,905] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 19: [2023-04-29 17:23:17,905] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 19: [2023-04-29 17:23:17,905] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 19: [2023-04-29 17:23:17,905] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 19: [2023-04-29 17:23:17,905] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 19: [2023-04-29 17:23:17,905] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 19: [2023-04-29 17:23:17,909] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 19: [2023-04-29 17:23:17,909] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 19: [2023-04-29 17:23:17,910] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 19: [2023-04-29 17:23:17,912] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 19: [2023-04-29 17:23:17,912] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 19: [2023-04-29 17:23:17,913] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 0: [2023-04-29 17:23:17,913] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 0: [2023-04-29 17:23:17,913] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 0: [2023-04-29 17:23:17,913] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 0: [2023-04-29 17:23:17,913] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 0: [2023-04-29 17:23:17,913] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 0: [2023-04-29 17:23:17,913] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 0: [2023-04-29 17:23:17,913] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 0: [2023-04-29 17:23:17,913] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 19: [2023-04-29 17:23:17,914] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 19: [2023-04-29 17:23:17,914] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 2: [2023-04-29 17:23:17,920] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 2: [2023-04-29 17:23:17,920] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 2: [2023-04-29 17:23:17,920] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 2: [2023-04-29 17:23:17,921] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 2: [2023-04-29 17:23:17,921] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 2: [2023-04-29 17:23:17,921] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 2: [2023-04-29 17:23:17,921] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 2: [2023-04-29 17:23:17,921] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 0: [2023-04-29 17:23:17,925] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 2: [2023-04-29 17:23:17,925] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 2: [2023-04-29 17:23:17,925] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 2: [2023-04-29 17:23:17,925] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 7: [2023-04-29 17:23:17,925] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 7: [2023-04-29 17:23:17,925] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 7: [2023-04-29 17:23:17,925] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 7: [2023-04-29 17:23:17,925] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 7: [2023-04-29 17:23:17,925] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 7: [2023-04-29 17:23:17,925] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 7: [2023-04-29 17:23:17,925] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 7: [2023-04-29 17:23:17,925] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 0: [2023-04-29 17:23:17,926] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 0: [2023-04-29 17:23:17,926] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 0: [2023-04-29 17:23:17,927] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 0: [2023-04-29 17:23:17,927] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 0: [2023-04-29 17:23:17,928] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 0: [2023-04-29 17:23:17,929] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 0: [2023-04-29 17:23:17,929] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 2: [2023-04-29 17:23:17,929] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 2: [2023-04-29 17:23:17,929] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 7: [2023-04-29 17:23:17,929] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 7: [2023-04-29 17:23:17,930] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 7: [2023-04-29 17:23:17,930] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 21: [2023-04-29 17:23:17,930] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 21: [2023-04-29 17:23:17,930] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 21: [2023-04-29 17:23:17,930] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 21: [2023-04-29 17:23:17,930] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 21: [2023-04-29 17:23:17,930] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 21: [2023-04-29 17:23:17,930] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 21: [2023-04-29 17:23:17,930] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 2: [2023-04-29 17:23:17,931] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 21: [2023-04-29 17:23:17,931] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 7: [2023-04-29 17:23:17,931] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 2: [2023-04-29 17:23:17,931] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 7: [2023-04-29 17:23:17,931] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 2: [2023-04-29 17:23:17,932] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 7: [2023-04-29 17:23:17,932] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 7: [2023-04-29 17:23:17,932] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 7: [2023-04-29 17:23:17,932] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 21: [2023-04-29 17:23:17,935] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 21: [2023-04-29 17:23:17,935] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 21: [2023-04-29 17:23:17,935] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 21: [2023-04-29 17:23:17,936] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 21: [2023-04-29 17:23:17,937] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 21: [2023-04-29 17:23:17,937] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 21: [2023-04-29 17:23:17,937] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 21: [2023-04-29 17:23:17,937] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 4: [2023-04-29 17:23:17,962] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 4: [2023-04-29 17:23:17,962] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 4: [2023-04-29 17:23:17,962] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 4: [2023-04-29 17:23:17,962] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 4: [2023-04-29 17:23:17,963] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 4: [2023-04-29 17:23:17,963] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 4: [2023-04-29 17:23:17,963] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 4: [2023-04-29 17:23:17,963] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 22: [2023-04-29 17:23:17,963] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 22: [2023-04-29 17:23:17,963] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 22: [2023-04-29 17:23:17,963] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 22: [2023-04-29 17:23:17,963] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 22: [2023-04-29 17:23:17,963] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 19: [2023-04-29 17:23:17,963] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 19: [2023-04-29 17:23:17,963] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 19: [2023-04-29 17:23:17,963] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 22: [2023-04-29 17:23:17,963] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 22: [2023-04-29 17:23:17,963] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 22: [2023-04-29 17:23:17,964] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 4: [2023-04-29 17:23:17,967] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 4: [2023-04-29 17:23:17,967] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 22: [2023-04-29 17:23:17,968] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 22: [2023-04-29 17:23:17,969] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 4: [2023-04-29 17:23:17,973] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 22: [2023-04-29 17:23:17,974] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 4: [2023-04-29 17:23:17,974] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 22: [2023-04-29 17:23:17,975] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 4: [2023-04-29 17:23:17,975] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 4: [2023-04-29 17:23:17,975] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 22: [2023-04-29 17:23:17,975] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 4: [2023-04-29 17:23:17,975] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 22: [2023-04-29 17:23:17,976] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 19: [2023-04-29 17:23:17,976] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 4: [2023-04-29 17:23:17,976] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 22: [2023-04-29 17:23:17,977] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 22: [2023-04-29 17:23:17,977] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 2: [2023-04-29 17:23:17,977] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 2: [2023-04-29 17:23:17,977] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 2: [2023-04-29 17:23:17,977] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 19: [2023-04-29 17:23:17,978] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 19: [2023-04-29 17:23:17,978] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 19: [2023-04-29 17:23:17,978] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 19: [2023-04-29 17:23:17,978] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 7: [2023-04-29 17:23:17,982] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 7: [2023-04-29 17:23:17,982] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 7: [2023-04-29 17:23:17,982] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 19: [2023-04-29 17:23:17,987] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 19: [2023-04-29 17:23:17,989] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 19: [2023-04-29 17:23:17,989] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 21: [2023-04-29 17:23:17,989] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 21: [2023-04-29 17:23:17,989] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 21: [2023-04-29 17:23:17,989] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 2: [2023-04-29 17:23:17,991] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 2: [2023-04-29 17:23:17,991] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 2: [2023-04-29 17:23:17,991] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 2: [2023-04-29 17:23:17,994] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 2: [2023-04-29 17:23:17,994] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 7: [2023-04-29 17:23:17,996] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 7: [2023-04-29 17:23:17,996] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 7: [2023-04-29 17:23:17,996] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 7: [2023-04-29 17:23:17,996] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 7: [2023-04-29 17:23:17,997] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 31: [2023-04-29 17:23:17,998] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 31: [2023-04-29 17:23:17,998] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 31: [2023-04-29 17:23:17,998] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 31: [2023-04-29 17:23:17,998] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 31: [2023-04-29 17:23:17,998] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 31: [2023-04-29 17:23:17,998] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 31: [2023-04-29 17:23:17,998] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 31: [2023-04-29 17:23:17,999] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 2: [2023-04-29 17:23:18,001] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 31: [2023-04-29 17:23:18,002] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 31: [2023-04-29 17:23:18,002] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 31: [2023-04-29 17:23:18,003] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 21: [2023-04-29 17:23:18,002] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 21: [2023-04-29 17:23:18,002] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 21: [2023-04-29 17:23:18,003] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 21: [2023-04-29 17:23:18,003] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 21: [2023-04-29 17:23:18,003] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 0: [2023-04-29 17:23:18,003] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 0: [2023-04-29 17:23:18,003] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 0: [2023-04-29 17:23:18,003] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 2: [2023-04-29 17:23:18,003] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 2: [2023-04-29 17:23:18,004] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 31: [2023-04-29 17:23:18,004] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 31: [2023-04-29 17:23:18,005] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 31: [2023-04-29 17:23:18,005] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 7: [2023-04-29 17:23:18,005] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 31: [2023-04-29 17:23:18,005] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 31: [2023-04-29 17:23:18,006] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 7: [2023-04-29 17:23:18,006] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 7: [2023-04-29 17:23:18,007] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 19: [2023-04-29 17:23:18,008] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 19: [2023-04-29 17:23:18,010] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 19: [2023-04-29 17:23:18,013] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 19: [2023-04-29 17:23:18,013] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 19: [2023-04-29 17:23:18,013] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 0: [2023-04-29 17:23:18,014] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 0: [2023-04-29 17:23:18,014] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 0: [2023-04-29 17:23:18,014] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 0: [2023-04-29 17:23:18,015] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 0: [2023-04-29 17:23:18,015] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 21: [2023-04-29 17:23:18,015] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 21: [2023-04-29 17:23:18,015] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 21: [2023-04-29 17:23:18,016] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 4: [2023-04-29 17:23:18,016] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 4: [2023-04-29 17:23:18,016] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 22: [2023-04-29 17:23:18,019] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 22: [2023-04-29 17:23:18,019] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 2: [2023-04-29 17:23:18,023] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 2: [2023-04-29 17:23:18,024] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 2: [2023-04-29 17:23:18,026] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 7: [2023-04-29 17:23:18,027] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 7: [2023-04-29 17:23:18,028] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 7: [2023-04-29 17:23:18,030] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 12: [2023-04-29 17:23:18,030] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 12: [2023-04-29 17:23:18,030] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 12: [2023-04-29 17:23:18,030] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 12: [2023-04-29 17:23:18,030] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 12: [2023-04-29 17:23:18,030] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 12: [2023-04-29 17:23:18,030] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 12: [2023-04-29 17:23:18,030] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 12: [2023-04-29 17:23:18,030] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 0: [2023-04-29 17:23:18,031] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 0: [2023-04-29 17:23:18,031] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 7: [2023-04-29 17:23:18,032] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 7: [2023-04-29 17:23:18,032] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 0: [2023-04-29 17:23:18,033] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 2: [2023-04-29 17:23:18,033] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 2: [2023-04-29 17:23:18,033] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 21: [2023-04-29 17:23:18,034] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 21: [2023-04-29 17:23:18,035] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 21: [2023-04-29 17:23:18,035] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 21: [2023-04-29 17:23:18,036] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 13: [2023-04-29 17:23:18,036] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 13: [2023-04-29 17:23:18,036] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 12: [2023-04-29 17:23:18,036] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 12: [2023-04-29 17:23:18,037] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 12: [2023-04-29 17:23:18,037] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 13: [2023-04-29 17:23:18,037] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 13: [2023-04-29 17:23:18,037] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 13: [2023-04-29 17:23:18,037] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 13: [2023-04-29 17:23:18,038] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 13: [2023-04-29 17:23:18,038] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 13: [2023-04-29 17:23:18,038] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 21: [2023-04-29 17:23:18,038] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 4: [2023-04-29 17:23:18,038] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 12: [2023-04-29 17:23:18,039] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 12: [2023-04-29 17:23:18,039] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 12: [2023-04-29 17:23:18,039] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 12: [2023-04-29 17:23:18,040] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 12: [2023-04-29 17:23:18,040] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 29: [2023-04-29 17:23:18,040] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 22: [2023-04-29 17:23:18,040] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 22: [2023-04-29 17:23:18,040] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 22: [2023-04-29 17:23:18,040] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 29: [2023-04-29 17:23:18,041] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 29: [2023-04-29 17:23:18,041] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 4: [2023-04-29 17:23:18,041] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 29: [2023-04-29 17:23:18,041] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 29: [2023-04-29 17:23:18,041] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 29: [2023-04-29 17:23:18,041] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 29: [2023-04-29 17:23:18,041] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 29: [2023-04-29 17:23:18,041] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 13: [2023-04-29 17:23:18,042] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 13: [2023-04-29 17:23:18,043] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 16: [2023-04-29 17:23:18,043] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 16: [2023-04-29 17:23:18,043] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 16: [2023-04-29 17:23:18,043] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 13: [2023-04-29 17:23:18,043] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 16: [2023-04-29 17:23:18,043] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 16: [2023-04-29 17:23:18,043] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 16: [2023-04-29 17:23:18,043] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 16: [2023-04-29 17:23:18,043] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 16: [2023-04-29 17:23:18,044] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 13: [2023-04-29 17:23:18,044] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 29: [2023-04-29 17:23:18,044] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 13: [2023-04-29 17:23:18,045] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 4: [2023-04-29 17:23:18,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 4: [2023-04-29 17:23:18,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 4: [2023-04-29 17:23:18,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 4: [2023-04-29 17:23:18,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 4: [2023-04-29 17:23:18,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 4: [2023-04-29 17:23:18,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 23: [2023-04-29 17:23:18,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 23: [2023-04-29 17:23:18,046] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 23: [2023-04-29 17:23:18,046] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 23: [2023-04-29 17:23:18,046] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 28: [2023-04-29 17:23:18,046] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 28: [2023-04-29 17:23:18,046] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 28: [2023-04-29 17:23:18,046] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 28: [2023-04-29 17:23:18,046] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 28: [2023-04-29 17:23:18,046] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 28: [2023-04-29 17:23:18,046] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 28: [2023-04-29 17:23:18,046] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 22: [2023-04-29 17:23:18,046] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 23: [2023-04-29 17:23:18,047] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 23: [2023-04-29 17:23:18,047] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 23: [2023-04-29 17:23:18,047] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 22: [2023-04-29 17:23:18,047] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 28: [2023-04-29 17:23:18,047] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 23: [2023-04-29 17:23:18,047] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 13: [2023-04-29 17:23:18,047] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 22: [2023-04-29 17:23:18,047] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 22: [2023-04-29 17:23:18,047] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 22: [2023-04-29 17:23:18,047] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 13: [2023-04-29 17:23:18,047] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 13: [2023-04-29 17:23:18,048] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 16: [2023-04-29 17:23:18,049] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 16: [2023-04-29 17:23:18,049] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 16: [2023-04-29 17:23:18,050] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 16: [2023-04-29 17:23:18,050] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 16: [2023-04-29 17:23:18,050] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 16: [2023-04-29 17:23:18,050] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 16: [2023-04-29 17:23:18,050] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 0: [2023-04-29 17:23:18,051] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 23: [2023-04-29 17:23:18,050] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 16: [2023-04-29 17:23:18,051] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 29: [2023-04-29 17:23:18,051] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 6: [2023-04-29 17:23:18,051] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 6: [2023-04-29 17:23:18,051] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 0: [2023-04-29 17:23:18,052] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 6: [2023-04-29 17:23:18,052] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 29: [2023-04-29 17:23:18,052] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 23: [2023-04-29 17:23:18,052] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 6: [2023-04-29 17:23:18,052] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 6: [2023-04-29 17:23:18,052] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 6: [2023-04-29 17:23:18,052] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 6: [2023-04-29 17:23:18,052] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 6: [2023-04-29 17:23:18,053] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 17: [2023-04-29 17:23:18,053] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 17: [2023-04-29 17:23:18,053] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 18: [2023-04-29 17:23:18,052] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 18: [2023-04-29 17:23:18,052] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 18: [2023-04-29 17:23:18,052] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 18: [2023-04-29 17:23:18,053] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 18: [2023-04-29 17:23:18,053] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 29: [2023-04-29 17:23:18,053] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 18: [2023-04-29 17:23:18,053] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 18: [2023-04-29 17:23:18,053] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 18: [2023-04-29 17:23:18,053] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 29: [2023-04-29 17:23:18,054] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 29: [2023-04-29 17:23:18,054] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 29: [2023-04-29 17:23:18,054] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 29: [2023-04-29 17:23:18,054] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 31: [2023-04-29 17:23:18,054] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 31: [2023-04-29 17:23:18,054] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 31: [2023-04-29 17:23:18,054] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 0: [2023-04-29 17:23:18,055] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 0: [2023-04-29 17:23:18,055] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 17: [2023-04-29 17:23:18,055] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 17: [2023-04-29 17:23:18,055] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 17: [2023-04-29 17:23:18,055] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 17: [2023-04-29 17:23:18,055] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 17: [2023-04-29 17:23:18,055] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 17: [2023-04-29 17:23:18,055] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 0: [2023-04-29 17:23:18,056] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 6: [2023-04-29 17:23:18,056] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 6: [2023-04-29 17:23:18,056] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 23: [2023-04-29 17:23:18,056] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 23: [2023-04-29 17:23:18,056] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 23: [2023-04-29 17:23:18,057] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 23: [2023-04-29 17:23:18,057] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 23: [2023-04-29 17:23:18,058] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 23: [2023-04-29 17:23:18,058] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 17: [2023-04-29 17:23:18,060] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 17: [2023-04-29 17:23:18,060] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 17: [2023-04-29 17:23:18,061] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 6: [2023-04-29 17:23:18,060] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 6: [2023-04-29 17:23:18,060] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 6: [2023-04-29 17:23:18,061] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 17: [2023-04-29 17:23:18,061] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 6: [2023-04-29 17:23:18,062] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 6: [2023-04-29 17:23:18,062] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 6: [2023-04-29 17:23:18,062] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 17: [2023-04-29 17:23:18,064] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 17: [2023-04-29 17:23:18,064] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 28: [2023-04-29 17:23:18,065] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 17: [2023-04-29 17:23:18,065] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 28: [2023-04-29 17:23:18,065] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 17: [2023-04-29 17:23:18,065] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 28: [2023-04-29 17:23:18,066] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 18: [2023-04-29 17:23:18,066] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 18: [2023-04-29 17:23:18,066] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 28: [2023-04-29 17:23:18,066] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 18: [2023-04-29 17:23:18,067] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 18: [2023-04-29 17:23:18,067] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 28: [2023-04-29 17:23:18,067] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 18: [2023-04-29 17:23:18,067] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 28: [2023-04-29 17:23:18,067] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 18: [2023-04-29 17:23:18,068] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 28: [2023-04-29 17:23:18,068] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 18: [2023-04-29 17:23:18,068] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 28: [2023-04-29 17:23:18,068] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 18: [2023-04-29 17:23:18,069] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 31: [2023-04-29 17:23:18,070] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 31: [2023-04-29 17:23:18,070] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 31: [2023-04-29 17:23:18,070] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 31: [2023-04-29 17:23:18,070] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 31: [2023-04-29 17:23:18,070] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 1: [2023-04-29 17:23:18,074] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 1: [2023-04-29 17:23:18,074] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 1: [2023-04-29 17:23:18,075] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 1: [2023-04-29 17:23:18,075] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 1: [2023-04-29 17:23:18,075] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 1: [2023-04-29 17:23:18,075] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 1: [2023-04-29 17:23:18,075] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 1: [2023-04-29 17:23:18,075] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 22: [2023-04-29 17:23:18,076] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 22: [2023-04-29 17:23:18,076] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 22: [2023-04-29 17:23:18,077] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 15: [2023-04-29 17:23:18,077] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 15: [2023-04-29 17:23:18,077] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 15: [2023-04-29 17:23:18,077] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 15: [2023-04-29 17:23:18,077] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 15: [2023-04-29 17:23:18,077] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 15: [2023-04-29 17:23:18,077] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 15: [2023-04-29 17:23:18,077] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 15: [2023-04-29 17:23:18,078] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 31: [2023-04-29 17:23:18,078] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 1: [2023-04-29 17:23:18,079] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 1: [2023-04-29 17:23:18,080] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 1: [2023-04-29 17:23:18,080] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 1: [2023-04-29 17:23:18,080] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 31: [2023-04-29 17:23:18,080] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 31: [2023-04-29 17:23:18,081] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 1: [2023-04-29 17:23:18,082] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 1: [2023-04-29 17:23:18,082] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 1: [2023-04-29 17:23:18,083] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 8: [2023-04-29 17:23:18,083] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 8: [2023-04-29 17:23:18,083] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 1: [2023-04-29 17:23:18,083] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 22: [2023-04-29 17:23:18,084] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 22: [2023-04-29 17:23:18,084] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 4: [2023-04-29 17:23:18,085] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 8: [2023-04-29 17:23:18,085] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 8: [2023-04-29 17:23:18,086] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 8: [2023-04-29 17:23:18,086] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 8: [2023-04-29 17:23:18,086] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 8: [2023-04-29 17:23:18,086] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 8: [2023-04-29 17:23:18,086] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 4: [2023-04-29 17:23:18,086] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 4: [2023-04-29 17:23:18,087] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 4: [2023-04-29 17:23:18,087] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 22: [2023-04-29 17:23:18,088] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 12: [2023-04-29 17:23:18,088] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 4: [2023-04-29 17:23:18,089] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 4: [2023-04-29 17:23:18,089] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 15: [2023-04-29 17:23:18,090] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 12: [2023-04-29 17:23:18,090] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 12: [2023-04-29 17:23:18,090] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 15: [2023-04-29 17:23:18,090] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 15: [2023-04-29 17:23:18,091] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 20: [2023-04-29 17:23:18,091] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 20: [2023-04-29 17:23:18,091] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 15: [2023-04-29 17:23:18,091] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 15: [2023-04-29 17:23:18,092] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 15: [2023-04-29 17:23:18,092] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 3: [2023-04-29 17:23:18,092] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 3: [2023-04-29 17:23:18,092] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 3: [2023-04-29 17:23:18,092] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 3: [2023-04-29 17:23:18,092] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 3: [2023-04-29 17:23:18,092] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 3: [2023-04-29 17:23:18,092] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 3: [2023-04-29 17:23:18,092] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 3: [2023-04-29 17:23:18,093] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 15: [2023-04-29 17:23:18,093] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 14: [2023-04-29 17:23:18,092] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 14: [2023-04-29 17:23:18,093] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 14: [2023-04-29 17:23:18,093] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 14: [2023-04-29 17:23:18,093] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 14: [2023-04-29 17:23:18,093] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 14: [2023-04-29 17:23:18,093] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 14: [2023-04-29 17:23:18,093] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 15: [2023-04-29 17:23:18,093] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 14: [2023-04-29 17:23:18,093] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 8: [2023-04-29 17:23:18,094] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 8: [2023-04-29 17:23:18,094] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 20: [2023-04-29 17:23:18,094] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 20: [2023-04-29 17:23:18,095] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 20: [2023-04-29 17:23:18,095] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 20: [2023-04-29 17:23:18,095] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 20: [2023-04-29 17:23:18,095] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 8: [2023-04-29 17:23:18,095] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 20: [2023-04-29 17:23:18,095] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 13: [2023-04-29 17:23:18,095] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 29: [2023-04-29 17:23:18,095] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 24: [2023-04-29 17:23:18,095] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 13: [2023-04-29 17:23:18,095] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 8: [2023-04-29 17:23:18,096] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 8: [2023-04-29 17:23:18,096] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 11: [2023-04-29 17:23:18,096] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 11: [2023-04-29 17:23:18,096] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 3: [2023-04-29 17:23:18,096] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 3: [2023-04-29 17:23:18,096] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 11: [2023-04-29 17:23:18,096] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 24: [2023-04-29 17:23:18,096] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 24: [2023-04-29 17:23:18,096] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 24: [2023-04-29 17:23:18,096] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 8: [2023-04-29 17:23:18,096] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 24: [2023-04-29 17:23:18,096] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 24: [2023-04-29 17:23:18,096] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 24: [2023-04-29 17:23:18,096] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 20: [2023-04-29 17:23:18,097] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 24: [2023-04-29 17:23:18,097] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 20: [2023-04-29 17:23:18,097] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 14: [2023-04-29 17:23:18,097] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 8: [2023-04-29 17:23:18,098] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 8: [2023-04-29 17:23:18,099] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 11: [2023-04-29 17:23:18,098] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 11: [2023-04-29 17:23:18,098] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 11: [2023-04-29 17:23:18,098] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 11: [2023-04-29 17:23:18,098] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 10: [2023-04-29 17:23:18,099] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 10: [2023-04-29 17:23:18,099] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 10: [2023-04-29 17:23:18,099] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 10: [2023-04-29 17:23:18,099] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 10: [2023-04-29 17:23:18,099] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 10: [2023-04-29 17:23:18,099] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 10: [2023-04-29 17:23:18,099] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 11: [2023-04-29 17:23:18,099] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 10: [2023-04-29 17:23:18,099] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 3: [2023-04-29 17:23:18,099] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 3: [2023-04-29 17:23:18,099] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 3: [2023-04-29 17:23:18,100] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 3: [2023-04-29 17:23:18,100] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 3: [2023-04-29 17:23:18,100] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 20: [2023-04-29 17:23:18,100] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 24: [2023-04-29 17:23:18,100] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 31: [2023-04-29 17:23:18,100] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 11: [2023-04-29 17:23:18,101] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 12: [2023-04-29 17:23:18,101] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 3: [2023-04-29 17:23:18,101] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 11: [2023-04-29 17:23:18,101] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 11: [2023-04-29 17:23:18,101] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 31: [2023-04-29 17:23:18,101] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 31: [2023-04-29 17:23:18,102] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 16: [2023-04-29 17:23:18,102] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 16: [2023-04-29 17:23:18,102] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 31: [2023-04-29 17:23:18,102] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 23: [2023-04-29 17:23:18,103] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 14: [2023-04-29 17:23:18,103] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 14: [2023-04-29 17:23:18,103] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 31: [2023-04-29 17:23:18,103] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 20: [2023-04-29 17:23:18,103] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 20: [2023-04-29 17:23:18,104] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 14: [2023-04-29 17:23:18,104] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 14: [2023-04-29 17:23:18,104] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 20: [2023-04-29 17:23:18,105] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 10: [2023-04-29 17:23:18,104] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 10: [2023-04-29 17:23:18,105] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 10: [2023-04-29 17:23:18,105] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 20: [2023-04-29 17:23:18,105] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 14: [2023-04-29 17:23:18,105] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 12: [2023-04-29 17:23:18,105] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 12: [2023-04-29 17:23:18,105] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 12: [2023-04-29 17:23:18,105] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 12: [2023-04-29 17:23:18,105] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 10: [2023-04-29 17:23:18,105] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 20: [2023-04-29 17:23:18,105] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 14: [2023-04-29 17:23:18,105] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 14: [2023-04-29 17:23:18,105] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 23: [2023-04-29 17:23:18,106] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 11: [2023-04-29 17:23:18,107] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 11: [2023-04-29 17:23:18,107] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 6: [2023-04-29 17:23:18,107] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 6: [2023-04-29 17:23:18,107] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 24: [2023-04-29 17:23:18,107] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 16: [2023-04-29 17:23:18,107] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 24: [2023-04-29 17:23:18,108] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 11: [2023-04-29 17:23:18,108] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 10: [2023-04-29 17:23:18,108] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 10: [2023-04-29 17:23:18,108] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 24: [2023-04-29 17:23:18,108] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 11: [2023-04-29 17:23:18,109] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 24: [2023-04-29 17:23:18,109] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 11: [2023-04-29 17:23:18,109] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 10: [2023-04-29 17:23:18,109] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 24: [2023-04-29 17:23:18,109] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 13: [2023-04-29 17:23:18,110] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 13: [2023-04-29 17:23:18,110] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 13: [2023-04-29 17:23:18,110] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 10: [2023-04-29 17:23:18,110] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 24: [2023-04-29 17:23:18,110] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 24: [2023-04-29 17:23:18,110] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 17: [2023-04-29 17:23:18,113] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 12: [2023-04-29 17:23:18,114] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 17: [2023-04-29 17:23:18,115] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 13: [2023-04-29 17:23:18,116] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 13: [2023-04-29 17:23:18,116] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 13: [2023-04-29 17:23:18,117] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 16: [2023-04-29 17:23:18,117] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 16: [2023-04-29 17:23:18,117] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 16: [2023-04-29 17:23:18,117] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 16: [2023-04-29 17:23:18,117] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 16: [2023-04-29 17:23:18,117] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 12: [2023-04-29 17:23:18,118] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 12: [2023-04-29 17:23:18,118] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 13: [2023-04-29 17:23:18,120] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 29: [2023-04-29 17:23:18,120] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 13: [2023-04-29 17:23:18,122] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 5: [2023-04-29 17:23:18,122] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 5: [2023-04-29 17:23:18,122] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 29: [2023-04-29 17:23:18,122] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 29: [2023-04-29 17:23:18,122] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 6: [2023-04-29 17:23:18,125] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 5: [2023-04-29 17:23:18,125] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 5: [2023-04-29 17:23:18,125] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 5: [2023-04-29 17:23:18,125] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 5: [2023-04-29 17:23:18,125] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 5: [2023-04-29 17:23:18,125] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 23: [2023-04-29 17:23:18,126] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 16: [2023-04-29 17:23:18,126] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 5: [2023-04-29 17:23:18,126] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 16: [2023-04-29 17:23:18,126] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 23: [2023-04-29 17:23:18,126] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 5: [2023-04-29 17:23:18,127] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 5: [2023-04-29 17:23:18,127] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 23: [2023-04-29 17:23:18,128] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 23: [2023-04-29 17:23:18,128] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 23: [2023-04-29 17:23:18,128] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 23: [2023-04-29 17:23:18,128] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 6: [2023-04-29 17:23:18,130] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 17: [2023-04-29 17:23:18,130] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 6: [2023-04-29 17:23:18,130] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 17: [2023-04-29 17:23:18,130] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 23: [2023-04-29 17:23:18,130] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 12: [2023-04-29 17:23:18,131] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 23: [2023-04-29 17:23:18,131] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 17: [2023-04-29 17:23:18,132] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 17: [2023-04-29 17:23:18,132] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 6: [2023-04-29 17:23:18,134] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 6: [2023-04-29 17:23:18,134] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 6: [2023-04-29 17:23:18,134] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 6: [2023-04-29 17:23:18,134] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 6: [2023-04-29 17:23:18,134] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 17: [2023-04-29 17:23:18,135] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 17: [2023-04-29 17:23:18,135] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 5: [2023-04-29 17:23:18,135] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 5: [2023-04-29 17:23:18,135] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 5: [2023-04-29 17:23:18,135] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 29: [2023-04-29 17:23:18,135] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 29: [2023-04-29 17:23:18,135] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 29: [2023-04-29 17:23:18,135] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 29: [2023-04-29 17:23:18,136] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 29: [2023-04-29 17:23:18,136] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 17: [2023-04-29 17:23:18,136] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 5: [2023-04-29 17:23:18,136] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 1: [2023-04-29 17:23:18,136] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 1: [2023-04-29 17:23:18,136] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 1: [2023-04-29 17:23:18,136] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 1: [2023-04-29 17:23:18,136] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 5: [2023-04-29 17:23:18,137] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 5: [2023-04-29 17:23:18,137] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 12: [2023-04-29 17:23:18,137] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 16: [2023-04-29 17:23:18,137] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 12: [2023-04-29 17:23:18,139] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 28: [2023-04-29 17:23:18,139] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 28: [2023-04-29 17:23:18,139] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 28: [2023-04-29 17:23:18,139] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 12: [2023-04-29 17:23:18,140] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 12: [2023-04-29 17:23:18,140] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 18: [2023-04-29 17:23:18,141] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 18: [2023-04-29 17:23:18,141] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 18: [2023-04-29 17:23:18,141] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 17: [2023-04-29 17:23:18,142] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 25: [2023-04-29 17:23:18,141] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 25: [2023-04-29 17:23:18,141] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 1: [2023-04-29 17:23:18,142] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 26: [2023-04-29 17:23:18,142] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 26: [2023-04-29 17:23:18,142] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 26: [2023-04-29 17:23:18,142] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 26: [2023-04-29 17:23:18,142] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 26: [2023-04-29 17:23:18,142] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 26: [2023-04-29 17:23:18,142] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 26: [2023-04-29 17:23:18,142] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 1: [2023-04-29 17:23:18,142] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 1: [2023-04-29 17:23:18,142] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 1: [2023-04-29 17:23:18,142] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 26: [2023-04-29 17:23:18,142] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 13: [2023-04-29 17:23:18,144] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 13: [2023-04-29 17:23:18,144] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 13: [2023-04-29 17:23:18,144] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 25: [2023-04-29 17:23:18,145] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 25: [2023-04-29 17:23:18,145] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 25: [2023-04-29 17:23:18,145] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 25: [2023-04-29 17:23:18,145] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 25: [2023-04-29 17:23:18,145] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 25: [2023-04-29 17:23:18,146] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 25: [2023-04-29 17:23:18,146] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 3: [2023-04-29 17:23:18,146] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 3: [2023-04-29 17:23:18,146] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 25: [2023-04-29 17:23:18,147] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 14: [2023-04-29 17:23:18,147] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 6: [2023-04-29 17:23:18,148] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 16: [2023-04-29 17:23:18,148] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 16: [2023-04-29 17:23:18,148] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 8: [2023-04-29 17:23:18,148] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 26: [2023-04-29 17:23:18,148] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 29: [2023-04-29 17:23:18,148] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 26: [2023-04-29 17:23:18,149] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 26: [2023-04-29 17:23:18,149] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 26: [2023-04-29 17:23:18,149] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 16: [2023-04-29 17:23:18,149] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 29: [2023-04-29 17:23:18,150] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 9: [2023-04-29 17:23:18,150] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 9: [2023-04-29 17:23:18,150] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 9: [2023-04-29 17:23:18,150] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 9: [2023-04-29 17:23:18,150] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 9: [2023-04-29 17:23:18,150] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 9: [2023-04-29 17:23:18,150] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 9: [2023-04-29 17:23:18,150] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 26: [2023-04-29 17:23:18,150] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 9: [2023-04-29 17:23:18,150] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 20: [2023-04-29 17:23:18,150] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 20: [2023-04-29 17:23:18,150] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 24: [2023-04-29 17:23:18,150] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 8: [2023-04-29 17:23:18,150] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 8: [2023-04-29 17:23:18,150] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 26: [2023-04-29 17:23:18,151] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 26: [2023-04-29 17:23:18,151] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 26: [2023-04-29 17:23:18,151] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 13: [2023-04-29 17:23:18,151] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 16: [2023-04-29 17:23:18,152] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 16: [2023-04-29 17:23:18,152] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 11: [2023-04-29 17:23:18,153] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 11: [2023-04-29 17:23:18,153] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 11: [2023-04-29 17:23:18,153] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 9: [2023-04-29 17:23:18,155] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 9: [2023-04-29 17:23:18,155] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 9: [2023-04-29 17:23:18,155] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 9: [2023-04-29 17:23:18,155] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 13: [2023-04-29 17:23:18,155] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 13: [2023-04-29 17:23:18,155] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 20: [2023-04-29 17:23:18,155] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 9: [2023-04-29 17:23:18,155] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 9: [2023-04-29 17:23:18,155] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 9: [2023-04-29 17:23:18,155] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 8: [2023-04-29 17:23:18,155] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 8: [2023-04-29 17:23:18,155] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 9: [2023-04-29 17:23:18,156] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 8: [2023-04-29 17:23:18,156] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 25: [2023-04-29 17:23:18,156] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 25: [2023-04-29 17:23:18,156] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 25: [2023-04-29 17:23:18,156] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 8: [2023-04-29 17:23:18,156] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 8: [2023-04-29 17:23:18,156] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 18: [2023-04-29 17:23:18,156] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 18: [2023-04-29 17:23:18,156] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 18: [2023-04-29 17:23:18,156] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 18: [2023-04-29 17:23:18,156] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 18: [2023-04-29 17:23:18,156] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 28: [2023-04-29 17:23:18,157] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 28: [2023-04-29 17:23:18,157] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 28: [2023-04-29 17:23:18,157] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 28: [2023-04-29 17:23:18,157] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 28: [2023-04-29 17:23:18,157] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 25: [2023-04-29 17:23:18,157] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 25: [2023-04-29 17:23:18,158] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 25: [2023-04-29 17:23:18,158] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 23: [2023-04-29 17:23:18,160] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 10: [2023-04-29 17:23:18,162] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 10: [2023-04-29 17:23:18,162] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 10: [2023-04-29 17:23:18,162] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 10: [2023-04-29 17:23:18,162] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 17: [2023-04-29 17:23:18,164] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 20: [2023-04-29 17:23:18,165] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 20: [2023-04-29 17:23:18,165] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 23: [2023-04-29 17:23:18,165] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 1: [2023-04-29 17:23:18,165] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 1: [2023-04-29 17:23:18,166] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 1: [2023-04-29 17:23:18,166] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 17: [2023-04-29 17:23:18,166] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 11: [2023-04-29 17:23:18,167] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 11: [2023-04-29 17:23:18,167] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 18: [2023-04-29 17:23:18,167] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 18: [2023-04-29 17:23:18,167] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 23: [2023-04-29 17:23:18,168] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 17: [2023-04-29 17:23:18,168] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 10: [2023-04-29 17:23:18,168] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 10: [2023-04-29 17:23:18,168] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 10: [2023-04-29 17:23:18,168] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 10: [2023-04-29 17:23:18,168] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 3: [2023-04-29 17:23:18,169] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 1: [2023-04-29 17:23:18,169] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 18: [2023-04-29 17:23:18,169] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 15: [2023-04-29 17:23:18,169] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 15: [2023-04-29 17:23:18,169] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 15: [2023-04-29 17:23:18,169] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 15: [2023-04-29 17:23:18,169] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 17: [2023-04-29 17:23:18,170] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 3: [2023-04-29 17:23:18,170] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 3: [2023-04-29 17:23:18,170] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 3: [2023-04-29 17:23:18,170] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 20: [2023-04-29 17:23:18,170] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 20: [2023-04-29 17:23:18,170] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 20: [2023-04-29 17:23:18,170] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 3: [2023-04-29 17:23:18,170] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 3: [2023-04-29 17:23:18,170] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 3: [2023-04-29 17:23:18,170] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 23: [2023-04-29 17:23:18,170] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 23: [2023-04-29 17:23:18,170] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 14: [2023-04-29 17:23:18,170] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 3: [2023-04-29 17:23:18,170] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 23: [2023-04-29 17:23:18,170] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 28: [2023-04-29 17:23:18,170] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 17: [2023-04-29 17:23:18,171] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 6: [2023-04-29 17:23:18,172] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 28: [2023-04-29 17:23:18,172] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 6: [2023-04-29 17:23:18,172] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 6: [2023-04-29 17:23:18,173] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 28: [2023-04-29 17:23:18,173] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 29: [2023-04-29 17:23:18,173] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 11: [2023-04-29 17:23:18,173] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 11: [2023-04-29 17:23:18,173] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 11: [2023-04-29 17:23:18,173] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 17: [2023-04-29 17:23:18,173] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 6: [2023-04-29 17:23:18,173] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 29: [2023-04-29 17:23:18,173] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 15: [2023-04-29 17:23:18,173] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 15: [2023-04-29 17:23:18,173] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 15: [2023-04-29 17:23:18,173] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 15: [2023-04-29 17:23:18,173] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 14: [2023-04-29 17:23:18,173] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 6: [2023-04-29 17:23:18,174] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 14: [2023-04-29 17:23:18,174] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 29: [2023-04-29 17:23:18,174] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 30: [2023-04-29 17:23:18,174] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 8: [2023-04-29 17:23:18,175] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 29: [2023-04-29 17:23:18,175] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 24: [2023-04-29 17:23:18,175] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 29: [2023-04-29 17:23:18,175] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 30: [2023-04-29 17:23:18,175] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 30: [2023-04-29 17:23:18,175] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 30: [2023-04-29 17:23:18,175] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 30: [2023-04-29 17:23:18,175] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 30: [2023-04-29 17:23:18,175] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 30: [2023-04-29 17:23:18,175] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 20: [2023-04-29 17:23:18,175] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 30: [2023-04-29 17:23:18,175] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 11: [2023-04-29 17:23:18,176] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 20: [2023-04-29 17:23:18,176] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 5: [2023-04-29 17:23:18,176] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 5: [2023-04-29 17:23:18,176] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 11: [2023-04-29 17:23:18,178] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 11: [2023-04-29 17:23:18,178] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 1: [2023-04-29 17:23:18,178] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 27: [2023-04-29 17:23:18,179] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 27: [2023-04-29 17:23:18,179] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 1: [2023-04-29 17:23:18,179] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 1: [2023-04-29 17:23:18,179] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 1: [2023-04-29 17:23:18,180] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 27: [2023-04-29 17:23:18,180] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 27: [2023-04-29 17:23:18,180] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 27: [2023-04-29 17:23:18,180] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 27: [2023-04-29 17:23:18,180] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 27: [2023-04-29 17:23:18,180] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 27: [2023-04-29 17:23:18,180] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 24: [2023-04-29 17:23:18,182] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 24: [2023-04-29 17:23:18,182] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 24: [2023-04-29 17:23:18,182] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 20: [2023-04-29 17:23:18,184] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 30: [2023-04-29 17:23:18,184] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 14: [2023-04-29 17:23:18,184] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 14: [2023-04-29 17:23:18,185] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 14: [2023-04-29 17:23:18,185] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 14: [2023-04-29 17:23:18,185] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 14: [2023-04-29 17:23:18,185] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 8: [2023-04-29 17:23:18,185] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 8: [2023-04-29 17:23:18,185] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 30: [2023-04-29 17:23:18,186] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 30: [2023-04-29 17:23:18,186] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 30: [2023-04-29 17:23:18,186] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 30: [2023-04-29 17:23:18,186] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 30: [2023-04-29 17:23:18,186] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 30: [2023-04-29 17:23:18,187] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 24: [2023-04-29 17:23:18,186] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 24: [2023-04-29 17:23:18,186] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 24: [2023-04-29 17:23:18,186] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 24: [2023-04-29 17:23:18,187] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 30: [2023-04-29 17:23:18,187] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 27: [2023-04-29 17:23:18,189] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 10: [2023-04-29 17:23:18,189] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 27: [2023-04-29 17:23:18,190] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 27: [2023-04-29 17:23:18,190] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 27: [2023-04-29 17:23:18,191] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 27: [2023-04-29 17:23:18,192] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 10: [2023-04-29 17:23:18,192] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 20: [2023-04-29 17:23:18,192] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 10: [2023-04-29 17:23:18,192] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 18: [2023-04-29 17:23:18,192] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 10: [2023-04-29 17:23:18,192] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 11: [2023-04-29 17:23:18,193] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 8: [2023-04-29 17:23:18,193] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 27: [2023-04-29 17:23:18,193] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 27: [2023-04-29 17:23:18,194] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 20: [2023-04-29 17:23:18,194] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 27: [2023-04-29 17:23:18,194] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt... 11: [2023-04-29 17:23:18,195] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 25: [2023-04-29 17:23:18,197] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 25: [2023-04-29 17:23:18,197] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 8: [2023-04-29 17:23:18,197] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 18: [2023-04-29 17:23:18,197] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 5: [2023-04-29 17:23:18,199] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 5: [2023-04-29 17:23:18,199] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 18: [2023-04-29 17:23:18,199] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 18: [2023-04-29 17:23:18,199] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 8: [2023-04-29 17:23:18,199] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 10: [2023-04-29 17:23:18,200] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 14: [2023-04-29 17:23:18,200] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 14: [2023-04-29 17:23:18,200] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 18: [2023-04-29 17:23:18,200] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 8: [2023-04-29 17:23:18,201] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 20: [2023-04-29 17:23:18,201] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 10: [2023-04-29 17:23:18,201] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 8: [2023-04-29 17:23:18,202] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 26: [2023-04-29 17:23:18,202] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 20: [2023-04-29 17:23:18,202] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 10: [2023-04-29 17:23:18,203] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 20: [2023-04-29 17:23:18,203] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 26: [2023-04-29 17:23:18,203] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 26: [2023-04-29 17:23:18,203] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 28: [2023-04-29 17:23:18,204] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 11: [2023-04-29 17:23:18,205] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 10: [2023-04-29 17:23:18,205] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 28: [2023-04-29 17:23:18,205] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 3: [2023-04-29 17:23:18,205] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 28: [2023-04-29 17:23:18,205] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 5: [2023-04-29 17:23:18,205] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 5: [2023-04-29 17:23:18,205] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 5: [2023-04-29 17:23:18,205] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 5: [2023-04-29 17:23:18,205] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 11: [2023-04-29 17:23:18,205] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 11: [2023-04-29 17:23:18,206] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 28: [2023-04-29 17:23:18,206] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 5: [2023-04-29 17:23:18,206] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 5: [2023-04-29 17:23:18,206] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 15: [2023-04-29 17:23:18,207] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 3: [2023-04-29 17:23:18,206] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 3: [2023-04-29 17:23:18,207] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 28: [2023-04-29 17:23:18,208] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 3: [2023-04-29 17:23:18,208] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 15: [2023-04-29 17:23:18,209] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 3: [2023-04-29 17:23:18,209] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 3: [2023-04-29 17:23:18,209] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 15: [2023-04-29 17:23:18,209] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 15: [2023-04-29 17:23:18,212] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 9: [2023-04-29 17:23:18,212] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 9: [2023-04-29 17:23:18,212] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 9: [2023-04-29 17:23:18,212] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 9: [2023-04-29 17:23:18,212] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 26: [2023-04-29 17:23:18,213] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 26: [2023-04-29 17:23:18,214] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 26: [2023-04-29 17:23:18,214] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 26: [2023-04-29 17:23:18,214] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 26: [2023-04-29 17:23:18,214] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 9: [2023-04-29 17:23:18,216] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 9: [2023-04-29 17:23:18,216] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 9: [2023-04-29 17:23:18,216] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 9: [2023-04-29 17:23:18,216] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 15: [2023-04-29 17:23:18,217] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 15: [2023-04-29 17:23:18,219] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 15: [2023-04-29 17:23:18,220] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 15: [2023-04-29 17:23:18,220] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 24: [2023-04-29 17:23:18,220] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 24: [2023-04-29 17:23:18,221] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 14: [2023-04-29 17:23:18,221] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 14: [2023-04-29 17:23:18,222] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 25: [2023-04-29 17:23:18,222] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 25: [2023-04-29 17:23:18,222] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 25: [2023-04-29 17:23:18,223] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 25: [2023-04-29 17:23:18,223] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 14: [2023-04-29 17:23:18,225] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 25: [2023-04-29 17:23:18,225] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 25: [2023-04-29 17:23:18,226] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 25: [2023-04-29 17:23:18,226] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 25: [2023-04-29 17:23:18,226] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 24: [2023-04-29 17:23:18,226] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 24: [2023-04-29 17:23:18,226] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 24: [2023-04-29 17:23:18,226] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 14: [2023-04-29 17:23:18,227] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 26: [2023-04-29 17:23:18,228] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 14: [2023-04-29 17:23:18,229] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 24: [2023-04-29 17:23:18,231] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 24: [2023-04-29 17:23:18,231] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 26: [2023-04-29 17:23:18,239] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 26: [2023-04-29 17:23:18,239] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 9: [2023-04-29 17:23:18,240] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 5: [2023-04-29 17:23:18,241] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 5: [2023-04-29 17:23:18,242] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 5: [2023-04-29 17:23:18,243] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 5: [2023-04-29 17:23:18,243] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 9: [2023-04-29 17:23:18,243] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 9: [2023-04-29 17:23:18,243] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 5: [2023-04-29 17:23:18,245] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 27: [2023-04-29 17:23:18,245] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 9: [2023-04-29 17:23:18,246] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 9: [2023-04-29 17:23:18,246] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 9: [2023-04-29 17:23:18,246] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 9: [2023-04-29 17:23:18,246] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 9: [2023-04-29 17:23:18,246] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 5: [2023-04-29 17:23:18,246] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 27: [2023-04-29 17:23:18,248] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 26: [2023-04-29 17:23:18,248] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 26: [2023-04-29 17:23:18,250] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 26: [2023-04-29 17:23:18,252] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 26: [2023-04-29 17:23:18,252] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 30: [2023-04-29 17:23:18,254] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 26: [2023-04-29 17:23:18,254] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 27: [2023-04-29 17:23:18,257] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 27: [2023-04-29 17:23:18,257] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 27: [2023-04-29 17:23:18,257] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 25: [2023-04-29 17:23:18,258] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 27: [2023-04-29 17:23:18,259] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 27: [2023-04-29 17:23:18,259] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 27: [2023-04-29 17:23:18,259] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 25: [2023-04-29 17:23:18,259] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 25: [2023-04-29 17:23:18,263] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 25: [2023-04-29 17:23:18,264] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 25: [2023-04-29 17:23:18,269] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 25: [2023-04-29 17:23:18,271] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 30: [2023-04-29 17:23:18,277] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 30: [2023-04-29 17:23:18,279] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 30: [2023-04-29 17:23:18,279] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 30: [2023-04-29 17:23:18,279] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 30: [2023-04-29 17:23:18,279] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 30: [2023-04-29 17:23:18,279] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 30: [2023-04-29 17:23:18,279] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 30: [2023-04-29 17:23:18,279] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_03-model_00-model_states.pt. 27: [2023-04-29 17:23:18,282] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 27: [2023-04-29 17:23:18,287] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 27: [2023-04-29 17:23:18,299] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 27: [2023-04-29 17:23:18,299] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 27: [2023-04-29 17:23:18,301] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 27: [2023-04-29 17:23:18,304] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 27: [2023-04-29 17:23:18,304] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 27: [2023-04-29 17:23:18,304] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 19: [2023-04-29 17:23:18,309] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 19: [2023-04-29 17:23:18,309] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 19: [2023-04-29 17:23:18,309] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 19: [2023-04-29 17:23:18,309] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 19: [2023-04-29 17:23:18,310] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 19: [2023-04-29 17:23:18,310] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 19: [2023-04-29 17:23:18,310] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 19: [2023-04-29 17:23:18,310] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 21: [2023-04-29 17:23:18,313] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 21: [2023-04-29 17:23:18,313] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 21: [2023-04-29 17:23:18,313] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 21: [2023-04-29 17:23:18,313] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 21: [2023-04-29 17:23:18,313] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 21: [2023-04-29 17:23:18,313] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 21: [2023-04-29 17:23:18,313] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 21: [2023-04-29 17:23:18,313] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 19: [2023-04-29 17:23:18,314] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 19: [2023-04-29 17:23:18,314] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 19: [2023-04-29 17:23:18,314] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 30: [2023-04-29 17:23:18,316] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 30: [2023-04-29 17:23:18,317] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 19: [2023-04-29 17:23:18,318] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 21: [2023-04-29 17:23:18,318] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 21: [2023-04-29 17:23:18,318] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 19: [2023-04-29 17:23:18,318] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 30: [2023-04-29 17:23:18,318] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 21: [2023-04-29 17:23:18,318] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 19: [2023-04-29 17:23:18,318] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 21: [2023-04-29 17:23:18,319] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 30: [2023-04-29 17:23:18,319] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 19: [2023-04-29 17:23:18,319] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 30: [2023-04-29 17:23:18,319] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 21: [2023-04-29 17:23:18,319] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 21: [2023-04-29 17:23:18,319] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 19: [2023-04-29 17:23:18,319] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 21: [2023-04-29 17:23:18,319] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 21: [2023-04-29 17:23:18,320] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 30: [2023-04-29 17:23:18,321] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 30: [2023-04-29 17:23:18,321] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 19: [2023-04-29 17:23:18,368] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 19: [2023-04-29 17:23:18,368] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 19: [2023-04-29 17:23:18,368] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 21: [2023-04-29 17:23:18,372] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 21: [2023-04-29 17:23:18,372] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 21: [2023-04-29 17:23:18,372] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 19: [2023-04-29 17:23:18,380] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 19: [2023-04-29 17:23:18,385] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 19: [2023-04-29 17:23:18,385] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 19: [2023-04-29 17:23:18,385] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 19: [2023-04-29 17:23:18,385] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 21: [2023-04-29 17:23:18,386] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 21: [2023-04-29 17:23:18,386] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 21: [2023-04-29 17:23:18,386] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 21: [2023-04-29 17:23:18,386] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 21: [2023-04-29 17:23:18,386] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 19: [2023-04-29 17:23:18,388] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 19: [2023-04-29 17:23:18,390] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 19: [2023-04-29 17:23:18,390] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 21: [2023-04-29 17:23:18,397] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 21: [2023-04-29 17:23:18,397] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 21: [2023-04-29 17:23:18,397] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 19: [2023-04-29 17:23:18,407] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 19: [2023-04-29 17:23:18,410] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 19: [2023-04-29 17:23:18,411] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 19: [2023-04-29 17:23:18,411] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 21: [2023-04-29 17:23:18,412] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 19: [2023-04-29 17:23:18,413] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 21: [2023-04-29 17:23:18,413] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 21: [2023-04-29 17:23:18,414] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 21: [2023-04-29 17:23:18,415] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 21: [2023-04-29 17:23:18,415] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 22: [2023-04-29 17:23:18,433] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 22: [2023-04-29 17:23:18,433] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 22: [2023-04-29 17:23:18,434] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 22: [2023-04-29 17:23:18,434] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 22: [2023-04-29 17:23:18,435] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 22: [2023-04-29 17:23:18,435] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 22: [2023-04-29 17:23:18,435] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 22: [2023-04-29 17:23:18,435] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 22: [2023-04-29 17:23:18,438] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 22: [2023-04-29 17:23:18,439] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 22: [2023-04-29 17:23:18,445] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 22: [2023-04-29 17:23:18,446] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 22: [2023-04-29 17:23:18,447] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 22: [2023-04-29 17:23:18,447] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 22: [2023-04-29 17:23:18,448] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 22: [2023-04-29 17:23:18,448] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 0: [2023-04-29 17:23:18,449] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 0: [2023-04-29 17:23:18,449] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 0: [2023-04-29 17:23:18,449] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 31: [2023-04-29 17:23:18,448] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 31: [2023-04-29 17:23:18,448] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 31: [2023-04-29 17:23:18,448] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 31: [2023-04-29 17:23:18,449] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 31: [2023-04-29 17:23:18,449] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 31: [2023-04-29 17:23:18,449] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 31: [2023-04-29 17:23:18,449] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 0: [2023-04-29 17:23:18,449] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 0: [2023-04-29 17:23:18,449] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 0: [2023-04-29 17:23:18,449] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 0: [2023-04-29 17:23:18,449] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 31: [2023-04-29 17:23:18,449] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 0: [2023-04-29 17:23:18,449] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 7: [2023-04-29 17:23:18,450] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 7: [2023-04-29 17:23:18,451] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 7: [2023-04-29 17:23:18,451] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 7: [2023-04-29 17:23:18,451] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 7: [2023-04-29 17:23:18,451] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 7: [2023-04-29 17:23:18,451] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 7: [2023-04-29 17:23:18,451] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 7: [2023-04-29 17:23:18,452] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 31: [2023-04-29 17:23:18,453] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 31: [2023-04-29 17:23:18,453] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 31: [2023-04-29 17:23:18,453] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 31: [2023-04-29 17:23:18,455] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 31: [2023-04-29 17:23:18,455] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 31: [2023-04-29 17:23:18,455] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 31: [2023-04-29 17:23:18,456] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 7: [2023-04-29 17:23:18,455] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 7: [2023-04-29 17:23:18,455] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 31: [2023-04-29 17:23:18,456] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 7: [2023-04-29 17:23:18,456] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 7: [2023-04-29 17:23:18,457] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 7: [2023-04-29 17:23:18,457] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 7: [2023-04-29 17:23:18,458] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 7: [2023-04-29 17:23:18,458] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 7: [2023-04-29 17:23:18,458] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 0: [2023-04-29 17:23:18,462] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 0: [2023-04-29 17:23:18,463] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 0: [2023-04-29 17:23:18,464] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 0: [2023-04-29 17:23:18,464] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 0: [2023-04-29 17:23:18,464] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 0: [2023-04-29 17:23:18,465] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 0: [2023-04-29 17:23:18,466] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 0: [2023-04-29 17:23:18,466] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 22: [2023-04-29 17:23:18,490] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 22: [2023-04-29 17:23:18,490] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 2: [2023-04-29 17:23:18,495] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 2: [2023-04-29 17:23:18,495] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 2: [2023-04-29 17:23:18,495] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 2: [2023-04-29 17:23:18,496] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 2: [2023-04-29 17:23:18,496] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 2: [2023-04-29 17:23:18,496] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 2: [2023-04-29 17:23:18,496] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 2: [2023-04-29 17:23:18,496] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 2: [2023-04-29 17:23:18,500] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 2: [2023-04-29 17:23:18,500] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 2: [2023-04-29 17:23:18,500] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 2: [2023-04-29 17:23:18,504] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 2: [2023-04-29 17:23:18,505] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 2: [2023-04-29 17:23:18,506] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 2: [2023-04-29 17:23:18,506] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 2: [2023-04-29 17:23:18,506] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 31: [2023-04-29 17:23:18,506] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 31: [2023-04-29 17:23:18,506] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 31: [2023-04-29 17:23:18,506] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 7: [2023-04-29 17:23:18,508] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 7: [2023-04-29 17:23:18,508] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 7: [2023-04-29 17:23:18,508] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 22: [2023-04-29 17:23:18,514] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 22: [2023-04-29 17:23:18,514] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 22: [2023-04-29 17:23:18,514] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 22: [2023-04-29 17:23:18,515] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 22: [2023-04-29 17:23:18,515] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 22: [2023-04-29 17:23:18,518] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 22: [2023-04-29 17:23:18,518] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 22: [2023-04-29 17:23:18,518] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 31: [2023-04-29 17:23:18,521] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 31: [2023-04-29 17:23:18,521] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 31: [2023-04-29 17:23:18,522] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 31: [2023-04-29 17:23:18,521] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 31: [2023-04-29 17:23:18,522] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 7: [2023-04-29 17:23:18,523] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 7: [2023-04-29 17:23:18,523] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 7: [2023-04-29 17:23:18,523] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 7: [2023-04-29 17:23:18,523] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 7: [2023-04-29 17:23:18,523] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 31: [2023-04-29 17:23:18,527] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 31: [2023-04-29 17:23:18,528] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 31: [2023-04-29 17:23:18,528] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 7: [2023-04-29 17:23:18,531] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 7: [2023-04-29 17:23:18,531] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 7: [2023-04-29 17:23:18,531] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 13: [2023-04-29 17:23:18,542] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 0: [2023-04-29 17:23:18,542] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 0: [2023-04-29 17:23:18,542] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 0: [2023-04-29 17:23:18,543] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 13: [2023-04-29 17:23:18,543] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 13: [2023-04-29 17:23:18,543] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 13: [2023-04-29 17:23:18,543] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 13: [2023-04-29 17:23:18,543] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 13: [2023-04-29 17:23:18,543] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 13: [2023-04-29 17:23:18,543] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 13: [2023-04-29 17:23:18,543] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 22: [2023-04-29 17:23:18,543] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 22: [2023-04-29 17:23:18,545] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 31: [2023-04-29 17:23:18,547] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 13: [2023-04-29 17:23:18,547] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 31: [2023-04-29 17:23:18,548] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 13: [2023-04-29 17:23:18,548] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 7: [2023-04-29 17:23:18,549] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 22: [2023-04-29 17:23:18,549] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 31: [2023-04-29 17:23:18,550] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 31: [2023-04-29 17:23:18,550] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 31: [2023-04-29 17:23:18,551] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 0: [2023-04-29 17:23:18,552] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 0: [2023-04-29 17:23:18,552] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 0: [2023-04-29 17:23:18,552] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 0: [2023-04-29 17:23:18,552] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 13: [2023-04-29 17:23:18,553] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 22: [2023-04-29 17:23:18,553] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 7: [2023-04-29 17:23:18,553] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 7: [2023-04-29 17:23:18,553] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 13: [2023-04-29 17:23:18,553] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 13: [2023-04-29 17:23:18,554] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 2: [2023-04-29 17:23:18,554] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 2: [2023-04-29 17:23:18,554] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 2: [2023-04-29 17:23:18,554] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 13: [2023-04-29 17:23:18,554] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 22: [2023-04-29 17:23:18,554] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 13: [2023-04-29 17:23:18,555] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 13: [2023-04-29 17:23:18,555] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 22: [2023-04-29 17:23:18,556] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 0: [2023-04-29 17:23:18,557] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 7: [2023-04-29 17:23:18,557] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 7: [2023-04-29 17:23:18,557] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 2: [2023-04-29 17:23:18,567] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 2: [2023-04-29 17:23:18,567] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 0: [2023-04-29 17:23:18,570] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 4: [2023-04-29 17:23:18,570] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 0: [2023-04-29 17:23:18,570] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 2: [2023-04-29 17:23:18,571] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 2: [2023-04-29 17:23:18,571] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 2: [2023-04-29 17:23:18,571] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 4: [2023-04-29 17:23:18,571] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 0: [2023-04-29 17:23:18,572] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 6: [2023-04-29 17:23:18,572] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 6: [2023-04-29 17:23:18,572] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 6: [2023-04-29 17:23:18,572] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 6: [2023-04-29 17:23:18,573] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 6: [2023-04-29 17:23:18,573] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 6: [2023-04-29 17:23:18,573] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 6: [2023-04-29 17:23:18,573] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 6: [2023-04-29 17:23:18,573] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 2: [2023-04-29 17:23:18,575] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 4: [2023-04-29 17:23:18,575] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 4: [2023-04-29 17:23:18,576] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 4: [2023-04-29 17:23:18,576] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 4: [2023-04-29 17:23:18,576] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 4: [2023-04-29 17:23:18,576] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 4: [2023-04-29 17:23:18,576] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 4: [2023-04-29 17:23:18,576] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 6: [2023-04-29 17:23:18,576] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 4: [2023-04-29 17:23:18,577] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 6: [2023-04-29 17:23:18,577] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 2: [2023-04-29 17:23:18,577] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 2: [2023-04-29 17:23:18,577] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 29: [2023-04-29 17:23:18,580] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 4: [2023-04-29 17:23:18,580] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 29: [2023-04-29 17:23:18,581] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 29: [2023-04-29 17:23:18,581] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 29: [2023-04-29 17:23:18,581] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 29: [2023-04-29 17:23:18,581] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 29: [2023-04-29 17:23:18,581] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 29: [2023-04-29 17:23:18,581] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 6: [2023-04-29 17:23:18,581] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 29: [2023-04-29 17:23:18,581] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 6: [2023-04-29 17:23:18,581] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 6: [2023-04-29 17:23:18,582] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 6: [2023-04-29 17:23:18,582] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 6: [2023-04-29 17:23:18,582] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 4: [2023-04-29 17:23:18,584] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 4: [2023-04-29 17:23:18,585] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 4: [2023-04-29 17:23:18,586] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 0: [2023-04-29 17:23:18,586] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 0: [2023-04-29 17:23:18,587] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 4: [2023-04-29 17:23:18,587] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 0: [2023-04-29 17:23:18,587] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 4: [2023-04-29 17:23:18,587] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 0: [2023-04-29 17:23:18,588] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 0: [2023-04-29 17:23:18,588] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 6: [2023-04-29 17:23:18,583] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 29: [2023-04-29 17:23:18,584] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 2: [2023-04-29 17:23:18,589] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 2: [2023-04-29 17:23:18,590] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 29: [2023-04-29 17:23:18,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 29: [2023-04-29 17:23:18,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 29: [2023-04-29 17:23:18,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 29: [2023-04-29 17:23:18,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 29: [2023-04-29 17:23:18,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 29: [2023-04-29 17:23:18,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 29: [2023-04-29 17:23:18,595] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 12: [2023-04-29 17:23:18,595] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 12: [2023-04-29 17:23:18,596] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 12: [2023-04-29 17:23:18,596] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 12: [2023-04-29 17:23:18,596] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 12: [2023-04-29 17:23:18,596] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 12: [2023-04-29 17:23:18,596] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 12: [2023-04-29 17:23:18,596] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 12: [2023-04-29 17:23:18,596] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 2: [2023-04-29 17:23:18,598] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 13: [2023-04-29 17:23:18,599] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 2: [2023-04-29 17:23:18,600] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 2: [2023-04-29 17:23:18,601] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 13: [2023-04-29 17:23:18,601] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 12: [2023-04-29 17:23:18,602] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 12: [2023-04-29 17:23:18,603] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 12: [2023-04-29 17:23:18,603] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 3: [2023-04-29 17:23:18,605] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 3: [2023-04-29 17:23:18,605] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 12: [2023-04-29 17:23:18,605] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 3: [2023-04-29 17:23:18,605] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 3: [2023-04-29 17:23:18,605] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 3: [2023-04-29 17:23:18,605] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 3: [2023-04-29 17:23:18,605] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 3: [2023-04-29 17:23:18,605] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 12: [2023-04-29 17:23:18,605] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 12: [2023-04-29 17:23:18,606] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 3: [2023-04-29 17:23:18,606] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 12: [2023-04-29 17:23:18,606] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 12: [2023-04-29 17:23:18,607] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 3: [2023-04-29 17:23:18,609] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 3: [2023-04-29 17:23:18,609] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 3: [2023-04-29 17:23:18,612] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 3: [2023-04-29 17:23:18,613] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 3: [2023-04-29 17:23:18,613] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 3: [2023-04-29 17:23:18,613] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 3: [2023-04-29 17:23:18,613] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 3: [2023-04-29 17:23:18,613] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 17: [2023-04-29 17:23:18,616] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 17: [2023-04-29 17:23:18,616] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 17: [2023-04-29 17:23:18,616] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 17: [2023-04-29 17:23:18,616] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 17: [2023-04-29 17:23:18,616] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 17: [2023-04-29 17:23:18,616] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 17: [2023-04-29 17:23:18,617] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 17: [2023-04-29 17:23:18,617] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 13: [2023-04-29 17:23:18,620] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 17: [2023-04-29 17:23:18,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 13: [2023-04-29 17:23:18,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 13: [2023-04-29 17:23:18,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 17: [2023-04-29 17:23:18,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 13: [2023-04-29 17:23:18,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 13: [2023-04-29 17:23:18,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 13: [2023-04-29 17:23:18,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 13: [2023-04-29 17:23:18,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 13: [2023-04-29 17:23:18,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 4: [2023-04-29 17:23:18,626] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 17: [2023-04-29 17:23:18,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 17: [2023-04-29 17:23:18,627] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 17: [2023-04-29 17:23:18,627] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 17: [2023-04-29 17:23:18,628] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 17: [2023-04-29 17:23:18,628] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 17: [2023-04-29 17:23:18,629] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 6: [2023-04-29 17:23:18,629] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 6: [2023-04-29 17:23:18,629] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 4: [2023-04-29 17:23:18,630] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 29: [2023-04-29 17:23:18,632] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 14: [2023-04-29 17:23:18,633] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 14: [2023-04-29 17:23:18,633] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 14: [2023-04-29 17:23:18,634] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 14: [2023-04-29 17:23:18,634] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 14: [2023-04-29 17:23:18,634] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 14: [2023-04-29 17:23:18,634] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 14: [2023-04-29 17:23:18,634] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 14: [2023-04-29 17:23:18,634] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 14: [2023-04-29 17:23:18,638] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 14: [2023-04-29 17:23:18,643] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 14: [2023-04-29 17:23:18,644] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 14: [2023-04-29 17:23:18,645] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 14: [2023-04-29 17:23:18,645] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 14: [2023-04-29 17:23:18,646] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 14: [2023-04-29 17:23:18,646] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 4: [2023-04-29 17:23:18,646] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 14: [2023-04-29 17:23:18,647] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 6: [2023-04-29 17:23:18,648] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 4: [2023-04-29 17:23:18,650] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 23: [2023-04-29 17:23:18,651] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 23: [2023-04-29 17:23:18,651] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 29: [2023-04-29 17:23:18,651] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 6: [2023-04-29 17:23:18,652] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 13: [2023-04-29 17:23:18,652] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 23: [2023-04-29 17:23:18,652] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 4: [2023-04-29 17:23:18,653] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 13: [2023-04-29 17:23:18,653] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 6: [2023-04-29 17:23:18,653] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 23: [2023-04-29 17:23:18,653] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 23: [2023-04-29 17:23:18,653] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 23: [2023-04-29 17:23:18,653] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 23: [2023-04-29 17:23:18,653] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 23: [2023-04-29 17:23:18,653] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 13: [2023-04-29 17:23:18,654] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 4: [2023-04-29 17:23:18,656] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 4: [2023-04-29 17:23:18,656] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 12: [2023-04-29 17:23:18,657] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 13: [2023-04-29 17:23:18,657] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 6: [2023-04-29 17:23:18,657] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 6: [2023-04-29 17:23:18,657] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 6: [2023-04-29 17:23:18,657] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 6: [2023-04-29 17:23:18,657] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 6: [2023-04-29 17:23:18,657] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 12: [2023-04-29 17:23:18,658] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 12: [2023-04-29 17:23:18,658] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 23: [2023-04-29 17:23:18,658] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 23: [2023-04-29 17:23:18,659] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 23: [2023-04-29 17:23:18,659] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 3: [2023-04-29 17:23:18,659] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 3: [2023-04-29 17:23:18,659] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 13: [2023-04-29 17:23:18,660] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 23: [2023-04-29 17:23:18,660] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 13: [2023-04-29 17:23:18,660] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 23: [2023-04-29 17:23:18,661] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 4: [2023-04-29 17:23:18,661] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 23: [2023-04-29 17:23:18,663] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 23: [2023-04-29 17:23:18,663] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 4: [2023-04-29 17:23:18,663] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 23: [2023-04-29 17:23:18,663] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 18: [2023-04-29 17:23:18,664] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 18: [2023-04-29 17:23:18,664] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 18: [2023-04-29 17:23:18,664] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 18: [2023-04-29 17:23:18,664] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 18: [2023-04-29 17:23:18,664] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 18: [2023-04-29 17:23:18,664] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 18: [2023-04-29 17:23:18,664] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 18: [2023-04-29 17:23:18,664] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 26: [2023-04-29 17:23:18,665] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 26: [2023-04-29 17:23:18,665] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 26: [2023-04-29 17:23:18,665] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 26: [2023-04-29 17:23:18,665] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 26: [2023-04-29 17:23:18,665] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 26: [2023-04-29 17:23:18,665] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 26: [2023-04-29 17:23:18,665] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 26: [2023-04-29 17:23:18,666] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 4: [2023-04-29 17:23:18,666] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 29: [2023-04-29 17:23:18,666] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 29: [2023-04-29 17:23:18,666] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 12: [2023-04-29 17:23:18,670] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 16: [2023-04-29 17:23:18,670] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 16: [2023-04-29 17:23:18,670] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 16: [2023-04-29 17:23:18,670] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 16: [2023-04-29 17:23:18,671] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 16: [2023-04-29 17:23:18,671] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 16: [2023-04-29 17:23:18,671] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 16: [2023-04-29 17:23:18,671] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 26: [2023-04-29 17:23:18,671] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 16: [2023-04-29 17:23:18,671] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 26: [2023-04-29 17:23:18,672] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 29: [2023-04-29 17:23:18,672] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 29: [2023-04-29 17:23:18,672] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 29: [2023-04-29 17:23:18,672] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 29: [2023-04-29 17:23:18,672] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 29: [2023-04-29 17:23:18,672] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 6: [2023-04-29 17:23:18,672] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 26: [2023-04-29 17:23:18,673] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 26: [2023-04-29 17:23:18,673] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 20: [2023-04-29 17:23:18,673] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 20: [2023-04-29 17:23:18,673] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 10: [2023-04-29 17:23:18,673] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 10: [2023-04-29 17:23:18,673] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 10: [2023-04-29 17:23:18,673] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 10: [2023-04-29 17:23:18,673] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 10: [2023-04-29 17:23:18,673] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 10: [2023-04-29 17:23:18,673] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 10: [2023-04-29 17:23:18,673] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 26: [2023-04-29 17:23:18,673] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 10: [2023-04-29 17:23:18,674] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 17: [2023-04-29 17:23:18,674] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 20: [2023-04-29 17:23:18,674] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 12: [2023-04-29 17:23:18,674] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 12: [2023-04-29 17:23:18,674] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 12: [2023-04-29 17:23:18,674] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 12: [2023-04-29 17:23:18,674] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 26: [2023-04-29 17:23:18,674] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 26: [2023-04-29 17:23:18,674] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 20: [2023-04-29 17:23:18,674] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 20: [2023-04-29 17:23:18,674] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 26: [2023-04-29 17:23:18,674] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 20: [2023-04-29 17:23:18,675] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 20: [2023-04-29 17:23:18,675] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 20: [2023-04-29 17:23:18,675] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 17: [2023-04-29 17:23:18,675] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 18: [2023-04-29 17:23:18,676] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 4: [2023-04-29 17:23:18,677] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 18: [2023-04-29 17:23:18,677] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 16: [2023-04-29 17:23:18,676] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 16: [2023-04-29 17:23:18,677] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 16: [2023-04-29 17:23:18,677] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 18: [2023-04-29 17:23:18,677] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 16: [2023-04-29 17:23:18,677] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 16: [2023-04-29 17:23:18,677] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 16: [2023-04-29 17:23:18,678] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 16: [2023-04-29 17:23:18,678] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 16: [2023-04-29 17:23:18,678] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 18: [2023-04-29 17:23:18,678] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 18: [2023-04-29 17:23:18,678] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 24: [2023-04-29 17:23:18,678] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 18: [2023-04-29 17:23:18,678] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 18: [2023-04-29 17:23:18,679] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 20: [2023-04-29 17:23:18,679] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 20: [2023-04-29 17:23:18,679] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 18: [2023-04-29 17:23:18,679] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 10: [2023-04-29 17:23:18,679] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 10: [2023-04-29 17:23:18,679] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 10: [2023-04-29 17:23:18,679] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 24: [2023-04-29 17:23:18,679] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 24: [2023-04-29 17:23:18,679] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 24: [2023-04-29 17:23:18,679] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 10: [2023-04-29 17:23:18,679] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 24: [2023-04-29 17:23:18,679] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 24: [2023-04-29 17:23:18,679] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 24: [2023-04-29 17:23:18,679] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 3: [2023-04-29 17:23:18,679] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 24: [2023-04-29 17:23:18,679] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 20: [2023-04-29 17:23:18,680] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 12: [2023-04-29 17:23:18,680] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 3: [2023-04-29 17:23:18,681] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 8: [2023-04-29 17:23:18,681] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 8: [2023-04-29 17:23:18,681] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 8: [2023-04-29 17:23:18,681] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 8: [2023-04-29 17:23:18,681] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 8: [2023-04-29 17:23:18,681] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 8: [2023-04-29 17:23:18,681] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 8: [2023-04-29 17:23:18,681] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 8: [2023-04-29 17:23:18,681] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 10: [2023-04-29 17:23:18,681] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 10: [2023-04-29 17:23:18,682] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 12: [2023-04-29 17:23:18,682] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 12: [2023-04-29 17:23:18,682] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 11: [2023-04-29 17:23:18,683] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 11: [2023-04-29 17:23:18,683] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 10: [2023-04-29 17:23:18,683] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 24: [2023-04-29 17:23:18,683] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 3: [2023-04-29 17:23:18,683] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 3: [2023-04-29 17:23:18,683] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 3: [2023-04-29 17:23:18,683] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 3: [2023-04-29 17:23:18,683] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 3: [2023-04-29 17:23:18,683] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 3: [2023-04-29 17:23:18,683] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 11: [2023-04-29 17:23:18,684] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 11: [2023-04-29 17:23:18,684] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 11: [2023-04-29 17:23:18,684] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 11: [2023-04-29 17:23:18,684] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 20: [2023-04-29 17:23:18,684] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 28: [2023-04-29 17:23:18,684] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 10: [2023-04-29 17:23:18,684] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 28: [2023-04-29 17:23:18,684] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 11: [2023-04-29 17:23:18,684] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 28: [2023-04-29 17:23:18,684] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 20: [2023-04-29 17:23:18,684] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 11: [2023-04-29 17:23:18,684] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 28: [2023-04-29 17:23:18,684] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 28: [2023-04-29 17:23:18,684] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 28: [2023-04-29 17:23:18,684] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 28: [2023-04-29 17:23:18,684] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 30: [2023-04-29 17:23:18,683] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 30: [2023-04-29 17:23:18,684] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 30: [2023-04-29 17:23:18,684] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 30: [2023-04-29 17:23:18,684] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 30: [2023-04-29 17:23:18,684] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 30: [2023-04-29 17:23:18,684] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 30: [2023-04-29 17:23:18,684] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 28: [2023-04-29 17:23:18,684] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 19: [2023-04-29 17:23:18,684] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 19: [2023-04-29 17:23:18,684] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 19: [2023-04-29 17:23:18,684] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 30: [2023-04-29 17:23:18,684] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 19: [2023-04-29 17:23:18,685] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 20: [2023-04-29 17:23:18,685] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 19: [2023-04-29 17:23:18,685] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 19: [2023-04-29 17:23:18,685] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 19: [2023-04-29 17:23:18,685] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 19: [2023-04-29 17:23:18,685] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 20: [2023-04-29 17:23:18,685] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 20: [2023-04-29 17:23:18,686] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 1: [2023-04-29 17:23:18,686] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 1: [2023-04-29 17:23:18,686] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 1: [2023-04-29 17:23:18,686] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 1: [2023-04-29 17:23:18,686] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 1: [2023-04-29 17:23:18,686] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 1: [2023-04-29 17:23:18,686] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 1: [2023-04-29 17:23:18,686] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 1: [2023-04-29 17:23:18,687] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 6: [2023-04-29 17:23:18,687] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 6: [2023-04-29 17:23:18,688] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 4: [2023-04-29 17:23:18,688] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 27: [2023-04-29 17:23:18,688] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 27: [2023-04-29 17:23:18,688] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 4: [2023-04-29 17:23:18,688] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 6: [2023-04-29 17:23:18,688] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 8: [2023-04-29 17:23:18,688] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 27: [2023-04-29 17:23:18,689] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 27: [2023-04-29 17:23:18,689] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 27: [2023-04-29 17:23:18,689] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 27: [2023-04-29 17:23:18,689] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 27: [2023-04-29 17:23:18,689] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 15: [2023-04-29 17:23:18,688] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 15: [2023-04-29 17:23:18,688] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 15: [2023-04-29 17:23:18,688] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 15: [2023-04-29 17:23:18,688] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 15: [2023-04-29 17:23:18,688] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 15: [2023-04-29 17:23:18,688] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 15: [2023-04-29 17:23:18,688] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 11: [2023-04-29 17:23:18,688] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 11: [2023-04-29 17:23:18,688] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 11: [2023-04-29 17:23:18,689] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 6: [2023-04-29 17:23:18,689] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 15: [2023-04-29 17:23:18,689] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 27: [2023-04-29 17:23:18,689] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 8: [2023-04-29 17:23:18,689] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 19: [2023-04-29 17:23:18,689] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 19: [2023-04-29 17:23:18,689] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 19: [2023-04-29 17:23:18,689] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 8: [2023-04-29 17:23:18,690] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 14: [2023-04-29 17:23:18,690] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 6: [2023-04-29 17:23:18,690] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 8: [2023-04-29 17:23:18,691] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 8: [2023-04-29 17:23:18,691] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 24: [2023-04-29 17:23:18,690] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 24: [2023-04-29 17:23:18,691] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 24: [2023-04-29 17:23:18,691] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 4: [2023-04-29 17:23:18,691] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 24: [2023-04-29 17:23:18,691] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 11: [2023-04-29 17:23:18,691] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 11: [2023-04-29 17:23:18,692] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 1: [2023-04-29 17:23:18,691] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 1: [2023-04-29 17:23:18,691] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 1: [2023-04-29 17:23:18,692] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 1: [2023-04-29 17:23:18,692] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 24: [2023-04-29 17:23:18,692] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 11: [2023-04-29 17:23:18,692] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 4: [2023-04-29 17:23:18,692] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 29: [2023-04-29 17:23:18,693] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 8: [2023-04-29 17:23:18,692] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 8: [2023-04-29 17:23:18,693] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 24: [2023-04-29 17:23:18,693] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 24: [2023-04-29 17:23:18,693] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 1: [2023-04-29 17:23:18,693] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 8: [2023-04-29 17:23:18,693] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 11: [2023-04-29 17:23:18,693] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 19: [2023-04-29 17:23:18,693] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 19: [2023-04-29 17:23:18,693] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 11: [2023-04-29 17:23:18,694] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 1: [2023-04-29 17:23:18,694] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 27: [2023-04-29 17:23:18,694] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 1: [2023-04-29 17:23:18,694] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 1: [2023-04-29 17:23:18,694] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 19: [2023-04-29 17:23:18,694] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 19: [2023-04-29 17:23:18,694] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 27: [2023-04-29 17:23:18,695] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 19: [2023-04-29 17:23:18,695] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 30: [2023-04-29 17:23:18,695] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 17: [2023-04-29 17:23:18,695] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 17: [2023-04-29 17:23:18,695] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 30: [2023-04-29 17:23:18,695] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 12: [2023-04-29 17:23:18,695] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 29: [2023-04-29 17:23:18,695] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 30: [2023-04-29 17:23:18,696] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 30: [2023-04-29 17:23:18,696] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 30: [2023-04-29 17:23:18,696] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 30: [2023-04-29 17:23:18,697] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 30: [2023-04-29 17:23:18,697] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 4: [2023-04-29 17:23:18,697] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 17: [2023-04-29 17:23:18,697] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 30: [2023-04-29 17:23:18,698] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 28: [2023-04-29 17:23:18,698] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 28: [2023-04-29 17:23:18,698] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 28: [2023-04-29 17:23:18,699] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 28: [2023-04-29 17:23:18,699] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 17: [2023-04-29 17:23:18,699] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 28: [2023-04-29 17:23:18,700] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 17: [2023-04-29 17:23:18,700] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 17: [2023-04-29 17:23:18,700] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 17: [2023-04-29 17:23:18,700] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 17: [2023-04-29 17:23:18,700] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 28: [2023-04-29 17:23:18,700] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 27: [2023-04-29 17:23:18,700] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 28: [2023-04-29 17:23:18,701] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 15: [2023-04-29 17:23:18,701] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 15: [2023-04-29 17:23:18,701] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 15: [2023-04-29 17:23:18,701] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 28: [2023-04-29 17:23:18,702] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 27: [2023-04-29 17:23:18,702] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 15: [2023-04-29 17:23:18,702] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 27: [2023-04-29 17:23:18,702] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 27: [2023-04-29 17:23:18,703] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 27: [2023-04-29 17:23:18,703] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 15: [2023-04-29 17:23:18,703] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 27: [2023-04-29 17:23:18,703] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 15: [2023-04-29 17:23:18,703] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 15: [2023-04-29 17:23:18,703] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 12: [2023-04-29 17:23:18,704] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 15: [2023-04-29 17:23:18,704] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 12: [2023-04-29 17:23:18,704] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 12: [2023-04-29 17:23:18,704] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 12: [2023-04-29 17:23:18,704] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 29: [2023-04-29 17:23:18,706] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 29: [2023-04-29 17:23:18,706] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 29: [2023-04-29 17:23:18,707] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 14: [2023-04-29 17:23:18,709] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 21: [2023-04-29 17:23:18,710] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 21: [2023-04-29 17:23:18,710] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 21: [2023-04-29 17:23:18,710] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 21: [2023-04-29 17:23:18,710] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 21: [2023-04-29 17:23:18,710] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 21: [2023-04-29 17:23:18,710] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 21: [2023-04-29 17:23:18,710] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 23: [2023-04-29 17:23:18,710] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 21: [2023-04-29 17:23:18,710] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 29: [2023-04-29 17:23:18,710] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 29: [2023-04-29 17:23:18,710] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 3: [2023-04-29 17:23:18,711] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 23: [2023-04-29 17:23:18,712] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 3: [2023-04-29 17:23:18,714] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 3: [2023-04-29 17:23:18,714] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 21: [2023-04-29 17:23:18,714] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 21: [2023-04-29 17:23:18,715] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 21: [2023-04-29 17:23:18,715] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 3: [2023-04-29 17:23:18,715] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 14: [2023-04-29 17:23:18,715] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 14: [2023-04-29 17:23:18,715] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 21: [2023-04-29 17:23:18,716] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 21: [2023-04-29 17:23:18,716] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 21: [2023-04-29 17:23:18,716] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 21: [2023-04-29 17:23:18,717] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 21: [2023-04-29 17:23:18,717] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 3: [2023-04-29 17:23:18,718] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 3: [2023-04-29 17:23:18,718] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 17: [2023-04-29 17:23:18,720] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 17: [2023-04-29 17:23:18,724] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 26: [2023-04-29 17:23:18,725] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 26: [2023-04-29 17:23:18,725] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 5: [2023-04-29 17:23:18,727] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 5: [2023-04-29 17:23:18,728] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 14: [2023-04-29 17:23:18,728] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 14: [2023-04-29 17:23:18,728] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 14: [2023-04-29 17:23:18,728] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 14: [2023-04-29 17:23:18,728] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 14: [2023-04-29 17:23:18,728] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 26: [2023-04-29 17:23:18,729] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 5: [2023-04-29 17:23:18,729] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 16: [2023-04-29 17:23:18,729] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 16: [2023-04-29 17:23:18,729] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 5: [2023-04-29 17:23:18,729] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 5: [2023-04-29 17:23:18,730] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 5: [2023-04-29 17:23:18,730] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 5: [2023-04-29 17:23:18,730] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 5: [2023-04-29 17:23:18,730] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 23: [2023-04-29 17:23:18,730] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 23: [2023-04-29 17:23:18,730] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 23: [2023-04-29 17:23:18,730] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 23: [2023-04-29 17:23:18,731] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 5: [2023-04-29 17:23:18,732] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 17: [2023-04-29 17:23:18,732] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 17: [2023-04-29 17:23:18,733] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 5: [2023-04-29 17:23:18,733] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 23: [2023-04-29 17:23:18,734] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 23: [2023-04-29 17:23:18,734] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 23: [2023-04-29 17:23:18,734] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 20: [2023-04-29 17:23:18,733] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 20: [2023-04-29 17:23:18,733] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 17: [2023-04-29 17:23:18,734] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 23: [2023-04-29 17:23:18,734] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 5: [2023-04-29 17:23:18,734] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 24: [2023-04-29 17:23:18,734] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 17: [2023-04-29 17:23:18,735] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 16: [2023-04-29 17:23:18,735] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 10: [2023-04-29 17:23:18,736] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 10: [2023-04-29 17:23:18,736] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 10: [2023-04-29 17:23:18,736] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 10: [2023-04-29 17:23:18,736] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 20: [2023-04-29 17:23:18,737] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 5: [2023-04-29 17:23:18,738] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 5: [2023-04-29 17:23:18,738] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 25: [2023-04-29 17:23:18,739] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 25: [2023-04-29 17:23:18,739] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 26: [2023-04-29 17:23:18,739] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 14: [2023-04-29 17:23:18,739] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 14: [2023-04-29 17:23:18,739] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 25: [2023-04-29 17:23:18,739] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 25: [2023-04-29 17:23:18,739] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 26: [2023-04-29 17:23:18,739] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 26: [2023-04-29 17:23:18,739] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 26: [2023-04-29 17:23:18,739] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 26: [2023-04-29 17:23:18,739] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 25: [2023-04-29 17:23:18,739] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 25: [2023-04-29 17:23:18,739] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 25: [2023-04-29 17:23:18,739] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 5: [2023-04-29 17:23:18,739] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 25: [2023-04-29 17:23:18,739] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 5: [2023-04-29 17:23:18,740] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 5: [2023-04-29 17:23:18,740] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 11: [2023-04-29 17:23:18,742] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 11: [2023-04-29 17:23:18,742] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 11: [2023-04-29 17:23:18,742] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 10: [2023-04-29 17:23:18,742] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 10: [2023-04-29 17:23:18,742] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 10: [2023-04-29 17:23:18,742] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 10: [2023-04-29 17:23:18,742] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 25: [2023-04-29 17:23:18,743] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 25: [2023-04-29 17:23:18,743] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 16: [2023-04-29 17:23:18,745] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 16: [2023-04-29 17:23:18,745] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 16: [2023-04-29 17:23:18,745] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 16: [2023-04-29 17:23:18,745] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 16: [2023-04-29 17:23:18,745] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 8: [2023-04-29 17:23:18,744] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 8: [2023-04-29 17:23:18,745] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 8: [2023-04-29 17:23:18,745] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 19: [2023-04-29 17:23:18,745] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 19: [2023-04-29 17:23:18,745] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 19: [2023-04-29 17:23:18,745] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 27: [2023-04-29 17:23:18,745] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 27: [2023-04-29 17:23:18,746] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 26: [2023-04-29 17:23:18,747] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 26: [2023-04-29 17:23:18,747] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 20: [2023-04-29 17:23:18,749] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 20: [2023-04-29 17:23:18,749] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 25: [2023-04-29 17:23:18,749] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 25: [2023-04-29 17:23:18,749] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 25: [2023-04-29 17:23:18,750] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 9: [2023-04-29 17:23:18,750] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 9: [2023-04-29 17:23:18,750] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 9: [2023-04-29 17:23:18,750] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 9: [2023-04-29 17:23:18,750] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 9: [2023-04-29 17:23:18,750] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 9: [2023-04-29 17:23:18,750] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 9: [2023-04-29 17:23:18,750] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 1: [2023-04-29 17:23:18,749] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 1: [2023-04-29 17:23:18,749] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 1: [2023-04-29 17:23:18,749] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 1: [2023-04-29 17:23:18,749] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 9: [2023-04-29 17:23:18,750] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 25: [2023-04-29 17:23:18,750] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 25: [2023-04-29 17:23:18,750] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 25: [2023-04-29 17:23:18,751] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 20: [2023-04-29 17:23:18,751] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 20: [2023-04-29 17:23:18,751] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 20: [2023-04-29 17:23:18,751] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 16: [2023-04-29 17:23:18,751] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 16: [2023-04-29 17:23:18,751] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 18: [2023-04-29 17:23:18,753] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 26: [2023-04-29 17:23:18,753] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 8: [2023-04-29 17:23:18,753] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 8: [2023-04-29 17:23:18,753] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 8: [2023-04-29 17:23:18,753] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 18: [2023-04-29 17:23:18,753] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 18: [2023-04-29 17:23:18,753] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 8: [2023-04-29 17:23:18,754] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 8: [2023-04-29 17:23:18,754] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 11: [2023-04-29 17:23:18,754] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 11: [2023-04-29 17:23:18,754] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 11: [2023-04-29 17:23:18,754] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 1: [2023-04-29 17:23:18,755] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 1: [2023-04-29 17:23:18,755] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 1: [2023-04-29 17:23:18,755] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 1: [2023-04-29 17:23:18,755] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 9: [2023-04-29 17:23:18,755] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 9: [2023-04-29 17:23:18,755] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 9: [2023-04-29 17:23:18,755] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 9: [2023-04-29 17:23:18,755] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 9: [2023-04-29 17:23:18,755] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 20: [2023-04-29 17:23:18,755] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 9: [2023-04-29 17:23:18,756] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 11: [2023-04-29 17:23:18,755] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 11: [2023-04-29 17:23:18,755] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 9: [2023-04-29 17:23:18,756] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 24: [2023-04-29 17:23:18,756] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 9: [2023-04-29 17:23:18,756] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt... 19: [2023-04-29 17:23:18,757] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 20: [2023-04-29 17:23:18,757] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 14: [2023-04-29 17:23:18,758] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 7: [2023-04-29 17:23:18,760] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 7: [2023-04-29 17:23:18,760] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 7: [2023-04-29 17:23:18,760] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 10: [2023-04-29 17:23:18,760] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 7: [2023-04-29 17:23:18,760] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 7: [2023-04-29 17:23:18,760] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 7: [2023-04-29 17:23:18,760] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 7: [2023-04-29 17:23:18,760] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 7: [2023-04-29 17:23:18,761] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 23: [2023-04-29 17:23:18,761] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 14: [2023-04-29 17:23:18,762] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 14: [2023-04-29 17:23:18,762] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 19: [2023-04-29 17:23:18,762] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 19: [2023-04-29 17:23:18,762] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 19: [2023-04-29 17:23:18,762] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 14: [2023-04-29 17:23:18,762] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 19: [2023-04-29 17:23:18,762] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 16: [2023-04-29 17:23:18,763] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 23: [2023-04-29 17:23:18,763] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 10: [2023-04-29 17:23:18,763] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 14: [2023-04-29 17:23:18,764] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 20: [2023-04-29 17:23:18,764] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 23: [2023-04-29 17:23:18,764] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 10: [2023-04-29 17:23:18,764] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 23: [2023-04-29 17:23:18,764] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 10: [2023-04-29 17:23:18,765] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 23: [2023-04-29 17:23:18,765] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 11: [2023-04-29 17:23:18,765] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 7: [2023-04-29 17:23:18,764] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 7: [2023-04-29 17:23:18,764] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 7: [2023-04-29 17:23:18,765] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 30: [2023-04-29 17:23:18,765] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 24: [2023-04-29 17:23:18,765] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 24: [2023-04-29 17:23:18,765] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 24: [2023-04-29 17:23:18,765] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 26: [2023-04-29 17:23:18,766] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 19: [2023-04-29 17:23:18,766] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 26: [2023-04-29 17:23:18,766] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 11: [2023-04-29 17:23:18,767] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 11: [2023-04-29 17:23:18,767] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 7: [2023-04-29 17:23:18,767] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 18: [2023-04-29 17:23:18,767] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 18: [2023-04-29 17:23:18,767] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 18: [2023-04-29 17:23:18,767] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 18: [2023-04-29 17:23:18,767] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 18: [2023-04-29 17:23:18,767] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 7: [2023-04-29 17:23:18,767] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 7: [2023-04-29 17:23:18,767] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 7: [2023-04-29 17:23:18,767] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 27: [2023-04-29 17:23:18,767] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 26: [2023-04-29 17:23:18,768] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 7: [2023-04-29 17:23:18,768] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 19: [2023-04-29 17:23:18,768] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 23: [2023-04-29 17:23:18,768] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 19: [2023-04-29 17:23:18,768] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 26: [2023-04-29 17:23:18,769] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 27: [2023-04-29 17:23:18,769] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 21: [2023-04-29 17:23:18,769] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 21: [2023-04-29 17:23:18,769] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 21: [2023-04-29 17:23:18,769] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 10: [2023-04-29 17:23:18,770] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 24: [2023-04-29 17:23:18,769] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 24: [2023-04-29 17:23:18,769] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 24: [2023-04-29 17:23:18,769] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 24: [2023-04-29 17:23:18,770] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 27: [2023-04-29 17:23:18,770] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 27: [2023-04-29 17:23:18,770] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 27: [2023-04-29 17:23:18,771] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 26: [2023-04-29 17:23:18,771] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 8: [2023-04-29 17:23:18,771] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 10: [2023-04-29 17:23:18,771] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 27: [2023-04-29 17:23:18,772] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 27: [2023-04-29 17:23:18,772] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 27: [2023-04-29 17:23:18,772] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 8: [2023-04-29 17:23:18,772] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 1: [2023-04-29 17:23:18,772] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 10: [2023-04-29 17:23:18,773] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 10: [2023-04-29 17:23:18,773] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 20: [2023-04-29 17:23:18,773] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 16: [2023-04-29 17:23:18,774] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 16: [2023-04-29 17:23:18,774] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 8: [2023-04-29 17:23:18,774] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 16: [2023-04-29 17:23:18,774] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 28: [2023-04-29 17:23:18,774] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 28: [2023-04-29 17:23:18,774] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 1: [2023-04-29 17:23:18,775] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 28: [2023-04-29 17:23:18,774] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 20: [2023-04-29 17:23:18,775] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 16: [2023-04-29 17:23:18,777] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 16: [2023-04-29 17:23:18,777] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 18: [2023-04-29 17:23:18,778] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 1: [2023-04-29 17:23:18,778] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 20: [2023-04-29 17:23:18,778] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 1: [2023-04-29 17:23:18,778] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 20: [2023-04-29 17:23:18,779] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 20: [2023-04-29 17:23:18,780] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 15: [2023-04-29 17:23:18,780] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 15: [2023-04-29 17:23:18,781] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 15: [2023-04-29 17:23:18,781] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 15: [2023-04-29 17:23:18,781] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 19: [2023-04-29 17:23:18,781] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 1: [2023-04-29 17:23:18,782] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 5: [2023-04-29 17:23:18,782] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 5: [2023-04-29 17:23:18,782] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 1: [2023-04-29 17:23:18,783] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 11: [2023-04-29 17:23:18,783] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 11: [2023-04-29 17:23:18,783] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 21: [2023-04-29 17:23:18,783] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 21: [2023-04-29 17:23:18,783] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 21: [2023-04-29 17:23:18,783] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 21: [2023-04-29 17:23:18,783] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 21: [2023-04-29 17:23:18,783] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 11: [2023-04-29 17:23:18,783] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 1: [2023-04-29 17:23:18,783] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 18: [2023-04-29 17:23:18,783] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 15: [2023-04-29 17:23:18,784] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 15: [2023-04-29 17:23:18,784] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 15: [2023-04-29 17:23:18,784] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 15: [2023-04-29 17:23:18,784] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 18: [2023-04-29 17:23:18,784] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 1: [2023-04-29 17:23:18,784] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 8: [2023-04-29 17:23:18,785] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 8: [2023-04-29 17:23:18,785] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 8: [2023-04-29 17:23:18,785] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 30: [2023-04-29 17:23:18,786] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 11: [2023-04-29 17:23:18,786] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 11: [2023-04-29 17:23:18,786] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 30: [2023-04-29 17:23:18,787] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 30: [2023-04-29 17:23:18,787] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 30: [2023-04-29 17:23:18,787] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 30: [2023-04-29 17:23:18,787] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 30: [2023-04-29 17:23:18,787] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 30: [2023-04-29 17:23:18,787] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 30: [2023-04-29 17:23:18,787] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 8: [2023-04-29 17:23:18,787] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 8: [2023-04-29 17:23:18,787] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 19: [2023-04-29 17:23:18,788] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 28: [2023-04-29 17:23:18,788] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 28: [2023-04-29 17:23:18,788] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 28: [2023-04-29 17:23:18,788] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 28: [2023-04-29 17:23:18,788] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 28: [2023-04-29 17:23:18,789] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 19: [2023-04-29 17:23:18,790] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 19: [2023-04-29 17:23:18,790] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 19: [2023-04-29 17:23:18,791] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 21: [2023-04-29 17:23:18,792] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 21: [2023-04-29 17:23:18,792] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 21: [2023-04-29 17:23:18,794] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 24: [2023-04-29 17:23:18,794] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 25: [2023-04-29 17:23:18,795] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 25: [2023-04-29 17:23:18,795] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 18: [2023-04-29 17:23:18,799] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 5: [2023-04-29 17:23:18,802] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 27: [2023-04-29 17:23:18,802] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 18: [2023-04-29 17:23:18,801] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 18: [2023-04-29 17:23:18,802] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 18: [2023-04-29 17:23:18,802] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 18: [2023-04-29 17:23:18,802] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 27: [2023-04-29 17:23:18,802] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 5: [2023-04-29 17:23:18,802] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 28: [2023-04-29 17:23:18,802] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 24: [2023-04-29 17:23:18,802] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 24: [2023-04-29 17:23:18,803] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 28: [2023-04-29 17:23:18,803] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 24: [2023-04-29 17:23:18,804] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 28: [2023-04-29 17:23:18,804] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 5: [2023-04-29 17:23:18,805] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 24: [2023-04-29 17:23:18,805] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 27: [2023-04-29 17:23:18,806] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 27: [2023-04-29 17:23:18,807] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 27: [2023-04-29 17:23:18,807] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 24: [2023-04-29 17:23:18,807] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 24: [2023-04-29 17:23:18,807] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 27: [2023-04-29 17:23:18,808] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 5: [2023-04-29 17:23:18,809] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 5: [2023-04-29 17:23:18,809] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 21: [2023-04-29 17:23:18,810] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 21: [2023-04-29 17:23:18,810] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 5: [2023-04-29 17:23:18,810] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 5: [2023-04-29 17:23:18,810] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 5: [2023-04-29 17:23:18,810] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 21: [2023-04-29 17:23:18,811] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 22: [2023-04-29 17:23:18,811] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 22: [2023-04-29 17:23:18,811] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 22: [2023-04-29 17:23:18,811] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 22: [2023-04-29 17:23:18,812] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 22: [2023-04-29 17:23:18,812] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 22: [2023-04-29 17:23:18,812] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 22: [2023-04-29 17:23:18,812] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 22: [2023-04-29 17:23:18,812] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 21: [2023-04-29 17:23:18,813] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 21: [2023-04-29 17:23:18,813] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 9: [2023-04-29 17:23:18,813] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 9: [2023-04-29 17:23:18,813] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 9: [2023-04-29 17:23:18,813] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 9: [2023-04-29 17:23:18,813] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 25: [2023-04-29 17:23:18,815] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 22: [2023-04-29 17:23:18,815] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 22: [2023-04-29 17:23:18,816] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 25: [2023-04-29 17:23:18,816] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 15: [2023-04-29 17:23:18,816] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 25: [2023-04-29 17:23:18,817] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 25: [2023-04-29 17:23:18,817] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 9: [2023-04-29 17:23:18,817] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 9: [2023-04-29 17:23:18,817] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 9: [2023-04-29 17:23:18,817] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 9: [2023-04-29 17:23:18,817] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 7: [2023-04-29 17:23:18,817] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 7: [2023-04-29 17:23:18,817] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 7: [2023-04-29 17:23:18,817] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 30: [2023-04-29 17:23:18,818] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 15: [2023-04-29 17:23:18,819] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 15: [2023-04-29 17:23:18,820] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 15: [2023-04-29 17:23:18,820] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 15: [2023-04-29 17:23:18,820] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 25: [2023-04-29 17:23:18,820] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 25: [2023-04-29 17:23:18,820] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 25: [2023-04-29 17:23:18,820] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 25: [2023-04-29 17:23:18,820] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_04-model_00-model_states.pt. 22: [2023-04-29 17:23:18,821] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 22: [2023-04-29 17:23:18,821] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 22: [2023-04-29 17:23:18,822] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 22: [2023-04-29 17:23:18,822] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 22: [2023-04-29 17:23:18,823] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 30: [2023-04-29 17:23:18,823] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 22: [2023-04-29 17:23:18,823] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 15: [2023-04-29 17:23:18,823] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 28: [2023-04-29 17:23:18,823] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 15: [2023-04-29 17:23:18,824] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 15: [2023-04-29 17:23:18,824] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 30: [2023-04-29 17:23:18,824] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 30: [2023-04-29 17:23:18,824] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 30: [2023-04-29 17:23:18,825] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 30: [2023-04-29 17:23:18,825] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 28: [2023-04-29 17:23:18,825] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 30: [2023-04-29 17:23:18,826] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 28: [2023-04-29 17:23:18,826] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 28: [2023-04-29 17:23:18,826] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 28: [2023-04-29 17:23:18,828] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 5: [2023-04-29 17:23:18,830] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 7: [2023-04-29 17:23:18,832] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 7: [2023-04-29 17:23:18,832] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 7: [2023-04-29 17:23:18,833] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 7: [2023-04-29 17:23:18,833] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 7: [2023-04-29 17:23:18,833] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 5: [2023-04-29 17:23:18,838] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 7: [2023-04-29 17:23:18,838] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 7: [2023-04-29 17:23:18,839] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 7: [2023-04-29 17:23:18,839] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 5: [2023-04-29 17:23:18,841] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 5: [2023-04-29 17:23:18,842] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 5: [2023-04-29 17:23:18,843] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 5: [2023-04-29 17:23:18,843] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 25: [2023-04-29 17:23:18,845] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 9: [2023-04-29 17:23:18,846] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 25: [2023-04-29 17:23:18,846] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 9: [2023-04-29 17:23:18,846] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 9: [2023-04-29 17:23:18,846] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 9: [2023-04-29 17:23:18,847] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 9: [2023-04-29 17:23:18,848] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 9: [2023-04-29 17:23:18,849] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 9: [2023-04-29 17:23:18,849] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 9: [2023-04-29 17:23:18,849] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 25: [2023-04-29 17:23:18,852] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 25: [2023-04-29 17:23:18,852] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 25: [2023-04-29 17:23:18,852] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 25: [2023-04-29 17:23:18,855] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 7: [2023-04-29 17:23:18,857] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 7: [2023-04-29 17:23:18,860] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 7: [2023-04-29 17:23:18,860] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 7: [2023-04-29 17:23:18,861] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 7: [2023-04-29 17:23:18,863] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 13: [2023-04-29 17:23:18,864] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 0: [2023-04-29 17:23:18,864] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 0: [2023-04-29 17:23:18,864] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 0: [2023-04-29 17:23:18,864] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 0: [2023-04-29 17:23:18,864] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 0: [2023-04-29 17:23:18,864] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 13: [2023-04-29 17:23:18,864] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 0: [2023-04-29 17:23:18,864] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 0: [2023-04-29 17:23:18,864] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 13: [2023-04-29 17:23:18,864] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 13: [2023-04-29 17:23:18,864] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 0: [2023-04-29 17:23:18,864] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 13: [2023-04-29 17:23:18,864] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 13: [2023-04-29 17:23:18,864] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 13: [2023-04-29 17:23:18,864] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 13: [2023-04-29 17:23:18,865] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 22: [2023-04-29 17:23:18,867] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 22: [2023-04-29 17:23:18,867] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 13: [2023-04-29 17:23:18,869] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 13: [2023-04-29 17:23:18,870] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 13: [2023-04-29 17:23:18,873] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 13: [2023-04-29 17:23:18,874] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 13: [2023-04-29 17:23:18,874] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 13: [2023-04-29 17:23:18,876] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 13: [2023-04-29 17:23:18,876] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 13: [2023-04-29 17:23:18,876] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 0: [2023-04-29 17:23:18,877] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 0: [2023-04-29 17:23:18,878] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 0: [2023-04-29 17:23:18,878] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 0: [2023-04-29 17:23:18,879] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 0: [2023-04-29 17:23:18,879] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 0: [2023-04-29 17:23:18,880] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 0: [2023-04-29 17:23:18,880] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 0: [2023-04-29 17:23:18,880] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 22: [2023-04-29 17:23:18,889] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 22: [2023-04-29 17:23:18,890] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 22: [2023-04-29 17:23:18,890] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 22: [2023-04-29 17:23:18,890] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 22: [2023-04-29 17:23:18,890] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 22: [2023-04-29 17:23:18,893] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 22: [2023-04-29 17:23:18,893] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 22: [2023-04-29 17:23:18,893] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 2: [2023-04-29 17:23:18,920] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 2: [2023-04-29 17:23:18,920] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 2: [2023-04-29 17:23:18,921] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 2: [2023-04-29 17:23:18,922] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 2: [2023-04-29 17:23:18,922] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 2: [2023-04-29 17:23:18,922] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 2: [2023-04-29 17:23:18,922] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 2: [2023-04-29 17:23:18,923] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 13: [2023-04-29 17:23:18,922] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 22: [2023-04-29 17:23:18,924] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 2: [2023-04-29 17:23:18,925] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 2: [2023-04-29 17:23:18,925] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 22: [2023-04-29 17:23:18,926] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 22: [2023-04-29 17:23:18,926] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 2: [2023-04-29 17:23:18,926] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 13: [2023-04-29 17:23:18,926] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 22: [2023-04-29 17:23:18,927] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 22: [2023-04-29 17:23:18,927] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 22: [2023-04-29 17:23:18,930] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 2: [2023-04-29 17:23:18,931] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 2: [2023-04-29 17:23:18,932] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 2: [2023-04-29 17:23:18,932] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 2: [2023-04-29 17:23:18,933] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 2: [2023-04-29 17:23:18,933] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 13: [2023-04-29 17:23:18,942] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 13: [2023-04-29 17:23:18,942] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 13: [2023-04-29 17:23:18,942] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 13: [2023-04-29 17:23:18,942] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 13: [2023-04-29 17:23:18,945] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 13: [2023-04-29 17:23:18,945] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 13: [2023-04-29 17:23:18,945] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 13: [2023-04-29 17:23:18,948] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 0: [2023-04-29 17:23:18,956] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 0: [2023-04-29 17:23:18,956] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 0: [2023-04-29 17:23:18,956] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 31: [2023-04-29 17:23:18,967] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 31: [2023-04-29 17:23:18,967] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 31: [2023-04-29 17:23:18,967] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 31: [2023-04-29 17:23:18,968] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 31: [2023-04-29 17:23:18,968] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 31: [2023-04-29 17:23:18,968] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 31: [2023-04-29 17:23:18,968] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 31: [2023-04-29 17:23:18,968] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 0: [2023-04-29 17:23:18,970] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 0: [2023-04-29 17:23:18,970] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 0: [2023-04-29 17:23:18,970] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 0: [2023-04-29 17:23:18,970] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 0: [2023-04-29 17:23:18,970] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 31: [2023-04-29 17:23:18,972] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 31: [2023-04-29 17:23:18,972] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 31: [2023-04-29 17:23:18,972] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 31: [2023-04-29 17:23:18,973] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 31: [2023-04-29 17:23:18,974] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 13: [2023-04-29 17:23:18,974] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 31: [2023-04-29 17:23:18,974] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 31: [2023-04-29 17:23:18,974] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 31: [2023-04-29 17:23:18,975] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 13: [2023-04-29 17:23:18,975] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 13: [2023-04-29 17:23:18,975] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 13: [2023-04-29 17:23:18,975] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 13: [2023-04-29 17:23:18,976] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 13: [2023-04-29 17:23:18,976] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 2: [2023-04-29 17:23:18,979] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 2: [2023-04-29 17:23:18,979] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 2: [2023-04-29 17:23:18,979] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 0: [2023-04-29 17:23:18,981] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 0: [2023-04-29 17:23:18,983] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 0: [2023-04-29 17:23:18,983] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 2: [2023-04-29 17:23:18,996] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 2: [2023-04-29 17:23:18,996] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 2: [2023-04-29 17:23:18,996] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 2: [2023-04-29 17:23:18,997] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 2: [2023-04-29 17:23:18,997] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 2: [2023-04-29 17:23:19,001] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 0: [2023-04-29 17:23:19,002] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 0: [2023-04-29 17:23:19,003] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 2: [2023-04-29 17:23:19,003] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 2: [2023-04-29 17:23:19,003] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 0: [2023-04-29 17:23:19,005] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 0: [2023-04-29 17:23:19,005] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 0: [2023-04-29 17:23:19,006] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 3: [2023-04-29 17:23:19,009] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 3: [2023-04-29 17:23:19,009] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 3: [2023-04-29 17:23:19,010] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 3: [2023-04-29 17:23:19,010] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 3: [2023-04-29 17:23:19,010] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 3: [2023-04-29 17:23:19,010] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 3: [2023-04-29 17:23:19,010] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 3: [2023-04-29 17:23:19,010] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 14: [2023-04-29 17:23:19,013] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 14: [2023-04-29 17:23:19,013] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 14: [2023-04-29 17:23:19,013] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 3: [2023-04-29 17:23:19,013] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 3: [2023-04-29 17:23:19,013] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 14: [2023-04-29 17:23:19,013] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 14: [2023-04-29 17:23:19,013] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 14: [2023-04-29 17:23:19,013] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 14: [2023-04-29 17:23:19,013] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 14: [2023-04-29 17:23:19,014] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 14: [2023-04-29 17:23:19,017] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 3: [2023-04-29 17:23:19,017] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 3: [2023-04-29 17:23:19,017] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 3: [2023-04-29 17:23:19,018] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 3: [2023-04-29 17:23:19,018] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 3: [2023-04-29 17:23:19,018] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 3: [2023-04-29 17:23:19,018] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 14: [2023-04-29 17:23:19,024] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 14: [2023-04-29 17:23:19,024] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 31: [2023-04-29 17:23:19,024] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 31: [2023-04-29 17:23:19,024] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 31: [2023-04-29 17:23:19,024] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 14: [2023-04-29 17:23:19,024] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 14: [2023-04-29 17:23:19,024] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 14: [2023-04-29 17:23:19,025] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 2: [2023-04-29 17:23:19,025] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 2: [2023-04-29 17:23:19,025] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 2: [2023-04-29 17:23:19,026] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 2: [2023-04-29 17:23:19,026] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 2: [2023-04-29 17:23:19,026] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 14: [2023-04-29 17:23:19,026] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 14: [2023-04-29 17:23:19,026] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 4: [2023-04-29 17:23:19,028] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 4: [2023-04-29 17:23:19,028] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 4: [2023-04-29 17:23:19,028] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 4: [2023-04-29 17:23:19,028] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 4: [2023-04-29 17:23:19,028] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 4: [2023-04-29 17:23:19,028] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 4: [2023-04-29 17:23:19,028] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 4: [2023-04-29 17:23:19,029] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 4: [2023-04-29 17:23:19,032] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 4: [2023-04-29 17:23:19,033] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 4: [2023-04-29 17:23:19,038] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 31: [2023-04-29 17:23:19,038] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 31: [2023-04-29 17:23:19,038] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 31: [2023-04-29 17:23:19,038] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 31: [2023-04-29 17:23:19,038] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 31: [2023-04-29 17:23:19,038] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 4: [2023-04-29 17:23:19,039] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 4: [2023-04-29 17:23:19,039] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 4: [2023-04-29 17:23:19,040] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 4: [2023-04-29 17:23:19,040] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 4: [2023-04-29 17:23:19,041] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 31: [2023-04-29 17:23:19,044] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 31: [2023-04-29 17:23:19,046] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 31: [2023-04-29 17:23:19,046] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 12: [2023-04-29 17:23:19,048] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 12: [2023-04-29 17:23:19,048] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 12: [2023-04-29 17:23:19,048] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 12: [2023-04-29 17:23:19,048] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 12: [2023-04-29 17:23:19,048] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 12: [2023-04-29 17:23:19,049] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 12: [2023-04-29 17:23:19,049] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 12: [2023-04-29 17:23:19,049] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 12: [2023-04-29 17:23:19,055] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 12: [2023-04-29 17:23:19,056] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 12: [2023-04-29 17:23:19,056] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 12: [2023-04-29 17:23:19,056] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 12: [2023-04-29 17:23:19,056] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 12: [2023-04-29 17:23:19,057] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 12: [2023-04-29 17:23:19,058] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 12: [2023-04-29 17:23:19,058] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 3: [2023-04-29 17:23:19,063] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 3: [2023-04-29 17:23:19,063] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 6: [2023-04-29 17:23:19,064] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 6: [2023-04-29 17:23:19,064] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 6: [2023-04-29 17:23:19,065] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 6: [2023-04-29 17:23:19,065] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 6: [2023-04-29 17:23:19,065] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 6: [2023-04-29 17:23:19,065] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 6: [2023-04-29 17:23:19,065] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 6: [2023-04-29 17:23:19,065] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 31: [2023-04-29 17:23:19,066] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 31: [2023-04-29 17:23:19,067] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 14: [2023-04-29 17:23:19,069] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 6: [2023-04-29 17:23:19,069] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 6: [2023-04-29 17:23:19,069] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 31: [2023-04-29 17:23:19,070] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 31: [2023-04-29 17:23:19,070] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 31: [2023-04-29 17:23:19,070] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 6: [2023-04-29 17:23:19,074] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 6: [2023-04-29 17:23:19,074] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 6: [2023-04-29 17:23:19,075] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 6: [2023-04-29 17:23:19,075] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 6: [2023-04-29 17:23:19,076] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 6: [2023-04-29 17:23:19,076] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 21: [2023-04-29 17:23:19,080] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 21: [2023-04-29 17:23:19,080] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 21: [2023-04-29 17:23:19,080] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 21: [2023-04-29 17:23:19,080] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 21: [2023-04-29 17:23:19,080] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 21: [2023-04-29 17:23:19,080] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 21: [2023-04-29 17:23:19,080] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 21: [2023-04-29 17:23:19,081] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 4: [2023-04-29 17:23:19,083] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 4: [2023-04-29 17:23:19,083] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 3: [2023-04-29 17:23:19,083] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 3: [2023-04-29 17:23:19,085] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 21: [2023-04-29 17:23:19,085] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 21: [2023-04-29 17:23:19,085] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 21: [2023-04-29 17:23:19,085] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 21: [2023-04-29 17:23:19,086] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 21: [2023-04-29 17:23:19,087] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 21: [2023-04-29 17:23:19,087] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 3: [2023-04-29 17:23:19,087] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 3: [2023-04-29 17:23:19,087] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 3: [2023-04-29 17:23:19,087] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 3: [2023-04-29 17:23:19,087] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 21: [2023-04-29 17:23:19,087] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 3: [2023-04-29 17:23:19,087] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 3: [2023-04-29 17:23:19,087] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 17: [2023-04-29 17:23:19,087] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 17: [2023-04-29 17:23:19,087] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 17: [2023-04-29 17:23:19,087] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 17: [2023-04-29 17:23:19,087] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 17: [2023-04-29 17:23:19,087] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 21: [2023-04-29 17:23:19,088] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 17: [2023-04-29 17:23:19,087] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 17: [2023-04-29 17:23:19,088] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 17: [2023-04-29 17:23:19,088] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 14: [2023-04-29 17:23:19,088] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 16: [2023-04-29 17:23:19,090] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 16: [2023-04-29 17:23:19,090] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 16: [2023-04-29 17:23:19,090] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 16: [2023-04-29 17:23:19,091] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 16: [2023-04-29 17:23:19,091] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 16: [2023-04-29 17:23:19,091] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 16: [2023-04-29 17:23:19,091] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 16: [2023-04-29 17:23:19,091] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 19: [2023-04-29 17:23:19,093] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 19: [2023-04-29 17:23:19,093] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 17: [2023-04-29 17:23:19,093] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 19: [2023-04-29 17:23:19,093] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 19: [2023-04-29 17:23:19,093] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 17: [2023-04-29 17:23:19,093] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 19: [2023-04-29 17:23:19,094] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 19: [2023-04-29 17:23:19,094] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 19: [2023-04-29 17:23:19,094] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 19: [2023-04-29 17:23:19,094] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 14: [2023-04-29 17:23:19,096] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 14: [2023-04-29 17:23:19,096] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 16: [2023-04-29 17:23:19,097] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 16: [2023-04-29 17:23:19,097] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 16: [2023-04-29 17:23:19,097] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 16: [2023-04-29 17:23:19,097] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 16: [2023-04-29 17:23:19,097] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 19: [2023-04-29 17:23:19,097] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 19: [2023-04-29 17:23:19,097] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 17: [2023-04-29 17:23:19,097] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 17: [2023-04-29 17:23:19,098] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 16: [2023-04-29 17:23:19,098] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 16: [2023-04-29 17:23:19,098] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 19: [2023-04-29 17:23:19,098] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 16: [2023-04-29 17:23:19,098] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 17: [2023-04-29 17:23:19,099] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 17: [2023-04-29 17:23:19,099] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 17: [2023-04-29 17:23:19,100] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 17: [2023-04-29 17:23:19,100] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 7: [2023-04-29 17:23:19,101] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 7: [2023-04-29 17:23:19,101] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 7: [2023-04-29 17:23:19,101] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 7: [2023-04-29 17:23:19,102] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 7: [2023-04-29 17:23:19,102] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 7: [2023-04-29 17:23:19,102] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 7: [2023-04-29 17:23:19,102] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 7: [2023-04-29 17:23:19,102] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 19: [2023-04-29 17:23:19,102] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 19: [2023-04-29 17:23:19,102] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 19: [2023-04-29 17:23:19,102] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 19: [2023-04-29 17:23:19,103] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 4: [2023-04-29 17:23:19,103] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 19: [2023-04-29 17:23:19,103] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 4: [2023-04-29 17:23:19,104] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 14: [2023-04-29 17:23:19,104] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 14: [2023-04-29 17:23:19,104] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 14: [2023-04-29 17:23:19,104] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 14: [2023-04-29 17:23:19,104] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 7: [2023-04-29 17:23:19,106] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 7: [2023-04-29 17:23:19,106] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 7: [2023-04-29 17:23:19,106] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 4: [2023-04-29 17:23:19,108] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 4: [2023-04-29 17:23:19,108] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 4: [2023-04-29 17:23:19,108] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 12: [2023-04-29 17:23:19,108] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 12: [2023-04-29 17:23:19,108] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 7: [2023-04-29 17:23:19,108] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 7: [2023-04-29 17:23:19,108] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 7: [2023-04-29 17:23:19,108] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 7: [2023-04-29 17:23:19,108] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 7: [2023-04-29 17:23:19,109] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 12: [2023-04-29 17:23:19,109] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 4: [2023-04-29 17:23:19,110] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 14: [2023-04-29 17:23:19,112] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 27: [2023-04-29 17:23:19,112] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 27: [2023-04-29 17:23:19,112] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 27: [2023-04-29 17:23:19,112] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 27: [2023-04-29 17:23:19,112] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 27: [2023-04-29 17:23:19,112] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 27: [2023-04-29 17:23:19,113] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 27: [2023-04-29 17:23:19,113] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 27: [2023-04-29 17:23:19,113] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 4: [2023-04-29 17:23:19,114] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 3: [2023-04-29 17:23:19,116] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 18: [2023-04-29 17:23:19,116] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 18: [2023-04-29 17:23:19,116] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 18: [2023-04-29 17:23:19,116] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 18: [2023-04-29 17:23:19,117] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 18: [2023-04-29 17:23:19,117] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 18: [2023-04-29 17:23:19,117] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 18: [2023-04-29 17:23:19,117] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 18: [2023-04-29 17:23:19,117] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 27: [2023-04-29 17:23:19,117] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 3: [2023-04-29 17:23:19,117] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 27: [2023-04-29 17:23:19,118] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 3: [2023-04-29 17:23:19,119] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 14: [2023-04-29 17:23:19,119] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 14: [2023-04-29 17:23:19,120] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 3: [2023-04-29 17:23:19,120] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 22: [2023-04-29 17:23:19,120] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 22: [2023-04-29 17:23:19,120] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 22: [2023-04-29 17:23:19,120] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 22: [2023-04-29 17:23:19,120] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 22: [2023-04-29 17:23:19,120] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 22: [2023-04-29 17:23:19,120] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 22: [2023-04-29 17:23:19,120] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 22: [2023-04-29 17:23:19,121] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 6: [2023-04-29 17:23:19,120] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 6: [2023-04-29 17:23:19,120] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 3: [2023-04-29 17:23:19,122] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 3: [2023-04-29 17:23:19,122] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 4: [2023-04-29 17:23:19,124] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 27: [2023-04-29 17:23:19,124] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 27: [2023-04-29 17:23:19,124] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 12: [2023-04-29 17:23:19,124] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 8: [2023-04-29 17:23:19,124] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 8: [2023-04-29 17:23:19,124] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 12: [2023-04-29 17:23:19,125] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 12: [2023-04-29 17:23:19,125] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 12: [2023-04-29 17:23:19,125] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 22: [2023-04-29 17:23:19,124] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 22: [2023-04-29 17:23:19,124] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 12: [2023-04-29 17:23:19,125] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 27: [2023-04-29 17:23:19,125] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 8: [2023-04-29 17:23:19,125] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 8: [2023-04-29 17:23:19,126] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 8: [2023-04-29 17:23:19,126] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 8: [2023-04-29 17:23:19,126] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 8: [2023-04-29 17:23:19,126] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 27: [2023-04-29 17:23:19,126] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 8: [2023-04-29 17:23:19,126] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 27: [2023-04-29 17:23:19,126] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 27: [2023-04-29 17:23:19,127] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 25: [2023-04-29 17:23:19,127] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 25: [2023-04-29 17:23:19,127] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 25: [2023-04-29 17:23:19,127] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 25: [2023-04-29 17:23:19,127] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 25: [2023-04-29 17:23:19,127] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 10: [2023-04-29 17:23:19,127] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 10: [2023-04-29 17:23:19,127] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 25: [2023-04-29 17:23:19,127] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 25: [2023-04-29 17:23:19,128] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 24: [2023-04-29 17:23:19,127] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 25: [2023-04-29 17:23:19,128] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 24: [2023-04-29 17:23:19,128] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 24: [2023-04-29 17:23:19,128] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 24: [2023-04-29 17:23:19,128] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 24: [2023-04-29 17:23:19,128] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 24: [2023-04-29 17:23:19,128] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 24: [2023-04-29 17:23:19,128] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 24: [2023-04-29 17:23:19,128] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 10: [2023-04-29 17:23:19,129] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 10: [2023-04-29 17:23:19,129] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 18: [2023-04-29 17:23:19,129] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 10: [2023-04-29 17:23:19,129] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 10: [2023-04-29 17:23:19,129] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 10: [2023-04-29 17:23:19,129] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 22: [2023-04-29 17:23:19,129] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 10: [2023-04-29 17:23:19,130] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 18: [2023-04-29 17:23:19,130] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 18: [2023-04-29 17:23:19,130] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 22: [2023-04-29 17:23:19,130] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 22: [2023-04-29 17:23:19,131] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 18: [2023-04-29 17:23:19,131] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 18: [2023-04-29 17:23:19,131] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 11: [2023-04-29 17:23:19,131] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 11: [2023-04-29 17:23:19,131] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 22: [2023-04-29 17:23:19,132] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 18: [2023-04-29 17:23:19,132] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 25: [2023-04-29 17:23:19,131] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 25: [2023-04-29 17:23:19,132] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 18: [2023-04-29 17:23:19,132] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 22: [2023-04-29 17:23:19,132] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 18: [2023-04-29 17:23:19,132] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 24: [2023-04-29 17:23:19,132] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 8: [2023-04-29 17:23:19,132] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 8: [2023-04-29 17:23:19,133] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 22: [2023-04-29 17:23:19,133] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 8: [2023-04-29 17:23:19,133] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 8: [2023-04-29 17:23:19,133] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 8: [2023-04-29 17:23:19,134] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 10: [2023-04-29 17:23:19,133] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 10: [2023-04-29 17:23:19,133] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 8: [2023-04-29 17:23:19,134] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 8: [2023-04-29 17:23:19,134] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 8: [2023-04-29 17:23:19,134] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 10: [2023-04-29 17:23:19,134] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 10: [2023-04-29 17:23:19,134] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 28: [2023-04-29 17:23:19,134] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 28: [2023-04-29 17:23:19,134] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 28: [2023-04-29 17:23:19,134] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 28: [2023-04-29 17:23:19,134] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 28: [2023-04-29 17:23:19,134] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 28: [2023-04-29 17:23:19,134] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 28: [2023-04-29 17:23:19,134] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 28: [2023-04-29 17:23:19,135] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 1: [2023-04-29 17:23:19,134] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 1: [2023-04-29 17:23:19,134] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 1: [2023-04-29 17:23:19,134] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 1: [2023-04-29 17:23:19,134] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 1: [2023-04-29 17:23:19,134] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 14: [2023-04-29 17:23:19,135] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 1: [2023-04-29 17:23:19,134] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 1: [2023-04-29 17:23:19,134] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 1: [2023-04-29 17:23:19,135] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 11: [2023-04-29 17:23:19,135] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 11: [2023-04-29 17:23:19,136] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 11: [2023-04-29 17:23:19,136] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 12: [2023-04-29 17:23:19,135] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 11: [2023-04-29 17:23:19,136] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 11: [2023-04-29 17:23:19,136] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 12: [2023-04-29 17:23:19,136] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 11: [2023-04-29 17:23:19,136] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 12: [2023-04-29 17:23:19,136] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 11: [2023-04-29 17:23:19,136] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 11: [2023-04-29 17:23:19,136] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 25: [2023-04-29 17:23:19,136] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 25: [2023-04-29 17:23:19,136] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 4: [2023-04-29 17:23:19,137] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 25: [2023-04-29 17:23:19,137] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 10: [2023-04-29 17:23:19,136] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 10: [2023-04-29 17:23:19,137] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 29: [2023-04-29 17:23:19,137] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 14: [2023-04-29 17:23:19,137] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 25: [2023-04-29 17:23:19,137] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 29: [2023-04-29 17:23:19,138] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 29: [2023-04-29 17:23:19,138] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 14: [2023-04-29 17:23:19,138] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 10: [2023-04-29 17:23:19,138] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 29: [2023-04-29 17:23:19,138] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 29: [2023-04-29 17:23:19,138] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 29: [2023-04-29 17:23:19,138] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 29: [2023-04-29 17:23:19,138] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 10: [2023-04-29 17:23:19,138] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 25: [2023-04-29 17:23:19,138] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 29: [2023-04-29 17:23:19,139] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 30: [2023-04-29 17:23:19,139] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 25: [2023-04-29 17:23:19,139] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 21: [2023-04-29 17:23:19,138] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 21: [2023-04-29 17:23:19,138] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 21: [2023-04-29 17:23:19,138] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 24: [2023-04-29 17:23:19,139] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 14: [2023-04-29 17:23:19,139] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 11: [2023-04-29 17:23:19,139] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 24: [2023-04-29 17:23:19,140] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 1: [2023-04-29 17:23:19,139] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 1: [2023-04-29 17:23:19,140] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 14: [2023-04-29 17:23:19,140] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 1: [2023-04-29 17:23:19,140] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 30: [2023-04-29 17:23:19,140] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 30: [2023-04-29 17:23:19,140] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 30: [2023-04-29 17:23:19,140] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 30: [2023-04-29 17:23:19,140] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 30: [2023-04-29 17:23:19,140] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 30: [2023-04-29 17:23:19,140] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 30: [2023-04-29 17:23:19,140] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 24: [2023-04-29 17:23:19,140] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 1: [2023-04-29 17:23:19,140] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 24: [2023-04-29 17:23:19,140] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 15: [2023-04-29 17:23:19,140] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 15: [2023-04-29 17:23:19,140] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 15: [2023-04-29 17:23:19,140] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 15: [2023-04-29 17:23:19,140] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 15: [2023-04-29 17:23:19,140] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 15: [2023-04-29 17:23:19,140] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 15: [2023-04-29 17:23:19,140] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 15: [2023-04-29 17:23:19,141] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 24: [2023-04-29 17:23:19,141] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 6: [2023-04-29 17:23:19,141] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 4: [2023-04-29 17:23:19,141] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 6: [2023-04-29 17:23:19,141] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 4: [2023-04-29 17:23:19,141] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 4: [2023-04-29 17:23:19,141] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 29: [2023-04-29 17:23:19,141] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 24: [2023-04-29 17:23:19,142] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 1: [2023-04-29 17:23:19,142] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 24: [2023-04-29 17:23:19,142] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 1: [2023-04-29 17:23:19,142] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 1: [2023-04-29 17:23:19,142] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 1: [2023-04-29 17:23:19,143] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 6: [2023-04-29 17:23:19,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 20: [2023-04-29 17:23:19,144] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 20: [2023-04-29 17:23:19,144] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 20: [2023-04-29 17:23:19,144] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 11: [2023-04-29 17:23:19,144] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 11: [2023-04-29 17:23:19,144] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 20: [2023-04-29 17:23:19,144] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 20: [2023-04-29 17:23:19,144] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 20: [2023-04-29 17:23:19,144] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 20: [2023-04-29 17:23:19,144] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 20: [2023-04-29 17:23:19,145] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 17: [2023-04-29 17:23:19,145] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 11: [2023-04-29 17:23:19,145] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 4: [2023-04-29 17:23:19,146] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 11: [2023-04-29 17:23:19,146] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 11: [2023-04-29 17:23:19,146] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 13: [2023-04-29 17:23:19,146] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 13: [2023-04-29 17:23:19,146] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 13: [2023-04-29 17:23:19,146] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 13: [2023-04-29 17:23:19,146] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 13: [2023-04-29 17:23:19,147] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 13: [2023-04-29 17:23:19,147] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 13: [2023-04-29 17:23:19,147] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 13: [2023-04-29 17:23:19,147] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 6: [2023-04-29 17:23:19,147] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 6: [2023-04-29 17:23:19,147] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 6: [2023-04-29 17:23:19,147] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 6: [2023-04-29 17:23:19,147] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 6: [2023-04-29 17:23:19,148] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 29: [2023-04-29 17:23:19,148] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 17: [2023-04-29 17:23:19,148] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 28: [2023-04-29 17:23:19,149] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 28: [2023-04-29 17:23:19,149] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 29: [2023-04-29 17:23:19,149] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 28: [2023-04-29 17:23:19,149] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 29: [2023-04-29 17:23:19,150] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 28: [2023-04-29 17:23:19,150] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 29: [2023-04-29 17:23:19,150] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 28: [2023-04-29 17:23:19,150] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 29: [2023-04-29 17:23:19,151] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 20: [2023-04-29 17:23:19,150] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 20: [2023-04-29 17:23:19,151] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 28: [2023-04-29 17:23:19,151] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 29: [2023-04-29 17:23:19,151] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 30: [2023-04-29 17:23:19,151] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 30: [2023-04-29 17:23:19,151] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 20: [2023-04-29 17:23:19,151] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 30: [2023-04-29 17:23:19,151] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 29: [2023-04-29 17:23:19,151] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 16: [2023-04-29 17:23:19,151] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 16: [2023-04-29 17:23:19,151] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 30: [2023-04-29 17:23:19,151] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 19: [2023-04-29 17:23:19,151] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 19: [2023-04-29 17:23:19,151] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 19: [2023-04-29 17:23:19,151] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 28: [2023-04-29 17:23:19,152] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 30: [2023-04-29 17:23:19,152] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 20: [2023-04-29 17:23:19,152] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 20: [2023-04-29 17:23:19,152] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 28: [2023-04-29 17:23:19,152] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 13: [2023-04-29 17:23:19,152] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 30: [2023-04-29 17:23:19,152] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 30: [2023-04-29 17:23:19,153] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 9: [2023-04-29 17:23:19,152] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 9: [2023-04-29 17:23:19,152] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 9: [2023-04-29 17:23:19,152] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 9: [2023-04-29 17:23:19,152] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 9: [2023-04-29 17:23:19,152] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 21: [2023-04-29 17:23:19,153] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 21: [2023-04-29 17:23:19,153] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 21: [2023-04-29 17:23:19,153] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 21: [2023-04-29 17:23:19,153] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 21: [2023-04-29 17:23:19,153] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 9: [2023-04-29 17:23:19,152] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 9: [2023-04-29 17:23:19,152] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 13: [2023-04-29 17:23:19,153] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 9: [2023-04-29 17:23:19,153] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 30: [2023-04-29 17:23:19,153] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 20: [2023-04-29 17:23:19,153] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 15: [2023-04-29 17:23:19,153] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 4: [2023-04-29 17:23:19,154] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 15: [2023-04-29 17:23:19,154] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 15: [2023-04-29 17:23:19,154] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 20: [2023-04-29 17:23:19,155] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 20: [2023-04-29 17:23:19,155] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 15: [2023-04-29 17:23:19,155] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 12: [2023-04-29 17:23:19,155] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 12: [2023-04-29 17:23:19,155] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 15: [2023-04-29 17:23:19,155] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 16: [2023-04-29 17:23:19,156] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 15: [2023-04-29 17:23:19,156] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 15: [2023-04-29 17:23:19,156] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 15: [2023-04-29 17:23:19,156] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 13: [2023-04-29 17:23:19,156] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 13: [2023-04-29 17:23:19,157] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 12: [2023-04-29 17:23:19,157] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 12: [2023-04-29 17:23:19,157] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 13: [2023-04-29 17:23:19,157] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 12: [2023-04-29 17:23:19,157] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 9: [2023-04-29 17:23:19,157] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 9: [2023-04-29 17:23:19,158] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 9: [2023-04-29 17:23:19,158] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 9: [2023-04-29 17:23:19,158] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 9: [2023-04-29 17:23:19,158] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 9: [2023-04-29 17:23:19,158] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 9: [2023-04-29 17:23:19,158] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 13: [2023-04-29 17:23:19,158] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 9: [2023-04-29 17:23:19,158] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 13: [2023-04-29 17:23:19,159] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 7: [2023-04-29 17:23:19,158] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 7: [2023-04-29 17:23:19,158] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 7: [2023-04-29 17:23:19,158] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 13: [2023-04-29 17:23:19,159] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 5: [2023-04-29 17:23:19,161] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 5: [2023-04-29 17:23:19,161] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 21: [2023-04-29 17:23:19,165] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 5: [2023-04-29 17:23:19,164] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 5: [2023-04-29 17:23:19,164] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 5: [2023-04-29 17:23:19,164] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 5: [2023-04-29 17:23:19,164] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 5: [2023-04-29 17:23:19,165] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 17: [2023-04-29 17:23:19,165] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 5: [2023-04-29 17:23:19,165] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 5: [2023-04-29 17:23:19,165] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 5: [2023-04-29 17:23:19,165] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 19: [2023-04-29 17:23:19,166] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 16: [2023-04-29 17:23:19,166] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 16: [2023-04-29 17:23:19,166] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 16: [2023-04-29 17:23:19,166] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 16: [2023-04-29 17:23:19,166] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 16: [2023-04-29 17:23:19,166] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 21: [2023-04-29 17:23:19,168] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 19: [2023-04-29 17:23:19,168] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 19: [2023-04-29 17:23:19,168] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 19: [2023-04-29 17:23:19,168] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 21: [2023-04-29 17:23:19,168] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 19: [2023-04-29 17:23:19,168] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 17: [2023-04-29 17:23:19,169] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 27: [2023-04-29 17:23:19,169] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 17: [2023-04-29 17:23:19,170] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 17: [2023-04-29 17:23:19,170] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 17: [2023-04-29 17:23:19,170] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 6: [2023-04-29 17:23:19,170] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 27: [2023-04-29 17:23:19,170] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 17: [2023-04-29 17:23:19,171] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 23: [2023-04-29 17:23:19,171] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 23: [2023-04-29 17:23:19,171] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 23: [2023-04-29 17:23:19,172] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 17: [2023-04-29 17:23:19,172] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 17: [2023-04-29 17:23:19,172] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 23: [2023-04-29 17:23:19,172] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 19: [2023-04-29 17:23:19,172] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 23: [2023-04-29 17:23:19,172] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 23: [2023-04-29 17:23:19,172] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 23: [2023-04-29 17:23:19,172] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 23: [2023-04-29 17:23:19,173] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 19: [2023-04-29 17:23:19,173] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 7: [2023-04-29 17:23:19,173] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 7: [2023-04-29 17:23:19,173] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 7: [2023-04-29 17:23:19,173] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 7: [2023-04-29 17:23:19,173] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 7: [2023-04-29 17:23:19,173] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 19: [2023-04-29 17:23:19,174] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 5: [2023-04-29 17:23:19,174] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 5: [2023-04-29 17:23:19,174] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 5: [2023-04-29 17:23:19,175] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 5: [2023-04-29 17:23:19,175] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 6: [2023-04-29 17:23:19,175] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 16: [2023-04-29 17:23:19,175] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 16: [2023-04-29 17:23:19,176] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 5: [2023-04-29 17:23:19,176] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 5: [2023-04-29 17:23:19,176] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 0: [2023-04-29 17:23:19,176] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 0: [2023-04-29 17:23:19,176] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 0: [2023-04-29 17:23:19,176] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 0: [2023-04-29 17:23:19,177] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 0: [2023-04-29 17:23:19,177] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 0: [2023-04-29 17:23:19,177] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 0: [2023-04-29 17:23:19,177] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 22: [2023-04-29 17:23:19,176] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 22: [2023-04-29 17:23:19,176] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 23: [2023-04-29 17:23:19,176] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 0: [2023-04-29 17:23:19,177] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 23: [2023-04-29 17:23:19,178] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 26: [2023-04-29 17:23:19,177] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 26: [2023-04-29 17:23:19,177] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 7: [2023-04-29 17:23:19,178] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 26: [2023-04-29 17:23:19,178] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 26: [2023-04-29 17:23:19,178] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 26: [2023-04-29 17:23:19,179] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 26: [2023-04-29 17:23:19,179] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 26: [2023-04-29 17:23:19,179] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 26: [2023-04-29 17:23:19,179] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 6: [2023-04-29 17:23:19,180] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 6: [2023-04-29 17:23:19,180] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 7: [2023-04-29 17:23:19,180] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 23: [2023-04-29 17:23:19,180] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 23: [2023-04-29 17:23:19,180] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 6: [2023-04-29 17:23:19,181] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 7: [2023-04-29 17:23:19,181] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 23: [2023-04-29 17:23:19,181] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 25: [2023-04-29 17:23:19,181] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 6: [2023-04-29 17:23:19,181] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 23: [2023-04-29 17:23:19,182] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 23: [2023-04-29 17:23:19,182] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 23: [2023-04-29 17:23:19,182] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 26: [2023-04-29 17:23:19,182] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 26: [2023-04-29 17:23:19,183] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 24: [2023-04-29 17:23:19,182] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 16: [2023-04-29 17:23:19,184] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 25: [2023-04-29 17:23:19,184] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 21: [2023-04-29 17:23:19,184] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 21: [2023-04-29 17:23:19,184] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 21: [2023-04-29 17:23:19,185] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 21: [2023-04-29 17:23:19,185] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 21: [2023-04-29 17:23:19,185] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 26: [2023-04-29 17:23:19,186] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 26: [2023-04-29 17:23:19,186] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 8: [2023-04-29 17:23:19,186] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 26: [2023-04-29 17:23:19,187] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 26: [2023-04-29 17:23:19,187] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 26: [2023-04-29 17:23:19,187] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 26: [2023-04-29 17:23:19,188] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt... 8: [2023-04-29 17:23:19,189] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 11: [2023-04-29 17:23:19,189] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 11: [2023-04-29 17:23:19,189] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 11: [2023-04-29 17:23:19,189] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 27: [2023-04-29 17:23:19,190] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 0: [2023-04-29 17:23:19,190] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 0: [2023-04-29 17:23:19,191] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 10: [2023-04-29 17:23:19,190] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 10: [2023-04-29 17:23:19,190] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 10: [2023-04-29 17:23:19,190] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 10: [2023-04-29 17:23:19,190] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 29: [2023-04-29 17:23:19,190] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 0: [2023-04-29 17:23:19,191] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 0: [2023-04-29 17:23:19,191] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 0: [2023-04-29 17:23:19,192] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 8: [2023-04-29 17:23:19,191] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 19: [2023-04-29 17:23:19,192] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 0: [2023-04-29 17:23:19,192] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 27: [2023-04-29 17:23:19,193] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 8: [2023-04-29 17:23:19,193] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 0: [2023-04-29 17:23:19,193] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 0: [2023-04-29 17:23:19,194] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 16: [2023-04-29 17:23:19,194] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 16: [2023-04-29 17:23:19,194] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 27: [2023-04-29 17:23:19,194] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 16: [2023-04-29 17:23:19,195] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 27: [2023-04-29 17:23:19,195] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 27: [2023-04-29 17:23:19,195] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 8: [2023-04-29 17:23:19,195] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 8: [2023-04-29 17:23:19,195] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 27: [2023-04-29 17:23:19,195] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 27: [2023-04-29 17:23:19,195] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 8: [2023-04-29 17:23:19,195] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 8: [2023-04-29 17:23:19,195] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 27: [2023-04-29 17:23:19,196] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 10: [2023-04-29 17:23:19,197] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 10: [2023-04-29 17:23:19,197] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 10: [2023-04-29 17:23:19,197] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 10: [2023-04-29 17:23:19,197] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 19: [2023-04-29 17:23:19,197] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 16: [2023-04-29 17:23:19,197] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 16: [2023-04-29 17:23:19,197] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 22: [2023-04-29 17:23:19,197] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 1: [2023-04-29 17:23:19,197] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 1: [2023-04-29 17:23:19,197] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 1: [2023-04-29 17:23:19,197] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 1: [2023-04-29 17:23:19,197] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 19: [2023-04-29 17:23:19,197] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 19: [2023-04-29 17:23:19,197] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 22: [2023-04-29 17:23:19,197] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 22: [2023-04-29 17:23:19,197] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 19: [2023-04-29 17:23:19,198] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 22: [2023-04-29 17:23:19,198] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 22: [2023-04-29 17:23:19,198] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 7: [2023-04-29 17:23:19,201] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 22: [2023-04-29 17:23:19,202] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 22: [2023-04-29 17:23:19,202] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 22: [2023-04-29 17:23:19,202] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 7: [2023-04-29 17:23:19,202] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 17: [2023-04-29 17:23:19,202] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 7: [2023-04-29 17:23:19,202] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 25: [2023-04-29 17:23:19,202] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 1: [2023-04-29 17:23:19,202] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 17: [2023-04-29 17:23:19,202] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 17: [2023-04-29 17:23:19,202] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 1: [2023-04-29 17:23:19,202] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 1: [2023-04-29 17:23:19,202] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 1: [2023-04-29 17:23:19,202] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 25: [2023-04-29 17:23:19,203] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 20: [2023-04-29 17:23:19,204] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 20: [2023-04-29 17:23:19,204] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 24: [2023-04-29 17:23:19,204] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 25: [2023-04-29 17:23:19,204] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 25: [2023-04-29 17:23:19,204] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 25: [2023-04-29 17:23:19,204] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 7: [2023-04-29 17:23:19,205] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 7: [2023-04-29 17:23:19,205] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 13: [2023-04-29 17:23:19,204] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 13: [2023-04-29 17:23:19,205] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 11: [2023-04-29 17:23:19,205] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 11: [2023-04-29 17:23:19,205] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 18: [2023-04-29 17:23:19,205] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 17: [2023-04-29 17:23:19,206] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 18: [2023-04-29 17:23:19,206] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 18: [2023-04-29 17:23:19,206] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 25: [2023-04-29 17:23:19,206] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 25: [2023-04-29 17:23:19,206] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 25: [2023-04-29 17:23:19,207] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 17: [2023-04-29 17:23:19,208] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 8: [2023-04-29 17:23:19,208] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 17: [2023-04-29 17:23:19,208] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 20: [2023-04-29 17:23:19,208] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 29: [2023-04-29 17:23:19,210] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 11: [2023-04-29 17:23:19,210] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 11: [2023-04-29 17:23:19,210] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 11: [2023-04-29 17:23:19,210] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 11: [2023-04-29 17:23:19,210] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 8: [2023-04-29 17:23:19,211] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 11: [2023-04-29 17:23:19,211] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 11: [2023-04-29 17:23:19,211] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 10: [2023-04-29 17:23:19,214] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 24: [2023-04-29 17:23:19,214] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 24: [2023-04-29 17:23:19,214] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 24: [2023-04-29 17:23:19,214] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 9: [2023-04-29 17:23:19,215] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 9: [2023-04-29 17:23:19,215] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 5: [2023-04-29 17:23:19,216] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 5: [2023-04-29 17:23:19,216] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 20: [2023-04-29 17:23:19,216] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 20: [2023-04-29 17:23:19,217] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 10: [2023-04-29 17:23:19,217] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 10: [2023-04-29 17:23:19,217] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 10: [2023-04-29 17:23:19,217] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 9: [2023-04-29 17:23:19,218] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 9: [2023-04-29 17:23:19,218] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 9: [2023-04-29 17:23:19,218] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 9: [2023-04-29 17:23:19,218] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 9: [2023-04-29 17:23:19,218] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 20: [2023-04-29 17:23:19,218] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 9: [2023-04-29 17:23:19,218] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 20: [2023-04-29 17:23:19,218] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 8: [2023-04-29 17:23:19,219] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 24: [2023-04-29 17:23:19,218] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 24: [2023-04-29 17:23:19,218] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 24: [2023-04-29 17:23:19,218] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 24: [2023-04-29 17:23:19,219] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 20: [2023-04-29 17:23:19,219] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 29: [2023-04-29 17:23:19,220] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 29: [2023-04-29 17:23:19,220] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 18: [2023-04-29 17:23:19,220] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 18: [2023-04-29 17:23:19,220] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 18: [2023-04-29 17:23:19,220] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 18: [2023-04-29 17:23:19,220] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 18: [2023-04-29 17:23:19,220] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 2: [2023-04-29 17:23:19,222] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 2: [2023-04-29 17:23:19,222] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 1: [2023-04-29 17:23:19,222] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 2: [2023-04-29 17:23:19,222] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 2: [2023-04-29 17:23:19,222] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 2: [2023-04-29 17:23:19,222] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 2: [2023-04-29 17:23:19,223] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 8: [2023-04-29 17:23:19,223] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 2: [2023-04-29 17:23:19,223] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 1: [2023-04-29 17:23:19,223] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 2: [2023-04-29 17:23:19,223] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 10: [2023-04-29 17:23:19,224] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 10: [2023-04-29 17:23:19,224] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 1: [2023-04-29 17:23:19,225] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 30: [2023-04-29 17:23:19,225] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 28: [2023-04-29 17:23:19,225] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 28: [2023-04-29 17:23:19,225] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 1: [2023-04-29 17:23:19,225] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 28: [2023-04-29 17:23:19,225] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 10: [2023-04-29 17:23:19,226] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 20: [2023-04-29 17:23:19,226] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 13: [2023-04-29 17:23:19,226] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 13: [2023-04-29 17:23:19,226] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 22: [2023-04-29 17:23:19,226] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 13: [2023-04-29 17:23:19,226] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 20: [2023-04-29 17:23:19,227] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 13: [2023-04-29 17:23:19,227] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 8: [2023-04-29 17:23:19,224] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 8: [2023-04-29 17:23:19,224] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 8: [2023-04-29 17:23:19,224] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 8: [2023-04-29 17:23:19,225] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 2: [2023-04-29 17:23:19,227] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 2: [2023-04-29 17:23:19,227] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 2: [2023-04-29 17:23:19,227] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 13: [2023-04-29 17:23:19,227] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 13: [2023-04-29 17:23:19,227] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 13: [2023-04-29 17:23:19,227] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 13: [2023-04-29 17:23:19,228] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 27: [2023-04-29 17:23:19,228] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 11: [2023-04-29 17:23:19,228] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 27: [2023-04-29 17:23:19,228] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 22: [2023-04-29 17:23:19,228] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 22: [2023-04-29 17:23:19,228] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 10: [2023-04-29 17:23:19,228] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 23: [2023-04-29 17:23:19,229] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 1: [2023-04-29 17:23:19,229] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 11: [2023-04-29 17:23:19,230] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 18: [2023-04-29 17:23:19,230] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 27: [2023-04-29 17:23:19,230] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 18: [2023-04-29 17:23:19,231] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 25: [2023-04-29 17:23:19,231] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 22: [2023-04-29 17:23:19,231] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 22: [2023-04-29 17:23:19,231] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 31: [2023-04-29 17:23:19,231] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 31: [2023-04-29 17:23:19,231] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 1: [2023-04-29 17:23:19,231] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 2: [2023-04-29 17:23:19,231] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 2: [2023-04-29 17:23:19,231] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 31: [2023-04-29 17:23:19,231] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 1: [2023-04-29 17:23:19,231] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 1: [2023-04-29 17:23:19,231] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 27: [2023-04-29 17:23:19,232] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 31: [2023-04-29 17:23:19,232] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 31: [2023-04-29 17:23:19,232] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 31: [2023-04-29 17:23:19,232] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 31: [2023-04-29 17:23:19,232] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 18: [2023-04-29 17:23:19,232] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 2: [2023-04-29 17:23:19,233] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 29: [2023-04-29 17:23:19,233] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 29: [2023-04-29 17:23:19,233] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 29: [2023-04-29 17:23:19,233] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 29: [2023-04-29 17:23:19,233] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 29: [2023-04-29 17:23:19,233] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 2: [2023-04-29 17:23:19,233] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 25: [2023-04-29 17:23:19,233] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 23: [2023-04-29 17:23:19,233] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 15: [2023-04-29 17:23:19,233] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 15: [2023-04-29 17:23:19,233] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 15: [2023-04-29 17:23:19,233] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 15: [2023-04-29 17:23:19,233] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 22: [2023-04-29 17:23:19,233] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 2: [2023-04-29 17:23:19,234] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 25: [2023-04-29 17:23:19,234] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 27: [2023-04-29 17:23:19,234] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 27: [2023-04-29 17:23:19,234] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 20: [2023-04-29 17:23:19,235] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 5: [2023-04-29 17:23:19,236] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 15: [2023-04-29 17:23:19,236] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 15: [2023-04-29 17:23:19,236] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 15: [2023-04-29 17:23:19,236] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 5: [2023-04-29 17:23:19,236] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 11: [2023-04-29 17:23:19,236] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 26: [2023-04-29 17:23:19,237] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 26: [2023-04-29 17:23:19,237] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 15: [2023-04-29 17:23:19,238] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 25: [2023-04-29 17:23:19,238] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 11: [2023-04-29 17:23:19,239] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 11: [2023-04-29 17:23:19,239] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 28: [2023-04-29 17:23:19,240] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 28: [2023-04-29 17:23:19,240] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 28: [2023-04-29 17:23:19,240] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 28: [2023-04-29 17:23:19,240] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 28: [2023-04-29 17:23:19,240] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 9: [2023-04-29 17:23:19,240] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 30: [2023-04-29 17:23:19,241] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 30: [2023-04-29 17:23:19,241] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 30: [2023-04-29 17:23:19,241] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 30: [2023-04-29 17:23:19,241] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 30: [2023-04-29 17:23:19,241] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 25: [2023-04-29 17:23:19,242] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 25: [2023-04-29 17:23:19,242] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 9: [2023-04-29 17:23:19,242] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 29: [2023-04-29 17:23:19,243] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 20: [2023-04-29 17:23:19,243] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 29: [2023-04-29 17:23:19,243] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 26: [2023-04-29 17:23:19,244] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 9: [2023-04-29 17:23:19,245] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 9: [2023-04-29 17:23:19,245] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 5: [2023-04-29 17:23:19,245] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 5: [2023-04-29 17:23:19,245] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 5: [2023-04-29 17:23:19,245] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 5: [2023-04-29 17:23:19,245] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 9: [2023-04-29 17:23:19,246] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 30: [2023-04-29 17:23:19,246] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 20: [2023-04-29 17:23:19,246] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 30: [2023-04-29 17:23:19,246] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 5: [2023-04-29 17:23:19,246] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 30: [2023-04-29 17:23:19,247] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 26: [2023-04-29 17:23:19,247] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 9: [2023-04-29 17:23:19,248] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 9: [2023-04-29 17:23:19,248] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 9: [2023-04-29 17:23:19,248] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 20: [2023-04-29 17:23:19,248] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 5: [2023-04-29 17:23:19,249] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 24: [2023-04-29 17:23:19,249] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 18: [2023-04-29 17:23:19,250] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 24: [2023-04-29 17:23:19,250] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 20: [2023-04-29 17:23:19,251] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 20: [2023-04-29 17:23:19,251] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 23: [2023-04-29 17:23:19,251] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 23: [2023-04-29 17:23:19,251] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 23: [2023-04-29 17:23:19,251] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 23: [2023-04-29 17:23:19,252] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 28: [2023-04-29 17:23:19,252] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 26: [2023-04-29 17:23:19,252] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 26: [2023-04-29 17:23:19,252] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 26: [2023-04-29 17:23:19,252] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 28: [2023-04-29 17:23:19,252] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 26: [2023-04-29 17:23:19,252] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 18: [2023-04-29 17:23:19,253] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 24: [2023-04-29 17:23:19,253] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 28: [2023-04-29 17:23:19,253] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 23: [2023-04-29 17:23:19,254] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 23: [2023-04-29 17:23:19,254] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 18: [2023-04-29 17:23:19,254] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 18: [2023-04-29 17:23:19,254] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 24: [2023-04-29 17:23:19,254] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 24: [2023-04-29 17:23:19,254] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 24: [2023-04-29 17:23:19,255] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 18: [2023-04-29 17:23:19,255] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 23: [2023-04-29 17:23:19,256] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 24: [2023-04-29 17:23:19,256] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 23: [2023-04-29 17:23:19,257] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_05-model_00-model_states.pt. 13: [2023-04-29 17:23:19,257] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 13: [2023-04-29 17:23:19,258] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 26: [2023-04-29 17:23:19,259] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 26: [2023-04-29 17:23:19,259] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 13: [2023-04-29 17:23:19,260] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 13: [2023-04-29 17:23:19,260] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 13: [2023-04-29 17:23:19,261] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 13: [2023-04-29 17:23:19,261] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 29: [2023-04-29 17:23:19,264] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 29: [2023-04-29 17:23:19,266] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 29: [2023-04-29 17:23:19,266] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 29: [2023-04-29 17:23:19,269] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 29: [2023-04-29 17:23:19,269] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 15: [2023-04-29 17:23:19,271] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 26: [2023-04-29 17:23:19,271] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 0: [2023-04-29 17:23:19,271] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 0: [2023-04-29 17:23:19,271] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 0: [2023-04-29 17:23:19,271] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 26: [2023-04-29 17:23:19,271] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 15: [2023-04-29 17:23:19,272] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 28: [2023-04-29 17:23:19,273] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 15: [2023-04-29 17:23:19,273] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 15: [2023-04-29 17:23:19,273] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 28: [2023-04-29 17:23:19,273] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 30: [2023-04-29 17:23:19,274] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 5: [2023-04-29 17:23:19,275] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 31: [2023-04-29 17:23:19,232] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 31: [2023-04-29 17:23:19,236] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 31: [2023-04-29 17:23:19,236] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 31: [2023-04-29 17:23:19,236] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 31: [2023-04-29 17:23:19,238] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 31: [2023-04-29 17:23:19,238] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 31: [2023-04-29 17:23:19,238] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 31: [2023-04-29 17:23:19,239] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 31: [2023-04-29 17:23:19,239] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 15: [2023-04-29 17:23:19,275] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 28: [2023-04-29 17:23:19,276] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 15: [2023-04-29 17:23:19,276] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 15: [2023-04-29 17:23:19,276] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 5: [2023-04-29 17:23:19,277] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 30: [2023-04-29 17:23:19,277] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 15: [2023-04-29 17:23:19,277] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 26: [2023-04-29 17:23:19,277] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 30: [2023-04-29 17:23:19,277] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 5: [2023-04-29 17:23:19,278] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 5: [2023-04-29 17:23:19,278] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 30: [2023-04-29 17:23:19,279] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 30: [2023-04-29 17:23:19,279] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 30: [2023-04-29 17:23:19,279] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 28: [2023-04-29 17:23:19,279] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 5: [2023-04-29 17:23:19,280] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 28: [2023-04-29 17:23:19,280] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 2: [2023-04-29 17:23:19,281] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 2: [2023-04-29 17:23:19,281] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 2: [2023-04-29 17:23:19,281] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 0: [2023-04-29 17:23:19,281] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 0: [2023-04-29 17:23:19,281] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 0: [2023-04-29 17:23:19,281] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 0: [2023-04-29 17:23:19,281] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 0: [2023-04-29 17:23:19,281] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 30: [2023-04-29 17:23:19,282] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 26: [2023-04-29 17:23:19,282] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 26: [2023-04-29 17:23:19,282] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 26: [2023-04-29 17:23:19,282] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 5: [2023-04-29 17:23:19,282] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 23: [2023-04-29 17:23:19,288] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 23: [2023-04-29 17:23:19,291] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 23: [2023-04-29 17:23:19,291] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 23: [2023-04-29 17:23:19,291] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 23: [2023-04-29 17:23:19,291] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 2: [2023-04-29 17:23:19,295] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 2: [2023-04-29 17:23:19,295] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 2: [2023-04-29 17:23:19,295] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 23: [2023-04-29 17:23:19,296] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 2: [2023-04-29 17:23:19,297] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 2: [2023-04-29 17:23:19,297] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 0: [2023-04-29 17:23:19,297] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 0: [2023-04-29 17:23:19,300] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 0: [2023-04-29 17:23:19,301] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 2: [2023-04-29 17:23:19,302] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 2: [2023-04-29 17:23:19,303] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 2: [2023-04-29 17:23:19,303] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 0: [2023-04-29 17:23:19,316] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 0: [2023-04-29 17:23:19,318] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 0: [2023-04-29 17:23:19,318] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 31: [2023-04-29 17:23:19,289] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 31: [2023-04-29 17:23:19,289] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 31: [2023-04-29 17:23:19,289] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 31: [2023-04-29 17:23:19,304] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 31: [2023-04-29 17:23:19,304] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 31: [2023-04-29 17:23:19,304] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 31: [2023-04-29 17:23:19,304] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 31: [2023-04-29 17:23:19,304] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 31: [2023-04-29 17:23:19,312] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 31: [2023-04-29 17:23:19,313] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 31: [2023-04-29 17:23:19,314] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 0: [2023-04-29 17:23:19,319] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 0: [2023-04-29 17:23:19,320] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 2: [2023-04-29 17:23:19,322] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 2: [2023-04-29 17:23:19,322] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 2: [2023-04-29 17:23:19,323] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 2: [2023-04-29 17:23:19,325] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 2: [2023-04-29 17:23:19,326] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 12: [2023-04-29 17:23:19,346] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 12: [2023-04-29 17:23:19,346] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 12: [2023-04-29 17:23:19,346] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 12: [2023-04-29 17:23:19,346] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 12: [2023-04-29 17:23:19,346] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 12: [2023-04-29 17:23:19,346] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 12: [2023-04-29 17:23:19,347] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 12: [2023-04-29 17:23:19,347] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 12: [2023-04-29 17:23:19,352] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 12: [2023-04-29 17:23:19,353] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 12: [2023-04-29 17:23:19,353] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 12: [2023-04-29 17:23:19,354] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 12: [2023-04-29 17:23:19,355] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 12: [2023-04-29 17:23:19,355] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 12: [2023-04-29 17:23:19,355] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 12: [2023-04-29 17:23:19,356] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 31: [2023-04-29 17:23:19,329] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 31: [2023-04-29 17:23:19,330] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 31: [2023-04-29 17:23:19,335] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 31: [2023-04-29 17:23:19,335] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 31: [2023-04-29 17:23:19,335] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 14: [2023-04-29 17:23:19,385] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 14: [2023-04-29 17:23:19,385] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 14: [2023-04-29 17:23:19,386] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 14: [2023-04-29 17:23:19,386] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 14: [2023-04-29 17:23:19,386] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 14: [2023-04-29 17:23:19,386] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 14: [2023-04-29 17:23:19,386] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 14: [2023-04-29 17:23:19,386] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 14: [2023-04-29 17:23:19,390] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 14: [2023-04-29 17:23:19,397] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 14: [2023-04-29 17:23:19,397] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 14: [2023-04-29 17:23:19,398] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 14: [2023-04-29 17:23:19,398] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 14: [2023-04-29 17:23:19,398] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 14: [2023-04-29 17:23:19,399] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 14: [2023-04-29 17:23:19,400] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 12: [2023-04-29 17:23:19,404] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 12: [2023-04-29 17:23:19,406] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 12: [2023-04-29 17:23:19,406] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 12: [2023-04-29 17:23:19,422] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 12: [2023-04-29 17:23:19,423] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 12: [2023-04-29 17:23:19,423] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 12: [2023-04-29 17:23:19,423] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 12: [2023-04-29 17:23:19,423] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 12: [2023-04-29 17:23:19,428] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 4: [2023-04-29 17:23:19,428] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 4: [2023-04-29 17:23:19,429] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 3: [2023-04-29 17:23:19,429] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 3: [2023-04-29 17:23:19,429] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 12: [2023-04-29 17:23:19,430] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 12: [2023-04-29 17:23:19,430] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 3: [2023-04-29 17:23:19,430] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 3: [2023-04-29 17:23:19,430] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 3: [2023-04-29 17:23:19,430] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 3: [2023-04-29 17:23:19,430] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 3: [2023-04-29 17:23:19,430] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 3: [2023-04-29 17:23:19,431] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 4: [2023-04-29 17:23:19,432] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 4: [2023-04-29 17:23:19,432] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 4: [2023-04-29 17:23:19,432] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 4: [2023-04-29 17:23:19,432] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 4: [2023-04-29 17:23:19,432] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 4: [2023-04-29 17:23:19,432] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 4: [2023-04-29 17:23:19,432] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 3: [2023-04-29 17:23:19,433] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 3: [2023-04-29 17:23:19,433] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 4: [2023-04-29 17:23:19,435] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 4: [2023-04-29 17:23:19,437] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 3: [2023-04-29 17:23:19,438] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 3: [2023-04-29 17:23:19,438] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 3: [2023-04-29 17:23:19,438] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 3: [2023-04-29 17:23:19,438] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 3: [2023-04-29 17:23:19,438] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 3: [2023-04-29 17:23:19,439] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 14: [2023-04-29 17:23:19,440] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 4: [2023-04-29 17:23:19,441] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 4: [2023-04-29 17:23:19,442] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 4: [2023-04-29 17:23:19,443] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 4: [2023-04-29 17:23:19,444] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 4: [2023-04-29 17:23:19,444] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 12: [2023-04-29 17:23:19,453] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 12: [2023-04-29 17:23:19,453] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 12: [2023-04-29 17:23:19,453] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 12: [2023-04-29 17:23:19,456] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 16: [2023-04-29 17:23:19,456] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 16: [2023-04-29 17:23:19,456] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 16: [2023-04-29 17:23:19,456] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 16: [2023-04-29 17:23:19,457] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 16: [2023-04-29 17:23:19,457] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 16: [2023-04-29 17:23:19,457] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 16: [2023-04-29 17:23:19,457] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 16: [2023-04-29 17:23:19,457] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 12: [2023-04-29 17:23:19,458] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 14: [2023-04-29 17:23:19,459] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 16: [2023-04-29 17:23:19,463] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 16: [2023-04-29 17:23:19,463] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 16: [2023-04-29 17:23:19,463] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 16: [2023-04-29 17:23:19,464] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 16: [2023-04-29 17:23:19,464] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 16: [2023-04-29 17:23:19,464] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 16: [2023-04-29 17:23:19,464] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 16: [2023-04-29 17:23:19,464] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 14: [2023-04-29 17:23:19,469] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 14: [2023-04-29 17:23:19,469] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 11: [2023-04-29 17:23:19,471] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 11: [2023-04-29 17:23:19,471] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 11: [2023-04-29 17:23:19,472] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 11: [2023-04-29 17:23:19,473] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 11: [2023-04-29 17:23:19,473] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 11: [2023-04-29 17:23:19,473] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 11: [2023-04-29 17:23:19,473] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 11: [2023-04-29 17:23:19,473] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 11: [2023-04-29 17:23:19,476] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 11: [2023-04-29 17:23:19,476] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 11: [2023-04-29 17:23:19,477] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 14: [2023-04-29 17:23:19,478] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 14: [2023-04-29 17:23:19,478] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 14: [2023-04-29 17:23:19,478] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 14: [2023-04-29 17:23:19,478] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 14: [2023-04-29 17:23:19,478] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 19: [2023-04-29 17:23:19,482] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 11: [2023-04-29 17:23:19,482] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 19: [2023-04-29 17:23:19,482] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 19: [2023-04-29 17:23:19,482] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 19: [2023-04-29 17:23:19,482] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 19: [2023-04-29 17:23:19,482] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 19: [2023-04-29 17:23:19,482] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 19: [2023-04-29 17:23:19,482] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 19: [2023-04-29 17:23:19,483] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 3: [2023-04-29 17:23:19,483] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 3: [2023-04-29 17:23:19,483] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 11: [2023-04-29 17:23:19,483] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 11: [2023-04-29 17:23:19,484] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 11: [2023-04-29 17:23:19,484] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 11: [2023-04-29 17:23:19,484] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 4: [2023-04-29 17:23:19,485] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 4: [2023-04-29 17:23:19,485] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 7: [2023-04-29 17:23:19,485] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 7: [2023-04-29 17:23:19,485] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 7: [2023-04-29 17:23:19,485] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 7: [2023-04-29 17:23:19,486] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 7: [2023-04-29 17:23:19,486] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 7: [2023-04-29 17:23:19,486] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 7: [2023-04-29 17:23:19,486] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 7: [2023-04-29 17:23:19,486] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 19: [2023-04-29 17:23:19,487] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 19: [2023-04-29 17:23:19,487] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 19: [2023-04-29 17:23:19,487] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 7: [2023-04-29 17:23:19,490] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 7: [2023-04-29 17:23:19,490] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 7: [2023-04-29 17:23:19,490] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 19: [2023-04-29 17:23:19,490] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 19: [2023-04-29 17:23:19,491] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 19: [2023-04-29 17:23:19,491] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 19: [2023-04-29 17:23:19,492] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 19: [2023-04-29 17:23:19,492] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 7: [2023-04-29 17:23:19,492] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 7: [2023-04-29 17:23:19,492] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 7: [2023-04-29 17:23:19,493] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 7: [2023-04-29 17:23:19,493] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 7: [2023-04-29 17:23:19,493] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 14: [2023-04-29 17:23:19,496] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 14: [2023-04-29 17:23:19,496] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 3: [2023-04-29 17:23:19,503] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 3: [2023-04-29 17:23:19,504] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 4: [2023-04-29 17:23:19,505] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 4: [2023-04-29 17:23:19,506] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 3: [2023-04-29 17:23:19,508] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 3: [2023-04-29 17:23:19,508] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 3: [2023-04-29 17:23:19,508] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 3: [2023-04-29 17:23:19,508] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 3: [2023-04-29 17:23:19,508] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 3: [2023-04-29 17:23:19,508] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 14: [2023-04-29 17:23:19,510] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 14: [2023-04-29 17:23:19,510] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 14: [2023-04-29 17:23:19,512] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 4: [2023-04-29 17:23:19,512] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 14: [2023-04-29 17:23:19,514] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 14: [2023-04-29 17:23:19,514] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 4: [2023-04-29 17:23:19,515] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 4: [2023-04-29 17:23:19,515] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 4: [2023-04-29 17:23:19,515] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 16: [2023-04-29 17:23:19,517] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 16: [2023-04-29 17:23:19,517] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 4: [2023-04-29 17:23:19,517] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 4: [2023-04-29 17:23:19,517] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 16: [2023-04-29 17:23:19,520] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 21: [2023-04-29 17:23:19,528] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 21: [2023-04-29 17:23:19,528] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 21: [2023-04-29 17:23:19,528] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 21: [2023-04-29 17:23:19,528] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 21: [2023-04-29 17:23:19,528] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 21: [2023-04-29 17:23:19,528] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 21: [2023-04-29 17:23:19,528] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 21: [2023-04-29 17:23:19,529] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 11: [2023-04-29 17:23:19,529] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 11: [2023-04-29 17:23:19,529] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 11: [2023-04-29 17:23:19,529] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 22: [2023-04-29 17:23:19,531] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 22: [2023-04-29 17:23:19,531] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 16: [2023-04-29 17:23:19,530] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 16: [2023-04-29 17:23:19,530] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 16: [2023-04-29 17:23:19,530] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 16: [2023-04-29 17:23:19,530] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 16: [2023-04-29 17:23:19,530] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 22: [2023-04-29 17:23:19,531] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 22: [2023-04-29 17:23:19,531] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 22: [2023-04-29 17:23:19,531] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 22: [2023-04-29 17:23:19,531] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 22: [2023-04-29 17:23:19,531] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 22: [2023-04-29 17:23:19,531] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 21: [2023-04-29 17:23:19,533] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 21: [2023-04-29 17:23:19,533] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 21: [2023-04-29 17:23:19,533] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 21: [2023-04-29 17:23:19,534] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 21: [2023-04-29 17:23:19,534] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 21: [2023-04-29 17:23:19,534] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 3: [2023-04-29 17:23:19,534] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 21: [2023-04-29 17:23:19,535] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 21: [2023-04-29 17:23:19,535] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 3: [2023-04-29 17:23:19,536] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 22: [2023-04-29 17:23:19,537] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 22: [2023-04-29 17:23:19,538] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 3: [2023-04-29 17:23:19,540] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 16: [2023-04-29 17:23:19,540] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 3: [2023-04-29 17:23:19,541] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 16: [2023-04-29 17:23:19,541] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 19: [2023-04-29 17:23:19,541] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 19: [2023-04-29 17:23:19,541] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 19: [2023-04-29 17:23:19,541] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 17: [2023-04-29 17:23:19,543] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 17: [2023-04-29 17:23:19,543] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 17: [2023-04-29 17:23:19,543] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 3: [2023-04-29 17:23:19,543] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 3: [2023-04-29 17:23:19,543] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 17: [2023-04-29 17:23:19,543] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 4: [2023-04-29 17:23:19,543] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 22: [2023-04-29 17:23:19,543] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 7: [2023-04-29 17:23:19,543] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 7: [2023-04-29 17:23:19,543] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 7: [2023-04-29 17:23:19,543] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 17: [2023-04-29 17:23:19,544] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 17: [2023-04-29 17:23:19,544] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 17: [2023-04-29 17:23:19,544] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 22: [2023-04-29 17:23:19,544] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 17: [2023-04-29 17:23:19,544] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 11: [2023-04-29 17:23:19,544] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 11: [2023-04-29 17:23:19,544] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 0: [2023-04-29 17:23:19,544] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 0: [2023-04-29 17:23:19,544] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 0: [2023-04-29 17:23:19,544] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 0: [2023-04-29 17:23:19,545] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 0: [2023-04-29 17:23:19,545] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 0: [2023-04-29 17:23:19,545] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 0: [2023-04-29 17:23:19,545] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 0: [2023-04-29 17:23:19,545] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 22: [2023-04-29 17:23:19,545] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 22: [2023-04-29 17:23:19,546] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 16: [2023-04-29 17:23:19,546] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 22: [2023-04-29 17:23:19,546] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 22: [2023-04-29 17:23:19,546] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 4: [2023-04-29 17:23:19,547] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 4: [2023-04-29 17:23:19,547] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 17: [2023-04-29 17:23:19,548] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 4: [2023-04-29 17:23:19,548] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 17: [2023-04-29 17:23:19,549] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 11: [2023-04-29 17:23:19,550] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 11: [2023-04-29 17:23:19,550] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 11: [2023-04-29 17:23:19,550] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 11: [2023-04-29 17:23:19,550] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 4: [2023-04-29 17:23:19,551] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 4: [2023-04-29 17:23:19,552] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 11: [2023-04-29 17:23:19,552] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 11: [2023-04-29 17:23:19,552] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 17: [2023-04-29 17:23:19,553] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 17: [2023-04-29 17:23:19,553] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 17: [2023-04-29 17:23:19,554] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 17: [2023-04-29 17:23:19,554] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 17: [2023-04-29 17:23:19,555] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 17: [2023-04-29 17:23:19,555] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 19: [2023-04-29 17:23:19,555] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 16: [2023-04-29 17:23:19,556] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 16: [2023-04-29 17:23:19,556] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 16: [2023-04-29 17:23:19,557] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 19: [2023-04-29 17:23:19,558] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 19: [2023-04-29 17:23:19,558] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 19: [2023-04-29 17:23:19,558] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 19: [2023-04-29 17:23:19,558] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 7: [2023-04-29 17:23:19,558] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 7: [2023-04-29 17:23:19,558] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 7: [2023-04-29 17:23:19,558] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 7: [2023-04-29 17:23:19,558] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 7: [2023-04-29 17:23:19,559] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 0: [2023-04-29 17:23:19,559] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 0: [2023-04-29 17:23:19,559] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 16: [2023-04-29 17:23:19,559] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 0: [2023-04-29 17:23:19,559] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 16: [2023-04-29 17:23:19,560] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 0: [2023-04-29 17:23:19,560] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 0: [2023-04-29 17:23:19,560] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 0: [2023-04-29 17:23:19,560] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 0: [2023-04-29 17:23:19,561] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 13: [2023-04-29 17:23:19,561] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 13: [2023-04-29 17:23:19,561] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 13: [2023-04-29 17:23:19,562] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 13: [2023-04-29 17:23:19,562] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 0: [2023-04-29 17:23:19,562] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 13: [2023-04-29 17:23:19,562] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 19: [2023-04-29 17:23:19,562] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 13: [2023-04-29 17:23:19,562] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 13: [2023-04-29 17:23:19,562] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 13: [2023-04-29 17:23:19,562] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 7: [2023-04-29 17:23:19,563] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 19: [2023-04-29 17:23:19,564] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 19: [2023-04-29 17:23:19,564] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 7: [2023-04-29 17:23:19,564] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 7: [2023-04-29 17:23:19,565] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 11: [2023-04-29 17:23:19,567] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 13: [2023-04-29 17:23:19,567] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 13: [2023-04-29 17:23:19,568] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 11: [2023-04-29 17:23:19,570] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 13: [2023-04-29 17:23:19,571] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 31: [2023-04-29 17:23:19,571] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 31: [2023-04-29 17:23:19,571] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 31: [2023-04-29 17:23:19,571] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 13: [2023-04-29 17:23:19,571] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 31: [2023-04-29 17:23:19,571] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 31: [2023-04-29 17:23:19,571] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 31: [2023-04-29 17:23:19,571] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 31: [2023-04-29 17:23:19,571] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 31: [2023-04-29 17:23:19,572] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 13: [2023-04-29 17:23:19,572] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 13: [2023-04-29 17:23:19,573] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 13: [2023-04-29 17:23:19,573] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 13: [2023-04-29 17:23:19,574] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 31: [2023-04-29 17:23:19,575] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 31: [2023-04-29 17:23:19,575] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 31: [2023-04-29 17:23:19,576] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 11: [2023-04-29 17:23:19,577] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 31: [2023-04-29 17:23:19,577] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 27: [2023-04-29 17:23:19,577] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 27: [2023-04-29 17:23:19,577] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 27: [2023-04-29 17:23:19,577] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 27: [2023-04-29 17:23:19,578] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 31: [2023-04-29 17:23:19,578] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 11: [2023-04-29 17:23:19,578] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 31: [2023-04-29 17:23:19,578] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 27: [2023-04-29 17:23:19,578] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 27: [2023-04-29 17:23:19,578] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 27: [2023-04-29 17:23:19,578] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 11: [2023-04-29 17:23:19,578] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 31: [2023-04-29 17:23:19,578] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 27: [2023-04-29 17:23:19,578] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 31: [2023-04-29 17:23:19,579] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 10: [2023-04-29 17:23:19,580] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 10: [2023-04-29 17:23:19,580] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 10: [2023-04-29 17:23:19,581] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 10: [2023-04-29 17:23:19,581] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 10: [2023-04-29 17:23:19,582] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 10: [2023-04-29 17:23:19,582] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 10: [2023-04-29 17:23:19,582] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 10: [2023-04-29 17:23:19,582] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 27: [2023-04-29 17:23:19,583] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 27: [2023-04-29 17:23:19,584] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 19: [2023-04-29 17:23:19,584] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 8: [2023-04-29 17:23:19,584] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 8: [2023-04-29 17:23:19,584] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 8: [2023-04-29 17:23:19,584] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 8: [2023-04-29 17:23:19,584] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 8: [2023-04-29 17:23:19,584] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 8: [2023-04-29 17:23:19,584] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 8: [2023-04-29 17:23:19,584] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 8: [2023-04-29 17:23:19,585] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 10: [2023-04-29 17:23:19,586] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 10: [2023-04-29 17:23:19,586] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 10: [2023-04-29 17:23:19,587] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 10: [2023-04-29 17:23:19,587] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 21: [2023-04-29 17:23:19,587] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 21: [2023-04-29 17:23:19,587] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 21: [2023-04-29 17:23:19,587] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 7: [2023-04-29 17:23:19,587] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 7: [2023-04-29 17:23:19,588] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 7: [2023-04-29 17:23:19,588] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 27: [2023-04-29 17:23:19,588] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 7: [2023-04-29 17:23:19,589] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 27: [2023-04-29 17:23:19,589] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 22: [2023-04-29 17:23:19,588] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 22: [2023-04-29 17:23:19,588] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 7: [2023-04-29 17:23:19,589] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 19: [2023-04-29 17:23:19,589] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 10: [2023-04-29 17:23:19,589] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 10: [2023-04-29 17:23:19,590] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 27: [2023-04-29 17:23:19,590] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 27: [2023-04-29 17:23:19,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 10: [2023-04-29 17:23:19,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 8: [2023-04-29 17:23:19,590] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 8: [2023-04-29 17:23:19,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 10: [2023-04-29 17:23:19,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 19: [2023-04-29 17:23:19,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 27: [2023-04-29 17:23:19,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 19: [2023-04-29 17:23:19,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 27: [2023-04-29 17:23:19,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 29: [2023-04-29 17:23:19,591] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 8: [2023-04-29 17:23:19,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 6: [2023-04-29 17:23:19,592] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 6: [2023-04-29 17:23:19,592] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 29: [2023-04-29 17:23:19,592] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 29: [2023-04-29 17:23:19,592] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 29: [2023-04-29 17:23:19,592] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 8: [2023-04-29 17:23:19,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 29: [2023-04-29 17:23:19,593] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 29: [2023-04-29 17:23:19,593] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 29: [2023-04-29 17:23:19,593] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 6: [2023-04-29 17:23:19,593] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 1: [2023-04-29 17:23:19,592] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 1: [2023-04-29 17:23:19,592] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 1: [2023-04-29 17:23:19,592] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 1: [2023-04-29 17:23:19,592] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 1: [2023-04-29 17:23:19,592] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 1: [2023-04-29 17:23:19,592] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 1: [2023-04-29 17:23:19,592] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 6: [2023-04-29 17:23:19,593] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 6: [2023-04-29 17:23:19,593] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 6: [2023-04-29 17:23:19,593] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 6: [2023-04-29 17:23:19,593] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 8: [2023-04-29 17:23:19,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 29: [2023-04-29 17:23:19,593] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 1: [2023-04-29 17:23:19,593] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 6: [2023-04-29 17:23:19,593] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 8: [2023-04-29 17:23:19,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 23: [2023-04-29 17:23:19,593] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 19: [2023-04-29 17:23:19,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 8: [2023-04-29 17:23:19,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 23: [2023-04-29 17:23:19,594] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 23: [2023-04-29 17:23:19,594] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 8: [2023-04-29 17:23:19,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 23: [2023-04-29 17:23:19,594] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 23: [2023-04-29 17:23:19,594] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 23: [2023-04-29 17:23:19,594] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 23: [2023-04-29 17:23:19,594] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 23: [2023-04-29 17:23:19,595] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 29: [2023-04-29 17:23:19,596] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 6: [2023-04-29 17:23:19,596] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 6: [2023-04-29 17:23:19,597] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 1: [2023-04-29 17:23:19,597] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 1: [2023-04-29 17:23:19,597] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 25: [2023-04-29 17:23:19,597] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 25: [2023-04-29 17:23:19,597] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 25: [2023-04-29 17:23:19,597] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 25: [2023-04-29 17:23:19,597] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 25: [2023-04-29 17:23:19,597] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 25: [2023-04-29 17:23:19,597] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 25: [2023-04-29 17:23:19,597] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 1: [2023-04-29 17:23:19,598] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 25: [2023-04-29 17:23:19,598] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 24: [2023-04-29 17:23:19,597] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 24: [2023-04-29 17:23:19,598] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 24: [2023-04-29 17:23:19,598] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 24: [2023-04-29 17:23:19,598] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 24: [2023-04-29 17:23:19,598] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 24: [2023-04-29 17:23:19,598] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 24: [2023-04-29 17:23:19,598] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 1: [2023-04-29 17:23:19,598] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 23: [2023-04-29 17:23:19,598] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 24: [2023-04-29 17:23:19,598] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 1: [2023-04-29 17:23:19,599] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 1: [2023-04-29 17:23:19,600] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 23: [2023-04-29 17:23:19,600] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 1: [2023-04-29 17:23:19,600] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 21: [2023-04-29 17:23:19,600] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 21: [2023-04-29 17:23:19,600] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 21: [2023-04-29 17:23:19,600] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 21: [2023-04-29 17:23:19,600] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 21: [2023-04-29 17:23:19,600] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 1: [2023-04-29 17:23:19,601] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 25: [2023-04-29 17:23:19,601] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 25: [2023-04-29 17:23:19,602] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 17: [2023-04-29 17:23:19,601] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 17: [2023-04-29 17:23:19,601] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 24: [2023-04-29 17:23:19,602] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 6: [2023-04-29 17:23:19,602] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 6: [2023-04-29 17:23:19,602] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 6: [2023-04-29 17:23:19,603] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 6: [2023-04-29 17:23:19,603] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 6: [2023-04-29 17:23:19,604] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 6: [2023-04-29 17:23:19,604] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 23: [2023-04-29 17:23:19,604] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 29: [2023-04-29 17:23:19,604] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 29: [2023-04-29 17:23:19,604] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 29: [2023-04-29 17:23:19,605] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 29: [2023-04-29 17:23:19,605] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 23: [2023-04-29 17:23:19,605] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 29: [2023-04-29 17:23:19,605] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 23: [2023-04-29 17:23:19,605] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 23: [2023-04-29 17:23:19,606] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 23: [2023-04-29 17:23:19,606] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 23: [2023-04-29 17:23:19,606] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 29: [2023-04-29 17:23:19,606] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 29: [2023-04-29 17:23:19,606] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 25: [2023-04-29 17:23:19,607] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 25: [2023-04-29 17:23:19,607] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 25: [2023-04-29 17:23:19,608] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 25: [2023-04-29 17:23:19,608] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 25: [2023-04-29 17:23:19,609] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 24: [2023-04-29 17:23:19,609] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 25: [2023-04-29 17:23:19,609] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 21: [2023-04-29 17:23:19,609] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 24: [2023-04-29 17:23:19,610] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 24: [2023-04-29 17:23:19,610] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 24: [2023-04-29 17:23:19,611] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 24: [2023-04-29 17:23:19,611] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 24: [2023-04-29 17:23:19,612] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 22: [2023-04-29 17:23:19,611] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 22: [2023-04-29 17:23:19,612] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 24: [2023-04-29 17:23:19,612] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 22: [2023-04-29 17:23:19,613] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 20: [2023-04-29 17:23:19,613] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 20: [2023-04-29 17:23:19,613] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 22: [2023-04-29 17:23:19,613] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 21: [2023-04-29 17:23:19,614] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 22: [2023-04-29 17:23:19,614] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 20: [2023-04-29 17:23:19,615] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 22: [2023-04-29 17:23:19,615] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 22: [2023-04-29 17:23:19,615] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 22: [2023-04-29 17:23:19,615] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 20: [2023-04-29 17:23:19,616] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 20: [2023-04-29 17:23:19,616] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 20: [2023-04-29 17:23:19,616] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 20: [2023-04-29 17:23:19,616] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 20: [2023-04-29 17:23:19,616] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 21: [2023-04-29 17:23:19,618] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 13: [2023-04-29 17:23:19,619] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 17: [2023-04-29 17:23:19,620] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 20: [2023-04-29 17:23:19,620] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 20: [2023-04-29 17:23:19,620] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 17: [2023-04-29 17:23:19,620] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 13: [2023-04-29 17:23:19,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 20: [2023-04-29 17:23:19,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 20: [2023-04-29 17:23:19,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 20: [2023-04-29 17:23:19,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 20: [2023-04-29 17:23:19,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 20: [2023-04-29 17:23:19,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 20: [2023-04-29 17:23:19,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 17: [2023-04-29 17:23:19,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 17: [2023-04-29 17:23:19,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 17: [2023-04-29 17:23:19,626] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 17: [2023-04-29 17:23:19,626] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 17: [2023-04-29 17:23:19,626] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 17: [2023-04-29 17:23:19,627] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 31: [2023-04-29 17:23:19,628] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 31: [2023-04-29 17:23:19,628] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 31: [2023-04-29 17:23:19,628] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 21: [2023-04-29 17:23:19,630] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 21: [2023-04-29 17:23:19,630] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 21: [2023-04-29 17:23:19,631] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 21: [2023-04-29 17:23:19,633] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 21: [2023-04-29 17:23:19,633] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 27: [2023-04-29 17:23:19,635] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 27: [2023-04-29 17:23:19,638] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 0: [2023-04-29 17:23:19,639] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 0: [2023-04-29 17:23:19,639] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 0: [2023-04-29 17:23:19,639] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 13: [2023-04-29 17:23:19,640] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 13: [2023-04-29 17:23:19,640] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 13: [2023-04-29 17:23:19,640] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 13: [2023-04-29 17:23:19,640] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 2: [2023-04-29 17:23:19,641] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 2: [2023-04-29 17:23:19,641] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 22: [2023-04-29 17:23:19,641] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 2: [2023-04-29 17:23:19,641] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 2: [2023-04-29 17:23:19,642] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 2: [2023-04-29 17:23:19,642] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 2: [2023-04-29 17:23:19,642] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 2: [2023-04-29 17:23:19,642] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 22: [2023-04-29 17:23:19,642] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 2: [2023-04-29 17:23:19,643] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 13: [2023-04-29 17:23:19,643] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 13: [2023-04-29 17:23:19,643] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 13: [2023-04-29 17:23:19,643] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 31: [2023-04-29 17:23:19,643] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 31: [2023-04-29 17:23:19,643] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 31: [2023-04-29 17:23:19,643] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 31: [2023-04-29 17:23:19,643] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 22: [2023-04-29 17:23:19,643] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 31: [2023-04-29 17:23:19,643] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 10: [2023-04-29 17:23:19,644] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 10: [2023-04-29 17:23:19,644] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 10: [2023-04-29 17:23:19,644] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 10: [2023-04-29 17:23:19,644] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 13: [2023-04-29 17:23:19,644] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 17: [2023-04-29 17:23:19,645] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 8: [2023-04-29 17:23:19,645] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 8: [2023-04-29 17:23:19,645] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 2: [2023-04-29 17:23:19,646] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 29: [2023-04-29 17:23:19,645] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 2: [2023-04-29 17:23:19,646] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 2: [2023-04-29 17:23:19,646] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 30: [2023-04-29 17:23:19,647] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 17: [2023-04-29 17:23:19,647] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 30: [2023-04-29 17:23:19,647] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 30: [2023-04-29 17:23:19,647] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 30: [2023-04-29 17:23:19,647] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 30: [2023-04-29 17:23:19,647] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 30: [2023-04-29 17:23:19,647] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 30: [2023-04-29 17:23:19,647] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 8: [2023-04-29 17:23:19,648] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 30: [2023-04-29 17:23:19,648] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 0: [2023-04-29 17:23:19,648] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 0: [2023-04-29 17:23:19,648] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 0: [2023-04-29 17:23:19,648] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 6: [2023-04-29 17:23:19,648] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 6: [2023-04-29 17:23:19,648] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 5: [2023-04-29 17:23:19,648] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 5: [2023-04-29 17:23:19,648] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 31: [2023-04-29 17:23:19,649] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 9: [2023-04-29 17:23:19,648] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 9: [2023-04-29 17:23:19,648] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 9: [2023-04-29 17:23:19,648] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 9: [2023-04-29 17:23:19,648] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 9: [2023-04-29 17:23:19,648] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 26: [2023-04-29 17:23:19,648] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 26: [2023-04-29 17:23:19,649] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 26: [2023-04-29 17:23:19,649] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 26: [2023-04-29 17:23:19,649] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 26: [2023-04-29 17:23:19,649] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 9: [2023-04-29 17:23:19,648] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 9: [2023-04-29 17:23:19,648] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 5: [2023-04-29 17:23:19,649] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 26: [2023-04-29 17:23:19,649] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 26: [2023-04-29 17:23:19,649] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 28: [2023-04-29 17:23:19,648] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 28: [2023-04-29 17:23:19,648] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 28: [2023-04-29 17:23:19,649] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 5: [2023-04-29 17:23:19,649] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 5: [2023-04-29 17:23:19,649] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 5: [2023-04-29 17:23:19,649] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 9: [2023-04-29 17:23:19,649] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 26: [2023-04-29 17:23:19,649] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 5: [2023-04-29 17:23:19,649] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 28: [2023-04-29 17:23:19,649] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 28: [2023-04-29 17:23:19,649] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 28: [2023-04-29 17:23:19,649] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 28: [2023-04-29 17:23:19,649] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 5: [2023-04-29 17:23:19,649] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 28: [2023-04-29 17:23:19,649] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 10: [2023-04-29 17:23:19,649] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 10: [2023-04-29 17:23:19,649] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 10: [2023-04-29 17:23:19,649] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 10: [2023-04-29 17:23:19,650] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 22: [2023-04-29 17:23:19,650] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 22: [2023-04-29 17:23:19,650] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 31: [2023-04-29 17:23:19,651] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 31: [2023-04-29 17:23:19,651] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 22: [2023-04-29 17:23:19,651] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 23: [2023-04-29 17:23:19,651] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 2: [2023-04-29 17:23:19,651] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 2: [2023-04-29 17:23:19,652] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 5: [2023-04-29 17:23:19,652] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 0: [2023-04-29 17:23:19,652] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 24: [2023-04-29 17:23:19,652] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 5: [2023-04-29 17:23:19,652] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 0: [2023-04-29 17:23:19,652] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 25: [2023-04-29 17:23:19,652] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 25: [2023-04-29 17:23:19,652] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 23: [2023-04-29 17:23:19,653] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 8: [2023-04-29 17:23:19,653] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 8: [2023-04-29 17:23:19,653] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 2: [2023-04-29 17:23:19,653] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 2: [2023-04-29 17:23:19,654] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 2: [2023-04-29 17:23:19,654] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 9: [2023-04-29 17:23:19,653] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 9: [2023-04-29 17:23:19,654] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 9: [2023-04-29 17:23:19,654] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 9: [2023-04-29 17:23:19,654] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 9: [2023-04-29 17:23:19,654] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 8: [2023-04-29 17:23:19,654] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 8: [2023-04-29 17:23:19,654] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 8: [2023-04-29 17:23:19,654] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 9: [2023-04-29 17:23:19,654] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 9: [2023-04-29 17:23:19,654] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 9: [2023-04-29 17:23:19,654] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 17: [2023-04-29 17:23:19,655] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 1: [2023-04-29 17:23:19,655] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 1: [2023-04-29 17:23:19,655] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 1: [2023-04-29 17:23:19,655] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 1: [2023-04-29 17:23:19,655] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 26: [2023-04-29 17:23:19,656] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 26: [2023-04-29 17:23:19,656] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 26: [2023-04-29 17:23:19,657] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 26: [2023-04-29 17:23:19,657] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 26: [2023-04-29 17:23:19,657] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 26: [2023-04-29 17:23:19,657] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 26: [2023-04-29 17:23:19,657] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 27: [2023-04-29 17:23:19,657] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 17: [2023-04-29 17:23:19,658] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 26: [2023-04-29 17:23:19,658] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 17: [2023-04-29 17:23:19,658] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 27: [2023-04-29 17:23:19,658] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 27: [2023-04-29 17:23:19,658] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 17: [2023-04-29 17:23:19,658] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 30: [2023-04-29 17:23:19,658] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 30: [2023-04-29 17:23:19,659] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 30: [2023-04-29 17:23:19,659] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 5: [2023-04-29 17:23:19,659] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 30: [2023-04-29 17:23:19,659] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 5: [2023-04-29 17:23:19,659] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 30: [2023-04-29 17:23:19,659] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 5: [2023-04-29 17:23:19,660] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 30: [2023-04-29 17:23:19,660] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 30: [2023-04-29 17:23:19,660] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 1: [2023-04-29 17:23:19,660] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 1: [2023-04-29 17:23:19,660] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 1: [2023-04-29 17:23:19,660] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 1: [2023-04-29 17:23:19,660] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 5: [2023-04-29 17:23:19,661] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 15: [2023-04-29 17:23:19,660] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 15: [2023-04-29 17:23:19,660] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 15: [2023-04-29 17:23:19,660] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 15: [2023-04-29 17:23:19,660] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 15: [2023-04-29 17:23:19,660] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 15: [2023-04-29 17:23:19,660] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 15: [2023-04-29 17:23:19,660] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 15: [2023-04-29 17:23:19,661] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 5: [2023-04-29 17:23:19,661] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 27: [2023-04-29 17:23:19,661] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 27: [2023-04-29 17:23:19,661] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 5: [2023-04-29 17:23:19,661] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 30: [2023-04-29 17:23:19,661] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 28: [2023-04-29 17:23:19,661] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 28: [2023-04-29 17:23:19,661] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 28: [2023-04-29 17:23:19,662] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 27: [2023-04-29 17:23:19,662] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 27: [2023-04-29 17:23:19,662] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 28: [2023-04-29 17:23:19,663] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 28: [2023-04-29 17:23:19,663] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 27: [2023-04-29 17:23:19,663] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 28: [2023-04-29 17:23:19,663] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 28: [2023-04-29 17:23:19,664] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 28: [2023-04-29 17:23:19,664] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 29: [2023-04-29 17:23:19,665] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 0: [2023-04-29 17:23:19,665] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 18: [2023-04-29 17:23:19,665] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 18: [2023-04-29 17:23:19,665] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 18: [2023-04-29 17:23:19,665] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 18: [2023-04-29 17:23:19,665] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 18: [2023-04-29 17:23:19,665] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 18: [2023-04-29 17:23:19,665] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 18: [2023-04-29 17:23:19,665] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 18: [2023-04-29 17:23:19,666] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 0: [2023-04-29 17:23:19,667] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 0: [2023-04-29 17:23:19,668] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 8: [2023-04-29 17:23:19,669] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 8: [2023-04-29 17:23:19,669] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 10: [2023-04-29 17:23:19,668] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 13: [2023-04-29 17:23:19,669] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 6: [2023-04-29 17:23:19,669] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 6: [2023-04-29 17:23:19,669] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 13: [2023-04-29 17:23:19,669] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 6: [2023-04-29 17:23:19,671] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 31: [2023-04-29 17:23:19,671] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 31: [2023-04-29 17:23:19,671] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 10: [2023-04-29 17:23:19,671] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 13: [2023-04-29 17:23:19,672] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 23: [2023-04-29 17:23:19,673] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 25: [2023-04-29 17:23:19,673] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 15: [2023-04-29 17:23:19,673] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 15: [2023-04-29 17:23:19,673] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 10: [2023-04-29 17:23:19,673] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 10: [2023-04-29 17:23:19,674] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 15: [2023-04-29 17:23:19,674] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 31: [2023-04-29 17:23:19,674] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 31: [2023-04-29 17:23:19,674] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 15: [2023-04-29 17:23:19,674] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 25: [2023-04-29 17:23:19,674] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 8: [2023-04-29 17:23:19,674] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 31: [2023-04-29 17:23:19,674] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 24: [2023-04-29 17:23:19,674] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 13: [2023-04-29 17:23:19,674] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 23: [2023-04-29 17:23:19,675] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 23: [2023-04-29 17:23:19,675] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 23: [2023-04-29 17:23:19,675] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 15: [2023-04-29 17:23:19,675] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 13: [2023-04-29 17:23:19,675] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 15: [2023-04-29 17:23:19,676] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 15: [2023-04-29 17:23:19,676] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 15: [2023-04-29 17:23:19,676] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 25: [2023-04-29 17:23:19,676] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 25: [2023-04-29 17:23:19,676] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 25: [2023-04-29 17:23:19,676] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 25: [2023-04-29 17:23:19,676] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 23: [2023-04-29 17:23:19,676] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 6: [2023-04-29 17:23:19,676] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 6: [2023-04-29 17:23:19,676] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 6: [2023-04-29 17:23:19,676] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 6: [2023-04-29 17:23:19,676] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 6: [2023-04-29 17:23:19,676] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 13: [2023-04-29 17:23:19,677] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 23: [2023-04-29 17:23:19,677] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 23: [2023-04-29 17:23:19,678] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 20: [2023-04-29 17:23:19,678] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 20: [2023-04-29 17:23:19,678] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 23: [2023-04-29 17:23:19,678] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 29: [2023-04-29 17:23:19,678] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 29: [2023-04-29 17:23:19,678] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 18: [2023-04-29 17:23:19,678] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 18: [2023-04-29 17:23:19,679] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 10: [2023-04-29 17:23:19,679] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 18: [2023-04-29 17:23:19,679] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 20: [2023-04-29 17:23:19,679] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 10: [2023-04-29 17:23:19,679] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 25: [2023-04-29 17:23:19,679] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 25: [2023-04-29 17:23:19,679] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 18: [2023-04-29 17:23:19,679] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 18: [2023-04-29 17:23:19,680] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 1: [2023-04-29 17:23:19,679] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 1: [2023-04-29 17:23:19,680] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 18: [2023-04-29 17:23:19,680] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 1: [2023-04-29 17:23:19,681] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 10: [2023-04-29 17:23:19,681] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 18: [2023-04-29 17:23:19,681] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 18: [2023-04-29 17:23:19,681] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt... 8: [2023-04-29 17:23:19,682] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 8: [2023-04-29 17:23:19,682] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 8: [2023-04-29 17:23:19,683] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 10: [2023-04-29 17:23:19,683] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 1: [2023-04-29 17:23:19,683] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 29: [2023-04-29 17:23:19,683] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 29: [2023-04-29 17:23:19,683] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 29: [2023-04-29 17:23:19,683] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 29: [2023-04-29 17:23:19,683] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 29: [2023-04-29 17:23:19,683] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 8: [2023-04-29 17:23:19,683] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 8: [2023-04-29 17:23:19,684] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 24: [2023-04-29 17:23:19,684] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 24: [2023-04-29 17:23:19,684] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 24: [2023-04-29 17:23:19,684] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 20: [2023-04-29 17:23:19,685] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 20: [2023-04-29 17:23:19,685] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 20: [2023-04-29 17:23:19,685] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 0: [2023-04-29 17:23:19,685] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 0: [2023-04-29 17:23:19,686] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 0: [2023-04-29 17:23:19,686] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 0: [2023-04-29 17:23:19,686] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 24: [2023-04-29 17:23:19,687] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 24: [2023-04-29 17:23:19,687] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 24: [2023-04-29 17:23:19,688] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 1: [2023-04-29 17:23:19,688] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 24: [2023-04-29 17:23:19,688] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 20: [2023-04-29 17:23:19,688] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 20: [2023-04-29 17:23:19,688] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 0: [2023-04-29 17:23:19,689] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 1: [2023-04-29 17:23:19,689] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 1: [2023-04-29 17:23:19,689] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 1: [2023-04-29 17:23:19,689] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 27: [2023-04-29 17:23:19,689] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 6: [2023-04-29 17:23:19,696] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 27: [2023-04-29 17:23:19,696] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 27: [2023-04-29 17:23:19,697] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 27: [2023-04-29 17:23:19,698] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 27: [2023-04-29 17:23:19,699] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 27: [2023-04-29 17:23:19,699] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 12: [2023-04-29 17:23:19,699] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 12: [2023-04-29 17:23:19,699] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 12: [2023-04-29 17:23:19,700] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 12: [2023-04-29 17:23:19,700] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 12: [2023-04-29 17:23:19,700] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 12: [2023-04-29 17:23:19,700] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 12: [2023-04-29 17:23:19,700] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 2: [2023-04-29 17:23:19,699] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 2: [2023-04-29 17:23:19,699] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 2: [2023-04-29 17:23:19,699] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 12: [2023-04-29 17:23:19,700] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 20: [2023-04-29 17:23:19,702] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 5: [2023-04-29 17:23:19,702] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 5: [2023-04-29 17:23:19,702] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 25: [2023-04-29 17:23:19,704] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 23: [2023-04-29 17:23:19,705] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 20: [2023-04-29 17:23:19,705] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 12: [2023-04-29 17:23:19,705] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 23: [2023-04-29 17:23:19,705] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 12: [2023-04-29 17:23:19,706] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 12: [2023-04-29 17:23:19,706] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 23: [2023-04-29 17:23:19,706] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 25: [2023-04-29 17:23:19,706] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 20: [2023-04-29 17:23:19,707] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 23: [2023-04-29 17:23:19,707] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 6: [2023-04-29 17:23:19,707] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 12: [2023-04-29 17:23:19,708] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 12: [2023-04-29 17:23:19,708] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 6: [2023-04-29 17:23:19,708] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 12: [2023-04-29 17:23:19,709] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 23: [2023-04-29 17:23:19,709] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 12: [2023-04-29 17:23:19,709] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 6: [2023-04-29 17:23:19,709] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 6: [2023-04-29 17:23:19,710] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 12: [2023-04-29 17:23:19,710] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 6: [2023-04-29 17:23:19,710] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 25: [2023-04-29 17:23:19,710] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 26: [2023-04-29 17:23:19,711] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 26: [2023-04-29 17:23:19,711] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 20: [2023-04-29 17:23:19,711] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 25: [2023-04-29 17:23:19,711] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 20: [2023-04-29 17:23:19,712] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 20: [2023-04-29 17:23:19,712] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 9: [2023-04-29 17:23:19,712] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 9: [2023-04-29 17:23:19,712] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 9: [2023-04-29 17:23:19,712] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 9: [2023-04-29 17:23:19,712] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 25: [2023-04-29 17:23:19,712] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 23: [2023-04-29 17:23:19,713] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 25: [2023-04-29 17:23:19,713] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 26: [2023-04-29 17:23:19,713] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 2: [2023-04-29 17:23:19,714] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 2: [2023-04-29 17:23:19,714] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 20: [2023-04-29 17:23:19,715] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 9: [2023-04-29 17:23:19,715] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 9: [2023-04-29 17:23:19,715] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 9: [2023-04-29 17:23:19,715] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 9: [2023-04-29 17:23:19,715] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 24: [2023-04-29 17:23:19,716] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 20: [2023-04-29 17:23:19,717] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 26: [2023-04-29 17:23:19,718] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 2: [2023-04-29 17:23:19,719] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 2: [2023-04-29 17:23:19,719] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 2: [2023-04-29 17:23:19,719] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 2: [2023-04-29 17:23:19,720] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 24: [2023-04-29 17:23:19,721] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 24: [2023-04-29 17:23:19,721] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 24: [2023-04-29 17:23:19,721] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 24: [2023-04-29 17:23:19,722] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 26: [2023-04-29 17:23:19,722] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 26: [2023-04-29 17:23:19,722] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 26: [2023-04-29 17:23:19,722] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 26: [2023-04-29 17:23:19,722] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 14: [2023-04-29 17:23:19,722] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 24: [2023-04-29 17:23:19,722] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 5: [2023-04-29 17:23:19,722] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 14: [2023-04-29 17:23:19,722] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 5: [2023-04-29 17:23:19,723] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 14: [2023-04-29 17:23:19,723] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 2: [2023-04-29 17:23:19,723] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 2: [2023-04-29 17:23:19,723] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 14: [2023-04-29 17:23:19,723] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 14: [2023-04-29 17:23:19,723] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 14: [2023-04-29 17:23:19,723] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 14: [2023-04-29 17:23:19,723] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 24: [2023-04-29 17:23:19,723] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 14: [2023-04-29 17:23:19,723] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 14: [2023-04-29 17:23:19,726] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 29: [2023-04-29 17:23:19,704] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 29: [2023-04-29 17:23:19,706] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 29: [2023-04-29 17:23:19,716] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 29: [2023-04-29 17:23:19,717] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 29: [2023-04-29 17:23:19,717] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 29: [2023-04-29 17:23:19,721] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 29: [2023-04-29 17:23:19,721] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 5: [2023-04-29 17:23:19,729] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 5: [2023-04-29 17:23:19,729] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 5: [2023-04-29 17:23:19,729] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 5: [2023-04-29 17:23:19,729] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 30: [2023-04-29 17:23:19,729] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 5: [2023-04-29 17:23:19,730] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 5: [2023-04-29 17:23:19,730] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 14: [2023-04-29 17:23:19,733] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 14: [2023-04-29 17:23:19,734] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 14: [2023-04-29 17:23:19,735] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 14: [2023-04-29 17:23:19,735] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 26: [2023-04-29 17:23:19,735] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 26: [2023-04-29 17:23:19,735] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 14: [2023-04-29 17:23:19,735] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 14: [2023-04-29 17:23:19,735] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 14: [2023-04-29 17:23:19,736] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 2: [2023-04-29 17:23:19,737] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 28: [2023-04-29 17:23:19,737] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 28: [2023-04-29 17:23:19,737] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 28: [2023-04-29 17:23:19,737] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 2: [2023-04-29 17:23:19,738] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 26: [2023-04-29 17:23:19,740] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 9: [2023-04-29 17:23:19,740] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 9: [2023-04-29 17:23:19,740] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 9: [2023-04-29 17:23:19,741] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 9: [2023-04-29 17:23:19,741] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 26: [2023-04-29 17:23:19,742] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 9: [2023-04-29 17:23:19,743] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 9: [2023-04-29 17:23:19,743] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 9: [2023-04-29 17:23:19,744] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 9: [2023-04-29 17:23:19,744] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 2: [2023-04-29 17:23:19,745] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 2: [2023-04-29 17:23:19,745] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 2: [2023-04-29 17:23:19,747] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 26: [2023-04-29 17:23:19,748] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 30: [2023-04-29 17:23:19,751] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 30: [2023-04-29 17:23:19,751] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 30: [2023-04-29 17:23:19,751] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 30: [2023-04-29 17:23:19,751] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 30: [2023-04-29 17:23:19,751] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 30: [2023-04-29 17:23:19,751] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 30: [2023-04-29 17:23:19,751] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 30: [2023-04-29 17:23:19,751] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 26: [2023-04-29 17:23:19,752] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 26: [2023-04-29 17:23:19,752] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 26: [2023-04-29 17:23:19,752] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 15: [2023-04-29 17:23:19,753] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 15: [2023-04-29 17:23:19,753] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 15: [2023-04-29 17:23:19,753] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 15: [2023-04-29 17:23:19,753] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 15: [2023-04-29 17:23:19,756] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 15: [2023-04-29 17:23:19,756] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 15: [2023-04-29 17:23:19,756] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 15: [2023-04-29 17:23:19,756] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 18: [2023-04-29 17:23:19,756] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 28: [2023-04-29 17:23:19,756] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 28: [2023-04-29 17:23:19,756] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 28: [2023-04-29 17:23:19,756] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 28: [2023-04-29 17:23:19,756] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 18: [2023-04-29 17:23:19,756] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 18: [2023-04-29 17:23:19,756] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 28: [2023-04-29 17:23:19,756] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 5: [2023-04-29 17:23:19,759] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 12: [2023-04-29 17:23:19,759] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 12: [2023-04-29 17:23:19,759] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 12: [2023-04-29 17:23:19,761] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 28: [2023-04-29 17:23:19,762] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 5: [2023-04-29 17:23:19,763] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 5: [2023-04-29 17:23:19,763] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 28: [2023-04-29 17:23:19,763] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 5: [2023-04-29 17:23:19,764] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 28: [2023-04-29 17:23:19,764] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 5: [2023-04-29 17:23:19,765] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 18: [2023-04-29 17:23:19,765] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 18: [2023-04-29 17:23:19,765] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 18: [2023-04-29 17:23:19,765] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 18: [2023-04-29 17:23:19,765] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 18: [2023-04-29 17:23:19,765] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_06-model_00-model_states.pt. 5: [2023-04-29 17:23:19,766] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 12: [2023-04-29 17:23:19,773] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 12: [2023-04-29 17:23:19,775] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 12: [2023-04-29 17:23:19,775] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 12: [2023-04-29 17:23:19,775] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 12: [2023-04-29 17:23:19,775] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 14: [2023-04-29 17:23:19,777] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 12: [2023-04-29 17:23:19,782] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 12: [2023-04-29 17:23:19,782] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 18: [2023-04-29 17:23:19,784] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 18: [2023-04-29 17:23:19,784] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 12: [2023-04-29 17:23:19,785] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 18: [2023-04-29 17:23:19,785] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 30: [2023-04-29 17:23:19,786] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 15: [2023-04-29 17:23:19,786] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 15: [2023-04-29 17:23:19,787] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 28: [2023-04-29 17:23:19,787] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 28: [2023-04-29 17:23:19,787] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 28: [2023-04-29 17:23:19,788] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 30: [2023-04-29 17:23:19,788] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 30: [2023-04-29 17:23:19,788] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 28: [2023-04-29 17:23:19,788] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 30: [2023-04-29 17:23:19,789] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 30: [2023-04-29 17:23:19,789] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 15: [2023-04-29 17:23:19,790] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 28: [2023-04-29 17:23:19,791] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 15: [2023-04-29 17:23:19,791] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 15: [2023-04-29 17:23:19,792] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 30: [2023-04-29 17:23:19,792] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 30: [2023-04-29 17:23:19,792] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 15: [2023-04-29 17:23:19,794] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 15: [2023-04-29 17:23:19,796] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 15: [2023-04-29 17:23:19,796] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 14: [2023-04-29 17:23:19,796] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 18: [2023-04-29 17:23:19,800] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 18: [2023-04-29 17:23:19,800] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 18: [2023-04-29 17:23:19,801] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 18: [2023-04-29 17:23:19,801] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 18: [2023-04-29 17:23:19,802] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 12: [2023-04-29 17:23:19,802] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 12: [2023-04-29 17:23:19,804] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 12: [2023-04-29 17:23:19,805] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 12: [2023-04-29 17:23:19,806] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 12: [2023-04-29 17:23:19,806] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 14: [2023-04-29 17:23:19,806] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 14: [2023-04-29 17:23:19,807] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 14: [2023-04-29 17:23:19,814] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 14: [2023-04-29 17:23:19,814] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 14: [2023-04-29 17:23:19,814] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 14: [2023-04-29 17:23:19,814] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 14: [2023-04-29 17:23:19,814] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 14: [2023-04-29 17:23:19,831] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 14: [2023-04-29 17:23:19,834] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 16: [2023-04-29 17:23:19,843] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 16: [2023-04-29 17:23:19,843] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 16: [2023-04-29 17:23:19,843] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 16: [2023-04-29 17:23:19,844] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 16: [2023-04-29 17:23:19,844] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 16: [2023-04-29 17:23:19,844] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 16: [2023-04-29 17:23:19,844] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 16: [2023-04-29 17:23:19,844] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 14: [2023-04-29 17:23:19,846] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 14: [2023-04-29 17:23:19,848] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 14: [2023-04-29 17:23:19,850] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 14: [2023-04-29 17:23:19,850] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 16: [2023-04-29 17:23:19,849] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 16: [2023-04-29 17:23:19,850] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 16: [2023-04-29 17:23:19,850] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 16: [2023-04-29 17:23:19,850] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 16: [2023-04-29 17:23:19,850] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 16: [2023-04-29 17:23:19,851] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 16: [2023-04-29 17:23:19,851] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 14: [2023-04-29 17:23:19,851] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 16: [2023-04-29 17:23:19,851] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 21: [2023-04-29 17:23:19,897] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 21: [2023-04-29 17:23:19,897] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 21: [2023-04-29 17:23:19,897] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 21: [2023-04-29 17:23:19,897] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 21: [2023-04-29 17:23:19,897] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 21: [2023-04-29 17:23:19,897] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 21: [2023-04-29 17:23:19,897] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 21: [2023-04-29 17:23:19,898] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 21: [2023-04-29 17:23:19,901] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 21: [2023-04-29 17:23:19,902] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 21: [2023-04-29 17:23:19,902] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 21: [2023-04-29 17:23:19,903] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 21: [2023-04-29 17:23:19,903] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 21: [2023-04-29 17:23:19,904] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 21: [2023-04-29 17:23:19,904] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 16: [2023-04-29 17:23:19,904] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 16: [2023-04-29 17:23:19,904] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 21: [2023-04-29 17:23:19,904] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 3: [2023-04-29 17:23:19,904] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 3: [2023-04-29 17:23:19,904] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 3: [2023-04-29 17:23:19,905] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 3: [2023-04-29 17:23:19,905] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 3: [2023-04-29 17:23:19,905] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 3: [2023-04-29 17:23:19,905] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 3: [2023-04-29 17:23:19,905] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 3: [2023-04-29 17:23:19,905] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 16: [2023-04-29 17:23:19,909] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 3: [2023-04-29 17:23:19,909] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 16: [2023-04-29 17:23:19,909] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 3: [2023-04-29 17:23:19,909] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 3: [2023-04-29 17:23:19,912] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 3: [2023-04-29 17:23:19,912] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 3: [2023-04-29 17:23:19,912] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 3: [2023-04-29 17:23:19,913] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 3: [2023-04-29 17:23:19,913] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 3: [2023-04-29 17:23:19,913] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 16: [2023-04-29 17:23:19,920] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 16: [2023-04-29 17:23:19,920] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 16: [2023-04-29 17:23:19,920] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 16: [2023-04-29 17:23:19,920] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 16: [2023-04-29 17:23:19,926] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 16: [2023-04-29 17:23:19,926] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 13: [2023-04-29 17:23:19,928] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 13: [2023-04-29 17:23:19,928] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 13: [2023-04-29 17:23:19,929] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 13: [2023-04-29 17:23:19,930] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 13: [2023-04-29 17:23:19,930] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 13: [2023-04-29 17:23:19,930] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 13: [2023-04-29 17:23:19,930] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 13: [2023-04-29 17:23:19,930] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 16: [2023-04-29 17:23:19,933] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 13: [2023-04-29 17:23:19,933] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 16: [2023-04-29 17:23:19,935] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 13: [2023-04-29 17:23:19,935] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 13: [2023-04-29 17:23:19,939] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 13: [2023-04-29 17:23:19,940] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 13: [2023-04-29 17:23:19,941] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 13: [2023-04-29 17:23:19,941] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 13: [2023-04-29 17:23:19,941] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 13: [2023-04-29 17:23:19,942] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 16: [2023-04-29 17:23:19,946] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 16: [2023-04-29 17:23:19,946] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 16: [2023-04-29 17:23:19,946] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 16: [2023-04-29 17:23:19,947] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 21: [2023-04-29 17:23:19,956] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 21: [2023-04-29 17:23:19,956] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 21: [2023-04-29 17:23:19,956] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 19: [2023-04-29 17:23:19,959] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 19: [2023-04-29 17:23:19,959] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 3: [2023-04-29 17:23:19,960] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 3: [2023-04-29 17:23:19,960] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 19: [2023-04-29 17:23:19,961] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 19: [2023-04-29 17:23:19,961] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 19: [2023-04-29 17:23:19,961] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 19: [2023-04-29 17:23:19,961] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 19: [2023-04-29 17:23:19,961] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 19: [2023-04-29 17:23:19,962] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 19: [2023-04-29 17:23:19,963] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 19: [2023-04-29 17:23:19,964] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 19: [2023-04-29 17:23:19,965] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 4: [2023-04-29 17:23:19,967] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 4: [2023-04-29 17:23:19,967] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 4: [2023-04-29 17:23:19,968] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 4: [2023-04-29 17:23:19,968] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 4: [2023-04-29 17:23:19,968] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 4: [2023-04-29 17:23:19,968] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 4: [2023-04-29 17:23:19,968] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 4: [2023-04-29 17:23:19,968] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 21: [2023-04-29 17:23:19,969] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 21: [2023-04-29 17:23:19,969] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 21: [2023-04-29 17:23:19,969] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 21: [2023-04-29 17:23:19,969] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 21: [2023-04-29 17:23:19,969] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 19: [2023-04-29 17:23:19,970] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 19: [2023-04-29 17:23:19,971] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 19: [2023-04-29 17:23:19,971] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 19: [2023-04-29 17:23:19,971] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 17: [2023-04-29 17:23:19,971] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 19: [2023-04-29 17:23:19,972] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 4: [2023-04-29 17:23:19,972] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 4: [2023-04-29 17:23:19,972] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 17: [2023-04-29 17:23:19,972] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 17: [2023-04-29 17:23:19,972] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 17: [2023-04-29 17:23:19,972] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 17: [2023-04-29 17:23:19,972] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 17: [2023-04-29 17:23:19,972] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 17: [2023-04-29 17:23:19,972] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 17: [2023-04-29 17:23:19,973] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 6: [2023-04-29 17:23:19,974] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 6: [2023-04-29 17:23:19,974] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 6: [2023-04-29 17:23:19,974] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 6: [2023-04-29 17:23:19,974] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 6: [2023-04-29 17:23:19,974] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 6: [2023-04-29 17:23:19,974] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 6: [2023-04-29 17:23:19,974] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 6: [2023-04-29 17:23:19,974] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 17: [2023-04-29 17:23:19,977] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 17: [2023-04-29 17:23:19,978] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 6: [2023-04-29 17:23:19,978] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 6: [2023-04-29 17:23:19,978] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 3: [2023-04-29 17:23:19,980] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 4: [2023-04-29 17:23:19,979] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 4: [2023-04-29 17:23:19,980] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 21: [2023-04-29 17:23:19,981] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 21: [2023-04-29 17:23:19,981] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 21: [2023-04-29 17:23:19,981] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 4: [2023-04-29 17:23:19,981] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 4: [2023-04-29 17:23:19,981] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 3: [2023-04-29 17:23:19,981] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 4: [2023-04-29 17:23:19,981] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 4: [2023-04-29 17:23:19,982] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 3: [2023-04-29 17:23:19,983] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 3: [2023-04-29 17:23:19,983] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 3: [2023-04-29 17:23:19,983] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 3: [2023-04-29 17:23:19,983] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 3: [2023-04-29 17:23:19,983] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 3: [2023-04-29 17:23:19,983] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 17: [2023-04-29 17:23:19,983] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 17: [2023-04-29 17:23:19,983] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 6: [2023-04-29 17:23:19,983] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 6: [2023-04-29 17:23:19,983] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 6: [2023-04-29 17:23:19,984] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 6: [2023-04-29 17:23:19,984] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 17: [2023-04-29 17:23:19,984] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 17: [2023-04-29 17:23:19,985] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 6: [2023-04-29 17:23:19,985] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 17: [2023-04-29 17:23:19,985] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 6: [2023-04-29 17:23:19,985] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 17: [2023-04-29 17:23:19,985] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 13: [2023-04-29 17:23:19,985] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 29: [2023-04-29 17:23:19,986] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 29: [2023-04-29 17:23:19,987] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 29: [2023-04-29 17:23:19,987] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 29: [2023-04-29 17:23:19,987] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 29: [2023-04-29 17:23:19,987] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 29: [2023-04-29 17:23:19,987] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 29: [2023-04-29 17:23:19,987] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 29: [2023-04-29 17:23:19,988] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 13: [2023-04-29 17:23:19,988] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 11: [2023-04-29 17:23:19,989] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 11: [2023-04-29 17:23:19,989] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 11: [2023-04-29 17:23:19,990] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 11: [2023-04-29 17:23:19,991] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 11: [2023-04-29 17:23:19,991] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 11: [2023-04-29 17:23:19,991] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 11: [2023-04-29 17:23:19,991] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 11: [2023-04-29 17:23:19,991] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 29: [2023-04-29 17:23:19,991] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 0: [2023-04-29 17:23:19,992] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 0: [2023-04-29 17:23:19,992] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 0: [2023-04-29 17:23:19,992] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 0: [2023-04-29 17:23:19,993] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 0: [2023-04-29 17:23:19,993] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 0: [2023-04-29 17:23:19,993] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 0: [2023-04-29 17:23:19,993] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 0: [2023-04-29 17:23:19,993] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 11: [2023-04-29 17:23:19,994] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 11: [2023-04-29 17:23:19,994] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 11: [2023-04-29 17:23:19,995] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 21: [2023-04-29 17:23:19,997] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 21: [2023-04-29 17:23:19,997] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 21: [2023-04-29 17:23:19,997] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 31: [2023-04-29 17:23:19,998] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 31: [2023-04-29 17:23:19,998] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 31: [2023-04-29 17:23:19,998] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 31: [2023-04-29 17:23:19,998] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 31: [2023-04-29 17:23:19,998] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 31: [2023-04-29 17:23:19,998] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 31: [2023-04-29 17:23:19,998] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 29: [2023-04-29 17:23:19,998] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 31: [2023-04-29 17:23:19,998] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 21: [2023-04-29 17:23:19,999] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 21: [2023-04-29 17:23:19,999] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 29: [2023-04-29 17:23:20,000] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 29: [2023-04-29 17:23:20,000] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 29: [2023-04-29 17:23:20,000] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 11: [2023-04-29 17:23:20,000] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 29: [2023-04-29 17:23:20,000] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 29: [2023-04-29 17:23:20,001] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 11: [2023-04-29 17:23:20,001] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 31: [2023-04-29 17:23:20,001] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 11: [2023-04-29 17:23:20,002] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 29: [2023-04-29 17:23:20,002] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 11: [2023-04-29 17:23:20,002] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 31: [2023-04-29 17:23:20,002] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 11: [2023-04-29 17:23:20,002] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 31: [2023-04-29 17:23:20,002] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 31: [2023-04-29 17:23:20,003] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 31: [2023-04-29 17:23:20,004] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 31: [2023-04-29 17:23:20,004] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 0: [2023-04-29 17:23:20,005] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 31: [2023-04-29 17:23:20,005] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 31: [2023-04-29 17:23:20,005] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 0: [2023-04-29 17:23:20,006] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 0: [2023-04-29 17:23:20,006] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 13: [2023-04-29 17:23:20,006] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 23: [2023-04-29 17:23:20,006] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 23: [2023-04-29 17:23:20,006] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 23: [2023-04-29 17:23:20,007] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 0: [2023-04-29 17:23:20,007] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 23: [2023-04-29 17:23:20,007] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 23: [2023-04-29 17:23:20,007] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 23: [2023-04-29 17:23:20,007] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 23: [2023-04-29 17:23:20,007] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 23: [2023-04-29 17:23:20,007] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 0: [2023-04-29 17:23:20,008] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 20: [2023-04-29 17:23:20,008] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 20: [2023-04-29 17:23:20,008] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 0: [2023-04-29 17:23:20,008] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 0: [2023-04-29 17:23:20,008] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 0: [2023-04-29 17:23:20,009] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 13: [2023-04-29 17:23:20,010] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 13: [2023-04-29 17:23:20,010] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 13: [2023-04-29 17:23:20,010] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 7: [2023-04-29 17:23:20,010] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 7: [2023-04-29 17:23:20,010] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 13: [2023-04-29 17:23:20,010] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 13: [2023-04-29 17:23:20,010] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 7: [2023-04-29 17:23:20,010] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 13: [2023-04-29 17:23:20,010] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 13: [2023-04-29 17:23:20,010] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 7: [2023-04-29 17:23:20,011] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 7: [2023-04-29 17:23:20,011] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 7: [2023-04-29 17:23:20,011] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 7: [2023-04-29 17:23:20,011] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 7: [2023-04-29 17:23:20,011] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 20: [2023-04-29 17:23:20,011] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 23: [2023-04-29 17:23:20,011] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 3: [2023-04-29 17:23:20,011] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 20: [2023-04-29 17:23:20,012] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 20: [2023-04-29 17:23:20,012] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 23: [2023-04-29 17:23:20,012] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 20: [2023-04-29 17:23:20,012] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 20: [2023-04-29 17:23:20,012] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 8: [2023-04-29 17:23:20,011] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 8: [2023-04-29 17:23:20,011] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 8: [2023-04-29 17:23:20,011] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 8: [2023-04-29 17:23:20,011] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 8: [2023-04-29 17:23:20,011] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 8: [2023-04-29 17:23:20,011] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 8: [2023-04-29 17:23:20,011] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 8: [2023-04-29 17:23:20,012] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 20: [2023-04-29 17:23:20,012] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 3: [2023-04-29 17:23:20,012] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 20: [2023-04-29 17:23:20,013] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 20: [2023-04-29 17:23:20,014] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 3: [2023-04-29 17:23:20,015] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 3: [2023-04-29 17:23:20,015] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 7: [2023-04-29 17:23:20,015] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 7: [2023-04-29 17:23:20,015] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 7: [2023-04-29 17:23:20,015] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 3: [2023-04-29 17:23:20,016] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 3: [2023-04-29 17:23:20,017] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 20: [2023-04-29 17:23:20,017] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 23: [2023-04-29 17:23:20,017] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 7: [2023-04-29 17:23:20,017] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 7: [2023-04-29 17:23:20,017] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 7: [2023-04-29 17:23:20,017] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 23: [2023-04-29 17:23:20,017] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 7: [2023-04-29 17:23:20,017] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 8: [2023-04-29 17:23:20,017] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 8: [2023-04-29 17:23:20,018] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 23: [2023-04-29 17:23:20,018] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 7: [2023-04-29 17:23:20,018] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 23: [2023-04-29 17:23:20,018] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 23: [2023-04-29 17:23:20,018] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 8: [2023-04-29 17:23:20,019] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 19: [2023-04-29 17:23:20,019] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 19: [2023-04-29 17:23:20,019] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 19: [2023-04-29 17:23:20,019] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 23: [2023-04-29 17:23:20,019] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 8: [2023-04-29 17:23:20,020] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 8: [2023-04-29 17:23:20,020] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 12: [2023-04-29 17:23:20,020] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 8: [2023-04-29 17:23:20,020] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 12: [2023-04-29 17:23:20,020] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 12: [2023-04-29 17:23:20,020] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 20: [2023-04-29 17:23:20,020] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 20: [2023-04-29 17:23:20,020] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 12: [2023-04-29 17:23:20,021] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 12: [2023-04-29 17:23:20,021] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 12: [2023-04-29 17:23:20,021] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 12: [2023-04-29 17:23:20,021] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 12: [2023-04-29 17:23:20,021] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 20: [2023-04-29 17:23:20,021] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 8: [2023-04-29 17:23:20,022] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 8: [2023-04-29 17:23:20,022] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 20: [2023-04-29 17:23:20,022] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 20: [2023-04-29 17:23:20,022] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 4: [2023-04-29 17:23:20,023] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 4: [2023-04-29 17:23:20,023] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 12: [2023-04-29 17:23:20,026] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 12: [2023-04-29 17:23:20,027] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 12: [2023-04-29 17:23:20,027] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 6: [2023-04-29 17:23:20,029] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 6: [2023-04-29 17:23:20,029] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 17: [2023-04-29 17:23:20,029] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 12: [2023-04-29 17:23:20,030] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 12: [2023-04-29 17:23:20,030] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 12: [2023-04-29 17:23:20,030] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 12: [2023-04-29 17:23:20,031] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 12: [2023-04-29 17:23:20,031] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 17: [2023-04-29 17:23:20,031] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 19: [2023-04-29 17:23:20,034] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 14: [2023-04-29 17:23:20,039] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 14: [2023-04-29 17:23:20,039] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 14: [2023-04-29 17:23:20,039] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 14: [2023-04-29 17:23:20,039] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 14: [2023-04-29 17:23:20,039] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 14: [2023-04-29 17:23:20,039] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 14: [2023-04-29 17:23:20,039] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 14: [2023-04-29 17:23:20,040] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 19: [2023-04-29 17:23:20,040] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 19: [2023-04-29 17:23:20,040] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 19: [2023-04-29 17:23:20,040] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 19: [2023-04-29 17:23:20,040] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 19: [2023-04-29 17:23:20,041] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 13: [2023-04-29 17:23:20,042] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 13: [2023-04-29 17:23:20,042] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 29: [2023-04-29 17:23:20,042] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 19: [2023-04-29 17:23:20,043] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 14: [2023-04-29 17:23:20,043] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 13: [2023-04-29 17:23:20,044] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 13: [2023-04-29 17:23:20,044] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 4: [2023-04-29 17:23:20,045] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 4: [2023-04-29 17:23:20,045] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 22: [2023-04-29 17:23:20,047] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 22: [2023-04-29 17:23:20,047] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 22: [2023-04-29 17:23:20,047] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 13: [2023-04-29 17:23:20,047] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 22: [2023-04-29 17:23:20,047] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 22: [2023-04-29 17:23:20,047] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 19: [2023-04-29 17:23:20,047] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 22: [2023-04-29 17:23:20,047] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 22: [2023-04-29 17:23:20,047] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 31: [2023-04-29 17:23:20,047] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 11: [2023-04-29 17:23:20,047] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 11: [2023-04-29 17:23:20,047] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 11: [2023-04-29 17:23:20,047] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 22: [2023-04-29 17:23:20,047] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 13: [2023-04-29 17:23:20,048] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 6: [2023-04-29 17:23:20,049] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 4: [2023-04-29 17:23:20,049] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 4: [2023-04-29 17:23:20,049] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 14: [2023-04-29 17:23:20,049] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 6: [2023-04-29 17:23:20,049] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 17: [2023-04-29 17:23:20,050] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 14: [2023-04-29 17:23:20,050] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 14: [2023-04-29 17:23:20,051] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 14: [2023-04-29 17:23:20,051] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 14: [2023-04-29 17:23:20,051] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 17: [2023-04-29 17:23:20,051] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 6: [2023-04-29 17:23:20,051] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 14: [2023-04-29 17:23:20,051] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 22: [2023-04-29 17:23:20,052] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 14: [2023-04-29 17:23:20,053] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 22: [2023-04-29 17:23:20,053] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 27: [2023-04-29 17:23:20,052] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 27: [2023-04-29 17:23:20,052] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 27: [2023-04-29 17:23:20,052] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 27: [2023-04-29 17:23:20,052] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 27: [2023-04-29 17:23:20,052] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 27: [2023-04-29 17:23:20,053] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 27: [2023-04-29 17:23:20,053] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 27: [2023-04-29 17:23:20,053] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 17: [2023-04-29 17:23:20,054] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 17: [2023-04-29 17:23:20,054] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 4: [2023-04-29 17:23:20,055] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 4: [2023-04-29 17:23:20,055] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 4: [2023-04-29 17:23:20,055] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 4: [2023-04-29 17:23:20,055] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 31: [2023-04-29 17:23:20,057] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 31: [2023-04-29 17:23:20,057] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 6: [2023-04-29 17:23:20,057] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 6: [2023-04-29 17:23:20,057] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 6: [2023-04-29 17:23:20,057] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 6: [2023-04-29 17:23:20,057] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 6: [2023-04-29 17:23:20,057] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 22: [2023-04-29 17:23:20,057] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 27: [2023-04-29 17:23:20,058] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 17: [2023-04-29 17:23:20,058] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 17: [2023-04-29 17:23:20,058] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 17: [2023-04-29 17:23:20,058] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 22: [2023-04-29 17:23:20,058] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 27: [2023-04-29 17:23:20,059] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 22: [2023-04-29 17:23:20,059] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 22: [2023-04-29 17:23:20,060] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 17: [2023-04-29 17:23:20,060] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 22: [2023-04-29 17:23:20,061] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 22: [2023-04-29 17:23:20,061] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 29: [2023-04-29 17:23:20,061] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 11: [2023-04-29 17:23:20,062] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 11: [2023-04-29 17:23:20,062] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 27: [2023-04-29 17:23:20,063] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 27: [2023-04-29 17:23:20,063] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 27: [2023-04-29 17:23:20,063] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 24: [2023-04-29 17:23:20,063] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 24: [2023-04-29 17:23:20,064] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 24: [2023-04-29 17:23:20,064] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 24: [2023-04-29 17:23:20,064] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 24: [2023-04-29 17:23:20,064] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 24: [2023-04-29 17:23:20,064] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 24: [2023-04-29 17:23:20,064] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 27: [2023-04-29 17:23:20,064] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 23: [2023-04-29 17:23:20,064] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 24: [2023-04-29 17:23:20,064] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 27: [2023-04-29 17:23:20,065] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 23: [2023-04-29 17:23:20,065] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 27: [2023-04-29 17:23:20,065] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 31: [2023-04-29 17:23:20,066] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 11: [2023-04-29 17:23:20,066] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 11: [2023-04-29 17:23:20,067] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 11: [2023-04-29 17:23:20,067] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 19: [2023-04-29 17:23:20,067] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 20: [2023-04-29 17:23:20,067] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 20: [2023-04-29 17:23:20,067] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 7: [2023-04-29 17:23:20,067] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 7: [2023-04-29 17:23:20,067] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 7: [2023-04-29 17:23:20,067] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 24: [2023-04-29 17:23:20,067] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 11: [2023-04-29 17:23:20,068] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 19: [2023-04-29 17:23:20,069] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 19: [2023-04-29 17:23:20,069] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 19: [2023-04-29 17:23:20,070] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 11: [2023-04-29 17:23:20,070] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 11: [2023-04-29 17:23:20,070] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 2: [2023-04-29 17:23:20,070] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 2: [2023-04-29 17:23:20,070] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 8: [2023-04-29 17:23:20,070] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 8: [2023-04-29 17:23:20,070] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 31: [2023-04-29 17:23:20,070] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 31: [2023-04-29 17:23:20,070] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 31: [2023-04-29 17:23:20,070] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 31: [2023-04-29 17:23:20,070] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 31: [2023-04-29 17:23:20,070] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 20: [2023-04-29 17:23:20,071] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 2: [2023-04-29 17:23:20,072] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 24: [2023-04-29 17:23:20,072] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 2: [2023-04-29 17:23:20,073] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 2: [2023-04-29 17:23:20,073] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 2: [2023-04-29 17:23:20,073] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 2: [2023-04-29 17:23:20,073] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 19: [2023-04-29 17:23:20,073] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 2: [2023-04-29 17:23:20,073] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 29: [2023-04-29 17:23:20,073] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 29: [2023-04-29 17:23:20,073] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 8: [2023-04-29 17:23:20,074] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 17: [2023-04-29 17:23:20,075] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 6: [2023-04-29 17:23:20,075] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 2: [2023-04-29 17:23:20,075] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 2: [2023-04-29 17:23:20,075] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 24: [2023-04-29 17:23:20,075] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 24: [2023-04-29 17:23:20,076] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 2: [2023-04-29 17:23:20,076] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 24: [2023-04-29 17:23:20,076] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 24: [2023-04-29 17:23:20,076] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 4: [2023-04-29 17:23:20,077] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 24: [2023-04-29 17:23:20,077] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 31: [2023-04-29 17:23:20,077] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 24: [2023-04-29 17:23:20,077] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 12: [2023-04-29 17:23:20,077] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 4: [2023-04-29 17:23:20,078] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 29: [2023-04-29 17:23:20,080] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 29: [2023-04-29 17:23:20,080] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 29: [2023-04-29 17:23:20,080] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 29: [2023-04-29 17:23:20,080] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 29: [2023-04-29 17:23:20,080] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 12: [2023-04-29 17:23:20,080] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 12: [2023-04-29 17:23:20,080] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 17: [2023-04-29 17:23:20,081] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 31: [2023-04-29 17:23:20,081] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 2: [2023-04-29 17:23:20,082] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 8: [2023-04-29 17:23:20,082] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 8: [2023-04-29 17:23:20,082] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 8: [2023-04-29 17:23:20,082] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 2: [2023-04-29 17:23:20,082] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 8: [2023-04-29 17:23:20,082] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 8: [2023-04-29 17:23:20,083] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 2: [2023-04-29 17:23:20,083] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 7: [2023-04-29 17:23:20,084] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 7: [2023-04-29 17:23:20,084] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 7: [2023-04-29 17:23:20,084] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 7: [2023-04-29 17:23:20,084] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 7: [2023-04-29 17:23:20,084] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 2: [2023-04-29 17:23:20,084] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 2: [2023-04-29 17:23:20,084] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 20: [2023-04-29 17:23:20,086] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 20: [2023-04-29 17:23:20,086] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 0: [2023-04-29 17:23:20,086] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 23: [2023-04-29 17:23:20,086] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 0: [2023-04-29 17:23:20,087] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 6: [2023-04-29 17:23:20,087] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 0: [2023-04-29 17:23:20,087] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 0: [2023-04-29 17:23:20,087] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 20: [2023-04-29 17:23:20,087] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 20: [2023-04-29 17:23:20,087] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 20: [2023-04-29 17:23:20,087] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 23: [2023-04-29 17:23:20,087] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 11: [2023-04-29 17:23:20,087] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 23: [2023-04-29 17:23:20,087] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 23: [2023-04-29 17:23:20,087] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 4: [2023-04-29 17:23:20,088] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 6: [2023-04-29 17:23:20,088] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 4: [2023-04-29 17:23:20,088] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 17: [2023-04-29 17:23:20,088] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 7: [2023-04-29 17:23:20,088] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 6: [2023-04-29 17:23:20,089] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 23: [2023-04-29 17:23:20,089] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 23: [2023-04-29 17:23:20,089] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 23: [2023-04-29 17:23:20,089] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 4: [2023-04-29 17:23:20,089] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 6: [2023-04-29 17:23:20,089] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 7: [2023-04-29 17:23:20,089] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 23: [2023-04-29 17:23:20,090] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 7: [2023-04-29 17:23:20,090] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 17: [2023-04-29 17:23:20,090] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 6: [2023-04-29 17:23:20,090] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 4: [2023-04-29 17:23:20,091] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 11: [2023-04-29 17:23:20,091] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 20: [2023-04-29 17:23:20,092] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 20: [2023-04-29 17:23:20,093] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 8: [2023-04-29 17:23:20,093] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 8: [2023-04-29 17:23:20,093] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 17: [2023-04-29 17:23:20,093] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 17: [2023-04-29 17:23:20,093] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 11: [2023-04-29 17:23:20,095] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 11: [2023-04-29 17:23:20,095] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 11: [2023-04-29 17:23:20,095] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 14: [2023-04-29 17:23:20,095] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 0: [2023-04-29 17:23:20,096] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 12: [2023-04-29 17:23:20,096] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 31: [2023-04-29 17:23:20,097] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 31: [2023-04-29 17:23:20,098] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 8: [2023-04-29 17:23:20,098] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 20: [2023-04-29 17:23:20,098] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 12: [2023-04-29 17:23:20,098] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 12: [2023-04-29 17:23:20,098] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 12: [2023-04-29 17:23:20,098] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 12: [2023-04-29 17:23:20,098] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 31: [2023-04-29 17:23:20,098] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 31: [2023-04-29 17:23:20,099] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 12: [2023-04-29 17:23:20,099] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 29: [2023-04-29 17:23:20,100] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 29: [2023-04-29 17:23:20,101] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 31: [2023-04-29 17:23:20,101] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 0: [2023-04-29 17:23:20,103] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 0: [2023-04-29 17:23:20,103] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 12: [2023-04-29 17:23:20,104] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 12: [2023-04-29 17:23:20,104] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 0: [2023-04-29 17:23:20,104] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 22: [2023-04-29 17:23:20,105] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 22: [2023-04-29 17:23:20,105] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 7: [2023-04-29 17:23:20,109] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 8: [2023-04-29 17:23:20,110] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 27: [2023-04-29 17:23:20,110] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 8: [2023-04-29 17:23:20,111] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 8: [2023-04-29 17:23:20,111] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 7: [2023-04-29 17:23:20,111] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 7: [2023-04-29 17:23:20,112] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 29: [2023-04-29 17:23:20,112] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 29: [2023-04-29 17:23:20,113] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 7: [2023-04-29 17:23:20,113] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 7: [2023-04-29 17:23:20,113] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 8: [2023-04-29 17:23:20,114] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 8: [2023-04-29 17:23:20,114] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 14: [2023-04-29 17:23:20,115] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 27: [2023-04-29 17:23:20,114] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 29: [2023-04-29 17:23:20,115] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 10: [2023-04-29 17:23:20,116] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 10: [2023-04-29 17:23:20,116] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 10: [2023-04-29 17:23:20,116] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 20: [2023-04-29 17:23:20,116] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 20: [2023-04-29 17:23:20,116] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 10: [2023-04-29 17:23:20,116] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 10: [2023-04-29 17:23:20,117] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 10: [2023-04-29 17:23:20,117] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 10: [2023-04-29 17:23:20,117] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 29: [2023-04-29 17:23:20,117] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 29: [2023-04-29 17:23:20,117] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 10: [2023-04-29 17:23:20,117] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 0: [2023-04-29 17:23:20,118] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 24: [2023-04-29 17:23:20,118] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 20: [2023-04-29 17:23:20,119] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 28: [2023-04-29 17:23:20,119] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 0: [2023-04-29 17:23:20,119] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 28: [2023-04-29 17:23:20,120] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 25: [2023-04-29 17:23:20,120] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 25: [2023-04-29 17:23:20,120] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 28: [2023-04-29 17:23:20,120] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 23: [2023-04-29 17:23:20,120] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 28: [2023-04-29 17:23:20,120] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 28: [2023-04-29 17:23:20,120] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 28: [2023-04-29 17:23:20,120] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 28: [2023-04-29 17:23:20,120] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 28: [2023-04-29 17:23:20,120] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 23: [2023-04-29 17:23:20,121] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 20: [2023-04-29 17:23:20,121] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 20: [2023-04-29 17:23:20,121] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 0: [2023-04-29 17:23:20,121] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 10: [2023-04-29 17:23:20,121] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 10: [2023-04-29 17:23:20,122] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 12: [2023-04-29 17:23:20,122] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 23: [2023-04-29 17:23:20,122] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 10: [2023-04-29 17:23:20,122] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 23: [2023-04-29 17:23:20,122] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 10: [2023-04-29 17:23:20,122] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 14: [2023-04-29 17:23:20,122] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 14: [2023-04-29 17:23:20,122] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 25: [2023-04-29 17:23:20,123] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 25: [2023-04-29 17:23:20,123] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 25: [2023-04-29 17:23:20,123] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 25: [2023-04-29 17:23:20,123] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 25: [2023-04-29 17:23:20,123] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 10: [2023-04-29 17:23:20,124] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 25: [2023-04-29 17:23:20,124] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 25: [2023-04-29 17:23:20,124] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 25: [2023-04-29 17:23:20,124] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 10: [2023-04-29 17:23:20,125] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 23: [2023-04-29 17:23:20,126] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 0: [2023-04-29 17:23:20,126] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 12: [2023-04-29 17:23:20,126] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 22: [2023-04-29 17:23:20,126] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 22: [2023-04-29 17:23:20,126] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 22: [2023-04-29 17:23:20,126] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 23: [2023-04-29 17:23:20,126] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 10: [2023-04-29 17:23:20,126] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 10: [2023-04-29 17:23:20,126] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 22: [2023-04-29 17:23:20,128] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 12: [2023-04-29 17:23:20,128] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 12: [2023-04-29 17:23:20,128] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 12: [2023-04-29 17:23:20,128] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 22: [2023-04-29 17:23:20,129] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 2: [2023-04-29 17:23:20,129] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 2: [2023-04-29 17:23:20,129] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 2: [2023-04-29 17:23:20,129] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 22: [2023-04-29 17:23:20,130] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 22: [2023-04-29 17:23:20,130] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 22: [2023-04-29 17:23:20,130] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 27: [2023-04-29 17:23:20,131] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 28: [2023-04-29 17:23:20,132] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 0: [2023-04-29 17:23:20,132] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 28: [2023-04-29 17:23:20,133] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 25: [2023-04-29 17:23:20,133] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 14: [2023-04-29 17:23:20,133] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 14: [2023-04-29 17:23:20,133] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 14: [2023-04-29 17:23:20,133] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 14: [2023-04-29 17:23:20,133] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 14: [2023-04-29 17:23:20,133] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 27: [2023-04-29 17:23:20,133] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 27: [2023-04-29 17:23:20,133] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 27: [2023-04-29 17:23:20,133] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 25: [2023-04-29 17:23:20,134] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 28: [2023-04-29 17:23:20,134] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 28: [2023-04-29 17:23:20,134] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 28: [2023-04-29 17:23:20,134] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 0: [2023-04-29 17:23:20,135] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 25: [2023-04-29 17:23:20,135] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 27: [2023-04-29 17:23:20,135] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 27: [2023-04-29 17:23:20,135] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 27: [2023-04-29 17:23:20,135] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 28: [2023-04-29 17:23:20,135] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 25: [2023-04-29 17:23:20,135] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 28: [2023-04-29 17:23:20,135] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 25: [2023-04-29 17:23:20,135] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 25: [2023-04-29 17:23:20,136] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 28: [2023-04-29 17:23:20,136] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 0: [2023-04-29 17:23:20,137] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 24: [2023-04-29 17:23:20,137] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 27: [2023-04-29 17:23:20,137] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 0: [2023-04-29 17:23:20,137] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 24: [2023-04-29 17:23:20,142] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 26: [2023-04-29 17:23:20,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 26: [2023-04-29 17:23:20,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 26: [2023-04-29 17:23:20,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 26: [2023-04-29 17:23:20,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 26: [2023-04-29 17:23:20,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 26: [2023-04-29 17:23:20,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 26: [2023-04-29 17:23:20,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 26: [2023-04-29 17:23:20,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 2: [2023-04-29 17:23:20,146] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 14: [2023-04-29 17:23:20,146] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 2: [2023-04-29 17:23:20,146] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 2: [2023-04-29 17:23:20,146] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 14: [2023-04-29 17:23:20,146] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 2: [2023-04-29 17:23:20,148] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 2: [2023-04-29 17:23:20,148] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 26: [2023-04-29 17:23:20,149] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 2: [2023-04-29 17:23:20,150] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 26: [2023-04-29 17:23:20,151] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 26: [2023-04-29 17:23:20,151] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 2: [2023-04-29 17:23:20,151] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 26: [2023-04-29 17:23:20,151] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 26: [2023-04-29 17:23:20,152] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 26: [2023-04-29 17:23:20,152] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 2: [2023-04-29 17:23:20,152] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 26: [2023-04-29 17:23:20,152] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 26: [2023-04-29 17:23:20,152] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 24: [2023-04-29 17:23:20,158] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 24: [2023-04-29 17:23:20,158] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 24: [2023-04-29 17:23:20,158] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 24: [2023-04-29 17:23:20,160] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 24: [2023-04-29 17:23:20,160] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 24: [2023-04-29 17:23:20,160] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 24: [2023-04-29 17:23:20,161] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 22: [2023-04-29 17:23:20,161] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 22: [2023-04-29 17:23:20,161] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 22: [2023-04-29 17:23:20,161] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 22: [2023-04-29 17:23:20,162] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 22: [2023-04-29 17:23:20,162] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 14: [2023-04-29 17:23:20,163] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 27: [2023-04-29 17:23:20,164] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 27: [2023-04-29 17:23:20,164] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 14: [2023-04-29 17:23:20,164] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 27: [2023-04-29 17:23:20,165] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 27: [2023-04-29 17:23:20,165] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 14: [2023-04-29 17:23:20,167] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 22: [2023-04-29 17:23:20,167] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 14: [2023-04-29 17:23:20,169] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 27: [2023-04-29 17:23:20,169] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 14: [2023-04-29 17:23:20,169] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 27: [2023-04-29 17:23:20,169] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 1: [2023-04-29 17:23:20,171] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 1: [2023-04-29 17:23:20,171] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 1: [2023-04-29 17:23:20,172] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 1: [2023-04-29 17:23:20,172] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 2: [2023-04-29 17:23:20,172] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 1: [2023-04-29 17:23:20,172] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 1: [2023-04-29 17:23:20,172] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 1: [2023-04-29 17:23:20,172] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 1: [2023-04-29 17:23:20,173] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 2: [2023-04-29 17:23:20,173] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 25: [2023-04-29 17:23:20,174] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 25: [2023-04-29 17:23:20,174] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 2: [2023-04-29 17:23:20,175] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 1: [2023-04-29 17:23:20,176] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 1: [2023-04-29 17:23:20,176] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 2: [2023-04-29 17:23:20,177] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 2: [2023-04-29 17:23:20,177] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 1: [2023-04-29 17:23:20,177] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 1: [2023-04-29 17:23:20,177] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 10: [2023-04-29 17:23:20,179] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 10: [2023-04-29 17:23:20,179] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 10: [2023-04-29 17:23:20,179] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 10: [2023-04-29 17:23:20,179] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 1: [2023-04-29 17:23:20,180] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 1: [2023-04-29 17:23:20,180] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 1: [2023-04-29 17:23:20,180] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 1: [2023-04-29 17:23:20,181] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 10: [2023-04-29 17:23:20,185] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 10: [2023-04-29 17:23:20,185] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 10: [2023-04-29 17:23:20,185] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 10: [2023-04-29 17:23:20,185] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 24: [2023-04-29 17:23:20,187] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 24: [2023-04-29 17:23:20,188] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 24: [2023-04-29 17:23:20,193] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 24: [2023-04-29 17:23:20,193] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 24: [2023-04-29 17:23:20,193] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 24: [2023-04-29 17:23:20,193] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 25: [2023-04-29 17:23:20,194] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 18: [2023-04-29 17:23:20,195] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 18: [2023-04-29 17:23:20,195] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 18: [2023-04-29 17:23:20,195] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 18: [2023-04-29 17:23:20,195] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 18: [2023-04-29 17:23:20,195] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 25: [2023-04-29 17:23:20,195] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 18: [2023-04-29 17:23:20,195] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 18: [2023-04-29 17:23:20,195] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 18: [2023-04-29 17:23:20,196] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 9: [2023-04-29 17:23:20,197] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 9: [2023-04-29 17:23:20,197] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 9: [2023-04-29 17:23:20,197] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 9: [2023-04-29 17:23:20,197] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 9: [2023-04-29 17:23:20,197] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 9: [2023-04-29 17:23:20,197] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 9: [2023-04-29 17:23:20,197] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 9: [2023-04-29 17:23:20,198] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 5: [2023-04-29 17:23:20,201] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 5: [2023-04-29 17:23:20,201] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 25: [2023-04-29 17:23:20,200] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 25: [2023-04-29 17:23:20,200] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 9: [2023-04-29 17:23:20,202] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 9: [2023-04-29 17:23:20,202] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 9: [2023-04-29 17:23:20,202] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 9: [2023-04-29 17:23:20,203] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 9: [2023-04-29 17:23:20,203] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 9: [2023-04-29 17:23:20,203] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 9: [2023-04-29 17:23:20,203] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 9: [2023-04-29 17:23:20,203] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 26: [2023-04-29 17:23:20,203] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 26: [2023-04-29 17:23:20,203] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 5: [2023-04-29 17:23:20,204] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 5: [2023-04-29 17:23:20,204] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 5: [2023-04-29 17:23:20,204] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 5: [2023-04-29 17:23:20,204] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 5: [2023-04-29 17:23:20,204] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 25: [2023-04-29 17:23:20,204] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 25: [2023-04-29 17:23:20,204] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 25: [2023-04-29 17:23:20,204] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 25: [2023-04-29 17:23:20,204] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 5: [2023-04-29 17:23:20,204] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 5: [2023-04-29 17:23:20,205] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 5: [2023-04-29 17:23:20,205] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 10: [2023-04-29 17:23:20,207] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 26: [2023-04-29 17:23:20,207] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 18: [2023-04-29 17:23:20,208] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 10: [2023-04-29 17:23:20,207] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 18: [2023-04-29 17:23:20,209] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 18: [2023-04-29 17:23:20,209] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 28: [2023-04-29 17:23:20,209] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 28: [2023-04-29 17:23:20,209] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 28: [2023-04-29 17:23:20,209] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 10: [2023-04-29 17:23:20,209] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 10: [2023-04-29 17:23:20,210] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 18: [2023-04-29 17:23:20,210] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 18: [2023-04-29 17:23:20,210] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 18: [2023-04-29 17:23:20,211] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 18: [2023-04-29 17:23:20,211] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 18: [2023-04-29 17:23:20,211] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 26: [2023-04-29 17:23:20,212] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 5: [2023-04-29 17:23:20,214] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 5: [2023-04-29 17:23:20,214] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 5: [2023-04-29 17:23:20,214] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 5: [2023-04-29 17:23:20,214] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 16: [2023-04-29 17:23:20,214] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 16: [2023-04-29 17:23:20,214] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 16: [2023-04-29 17:23:20,215] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 26: [2023-04-29 17:23:20,215] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 26: [2023-04-29 17:23:20,215] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 26: [2023-04-29 17:23:20,215] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 26: [2023-04-29 17:23:20,215] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 16: [2023-04-29 17:23:20,215] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 16: [2023-04-29 17:23:20,215] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 16: [2023-04-29 17:23:20,215] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 16: [2023-04-29 17:23:20,215] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 5: [2023-04-29 17:23:20,215] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 5: [2023-04-29 17:23:20,216] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 16: [2023-04-29 17:23:20,216] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 10: [2023-04-29 17:23:20,216] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 10: [2023-04-29 17:23:20,216] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 10: [2023-04-29 17:23:20,219] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 10: [2023-04-29 17:23:20,219] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 16: [2023-04-29 17:23:20,221] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 16: [2023-04-29 17:23:20,221] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 16: [2023-04-29 17:23:20,221] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 16: [2023-04-29 17:23:20,221] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 16: [2023-04-29 17:23:20,221] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 16: [2023-04-29 17:23:20,222] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 16: [2023-04-29 17:23:20,222] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 16: [2023-04-29 17:23:20,222] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 28: [2023-04-29 17:23:20,224] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 28: [2023-04-29 17:23:20,224] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 28: [2023-04-29 17:23:20,224] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 28: [2023-04-29 17:23:20,224] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 28: [2023-04-29 17:23:20,224] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 25: [2023-04-29 17:23:20,225] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 26: [2023-04-29 17:23:20,227] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 26: [2023-04-29 17:23:20,227] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 25: [2023-04-29 17:23:20,229] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 25: [2023-04-29 17:23:20,231] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 3: [2023-04-29 17:23:20,232] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 3: [2023-04-29 17:23:20,232] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 26: [2023-04-29 17:23:20,233] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 25: [2023-04-29 17:23:20,232] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 3: [2023-04-29 17:23:20,233] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 3: [2023-04-29 17:23:20,233] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 3: [2023-04-29 17:23:20,233] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 3: [2023-04-29 17:23:20,233] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 3: [2023-04-29 17:23:20,233] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 3: [2023-04-29 17:23:20,233] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 1: [2023-04-29 17:23:20,234] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 1: [2023-04-29 17:23:20,234] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 1: [2023-04-29 17:23:20,234] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 1: [2023-04-29 17:23:20,234] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 28: [2023-04-29 17:23:20,235] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 28: [2023-04-29 17:23:20,235] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 28: [2023-04-29 17:23:20,236] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 26: [2023-04-29 17:23:20,237] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 25: [2023-04-29 17:23:20,237] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 3: [2023-04-29 17:23:20,237] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 3: [2023-04-29 17:23:20,237] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 25: [2023-04-29 17:23:20,238] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 1: [2023-04-29 17:23:20,240] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 1: [2023-04-29 17:23:20,240] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 1: [2023-04-29 17:23:20,240] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 1: [2023-04-29 17:23:20,240] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 3: [2023-04-29 17:23:20,240] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 3: [2023-04-29 17:23:20,240] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 3: [2023-04-29 17:23:20,241] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 3: [2023-04-29 17:23:20,241] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 3: [2023-04-29 17:23:20,241] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 3: [2023-04-29 17:23:20,241] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 26: [2023-04-29 17:23:20,241] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 26: [2023-04-29 17:23:20,244] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 26: [2023-04-29 17:23:20,244] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 26: [2023-04-29 17:23:20,244] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 30: [2023-04-29 17:23:20,247] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 30: [2023-04-29 17:23:20,248] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 30: [2023-04-29 17:23:20,248] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 30: [2023-04-29 17:23:20,248] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 30: [2023-04-29 17:23:20,248] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 30: [2023-04-29 17:23:20,248] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 30: [2023-04-29 17:23:20,248] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 30: [2023-04-29 17:23:20,248] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 28: [2023-04-29 17:23:20,255] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 5: [2023-04-29 17:23:20,256] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 5: [2023-04-29 17:23:20,256] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 28: [2023-04-29 17:23:20,258] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 28: [2023-04-29 17:23:20,258] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 15: [2023-04-29 17:23:20,258] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 15: [2023-04-29 17:23:20,258] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 15: [2023-04-29 17:23:20,258] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 15: [2023-04-29 17:23:20,258] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 15: [2023-04-29 17:23:20,258] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 15: [2023-04-29 17:23:20,258] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 15: [2023-04-29 17:23:20,258] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 28: [2023-04-29 17:23:20,259] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 15: [2023-04-29 17:23:20,259] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 1: [2023-04-29 17:23:20,259] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 1: [2023-04-29 17:23:20,259] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 28: [2023-04-29 17:23:20,259] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 30: [2023-04-29 17:23:20,259] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 30: [2023-04-29 17:23:20,259] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 30: [2023-04-29 17:23:20,260] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 30: [2023-04-29 17:23:20,260] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 1: [2023-04-29 17:23:20,260] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 30: [2023-04-29 17:23:20,260] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 30: [2023-04-29 17:23:20,260] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 9: [2023-04-29 17:23:20,261] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 9: [2023-04-29 17:23:20,261] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 9: [2023-04-29 17:23:20,261] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 9: [2023-04-29 17:23:20,261] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 9: [2023-04-29 17:23:20,262] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 9: [2023-04-29 17:23:20,262] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 9: [2023-04-29 17:23:20,262] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 9: [2023-04-29 17:23:20,262] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 1: [2023-04-29 17:23:20,262] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 30: [2023-04-29 17:23:20,262] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 30: [2023-04-29 17:23:20,262] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 17: [2023-04-29 17:23:20,265] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 17: [2023-04-29 17:23:20,266] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 17: [2023-04-29 17:23:20,266] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 17: [2023-04-29 17:23:20,266] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 1: [2023-04-29 17:23:20,266] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 17: [2023-04-29 17:23:20,266] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 17: [2023-04-29 17:23:20,266] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 17: [2023-04-29 17:23:20,266] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 17: [2023-04-29 17:23:20,267] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 1: [2023-04-29 17:23:20,267] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 1: [2023-04-29 17:23:20,267] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 1: [2023-04-29 17:23:20,269] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 17: [2023-04-29 17:23:20,271] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 15: [2023-04-29 17:23:20,271] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 15: [2023-04-29 17:23:20,272] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 17: [2023-04-29 17:23:20,272] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 15: [2023-04-29 17:23:20,272] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 15: [2023-04-29 17:23:20,272] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 17: [2023-04-29 17:23:20,273] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 15: [2023-04-29 17:23:20,274] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 15: [2023-04-29 17:23:20,274] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 15: [2023-04-29 17:23:20,274] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 15: [2023-04-29 17:23:20,274] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt... 16: [2023-04-29 17:23:20,275] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 16: [2023-04-29 17:23:20,275] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 17: [2023-04-29 17:23:20,276] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 17: [2023-04-29 17:23:20,277] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 17: [2023-04-29 17:23:20,277] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 17: [2023-04-29 17:23:20,277] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 17: [2023-04-29 17:23:20,278] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 5: [2023-04-29 17:23:20,279] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 5: [2023-04-29 17:23:20,279] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 13: [2023-04-29 17:23:20,280] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 13: [2023-04-29 17:23:20,280] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 13: [2023-04-29 17:23:20,280] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 13: [2023-04-29 17:23:20,281] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 13: [2023-04-29 17:23:20,281] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 16: [2023-04-29 17:23:20,281] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 13: [2023-04-29 17:23:20,281] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 13: [2023-04-29 17:23:20,281] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 13: [2023-04-29 17:23:20,281] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 16: [2023-04-29 17:23:20,282] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 5: [2023-04-29 17:23:20,284] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 5: [2023-04-29 17:23:20,284] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 5: [2023-04-29 17:23:20,284] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 5: [2023-04-29 17:23:20,284] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 9: [2023-04-29 17:23:20,285] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 5: [2023-04-29 17:23:20,285] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 5: [2023-04-29 17:23:20,285] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 6: [2023-04-29 17:23:20,285] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 6: [2023-04-29 17:23:20,285] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 6: [2023-04-29 17:23:20,285] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 18: [2023-04-29 17:23:20,286] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 18: [2023-04-29 17:23:20,286] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 18: [2023-04-29 17:23:20,286] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 13: [2023-04-29 17:23:20,285] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 6: [2023-04-29 17:23:20,286] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 6: [2023-04-29 17:23:20,286] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 6: [2023-04-29 17:23:20,286] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 6: [2023-04-29 17:23:20,286] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 6: [2023-04-29 17:23:20,286] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 9: [2023-04-29 17:23:20,286] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 9: [2023-04-29 17:23:20,286] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 13: [2023-04-29 17:23:20,287] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 9: [2023-04-29 17:23:20,287] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 9: [2023-04-29 17:23:20,287] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 3: [2023-04-29 17:23:20,287] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 9: [2023-04-29 17:23:20,288] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 3: [2023-04-29 17:23:20,289] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 13: [2023-04-29 17:23:20,288] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 9: [2023-04-29 17:23:20,289] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 13: [2023-04-29 17:23:20,289] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 9: [2023-04-29 17:23:20,289] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 6: [2023-04-29 17:23:20,290] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 6: [2023-04-29 17:23:20,290] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 13: [2023-04-29 17:23:20,291] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 16: [2023-04-29 17:23:20,292] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 16: [2023-04-29 17:23:20,292] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 16: [2023-04-29 17:23:20,292] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 16: [2023-04-29 17:23:20,292] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 13: [2023-04-29 17:23:20,292] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 13: [2023-04-29 17:23:20,292] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 13: [2023-04-29 17:23:20,292] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 6: [2023-04-29 17:23:20,294] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 6: [2023-04-29 17:23:20,295] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 6: [2023-04-29 17:23:20,295] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 6: [2023-04-29 17:23:20,296] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 6: [2023-04-29 17:23:20,296] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 6: [2023-04-29 17:23:20,297] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 16: [2023-04-29 17:23:20,298] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 16: [2023-04-29 17:23:20,298] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 18: [2023-04-29 17:23:20,299] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 18: [2023-04-29 17:23:20,299] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 18: [2023-04-29 17:23:20,299] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 18: [2023-04-29 17:23:20,299] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 18: [2023-04-29 17:23:20,299] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 16: [2023-04-29 17:23:20,305] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 3: [2023-04-29 17:23:20,308] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 3: [2023-04-29 17:23:20,309] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 18: [2023-04-29 17:23:20,310] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 16: [2023-04-29 17:23:20,310] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 18: [2023-04-29 17:23:20,311] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 3: [2023-04-29 17:23:20,312] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 3: [2023-04-29 17:23:20,312] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 3: [2023-04-29 17:23:20,312] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 3: [2023-04-29 17:23:20,312] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 3: [2023-04-29 17:23:20,312] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 3: [2023-04-29 17:23:20,312] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 18: [2023-04-29 17:23:20,312] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 5: [2023-04-29 17:23:20,317] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 16: [2023-04-29 17:23:20,319] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 16: [2023-04-29 17:23:20,320] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 16: [2023-04-29 17:23:20,320] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 16: [2023-04-29 17:23:20,320] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 5: [2023-04-29 17:23:20,321] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 5: [2023-04-29 17:23:20,324] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 5: [2023-04-29 17:23:20,324] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 5: [2023-04-29 17:23:20,324] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 5: [2023-04-29 17:23:20,324] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 17: [2023-04-29 17:23:20,326] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 17: [2023-04-29 17:23:20,326] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 17: [2023-04-29 17:23:20,330] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 20: [2023-04-29 17:23:20,330] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 20: [2023-04-29 17:23:20,330] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 30: [2023-04-29 17:23:20,330] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 18: [2023-04-29 17:23:20,330] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 20: [2023-04-29 17:23:20,332] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 20: [2023-04-29 17:23:20,332] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 20: [2023-04-29 17:23:20,332] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 20: [2023-04-29 17:23:20,332] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 20: [2023-04-29 17:23:20,333] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 20: [2023-04-29 17:23:20,333] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 18: [2023-04-29 17:23:20,333] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 18: [2023-04-29 17:23:20,334] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 18: [2023-04-29 17:23:20,334] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 18: [2023-04-29 17:23:20,335] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 20: [2023-04-29 17:23:20,337] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 20: [2023-04-29 17:23:20,337] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 13: [2023-04-29 17:23:20,338] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 13: [2023-04-29 17:23:20,338] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 20: [2023-04-29 17:23:20,339] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 20: [2023-04-29 17:23:20,339] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 20: [2023-04-29 17:23:20,339] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 20: [2023-04-29 17:23:20,340] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 20: [2023-04-29 17:23:20,340] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 20: [2023-04-29 17:23:20,341] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 3: [2023-04-29 17:23:20,341] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 6: [2023-04-29 17:23:20,341] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 6: [2023-04-29 17:23:20,341] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 31: [2023-04-29 17:23:20,342] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 31: [2023-04-29 17:23:20,342] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 3: [2023-04-29 17:23:20,343] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 3: [2023-04-29 17:23:20,344] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 31: [2023-04-29 17:23:20,344] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 3: [2023-04-29 17:23:20,344] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 31: [2023-04-29 17:23:20,345] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 31: [2023-04-29 17:23:20,345] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 31: [2023-04-29 17:23:20,345] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 31: [2023-04-29 17:23:20,345] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 31: [2023-04-29 17:23:20,345] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 3: [2023-04-29 17:23:20,347] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 3: [2023-04-29 17:23:20,347] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 31: [2023-04-29 17:23:20,347] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 31: [2023-04-29 17:23:20,347] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 31: [2023-04-29 17:23:20,348] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 17: [2023-04-29 17:23:20,349] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 17: [2023-04-29 17:23:20,350] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 17: [2023-04-29 17:23:20,350] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 15: [2023-04-29 17:23:20,351] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 31: [2023-04-29 17:23:20,351] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 31: [2023-04-29 17:23:20,351] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 31: [2023-04-29 17:23:20,351] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 31: [2023-04-29 17:23:20,352] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 31: [2023-04-29 17:23:20,352] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 15: [2023-04-29 17:23:20,351] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 15: [2023-04-29 17:23:20,351] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 15: [2023-04-29 17:23:20,351] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 30: [2023-04-29 17:23:20,352] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 30: [2023-04-29 17:23:20,352] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 30: [2023-04-29 17:23:20,352] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 30: [2023-04-29 17:23:20,352] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 30: [2023-04-29 17:23:20,352] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 30: [2023-04-29 17:23:20,352] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 30: [2023-04-29 17:23:20,352] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 30: [2023-04-29 17:23:20,352] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 15: [2023-04-29 17:23:20,355] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 15: [2023-04-29 17:23:20,355] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 15: [2023-04-29 17:23:20,355] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 15: [2023-04-29 17:23:20,355] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_07-model_00-model_states.pt. 17: [2023-04-29 17:23:20,355] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 17: [2023-04-29 17:23:20,355] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 17: [2023-04-29 17:23:20,355] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 17: [2023-04-29 17:23:20,356] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 17: [2023-04-29 17:23:20,356] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 13: [2023-04-29 17:23:20,357] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 13: [2023-04-29 17:23:20,357] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 13: [2023-04-29 17:23:20,357] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 13: [2023-04-29 17:23:20,360] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 6: [2023-04-29 17:23:20,360] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 13: [2023-04-29 17:23:20,361] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 13: [2023-04-29 17:23:20,361] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 13: [2023-04-29 17:23:20,361] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 13: [2023-04-29 17:23:20,361] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 6: [2023-04-29 17:23:20,362] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 6: [2023-04-29 17:23:20,362] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 6: [2023-04-29 17:23:20,365] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 7: [2023-04-29 17:23:20,369] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 7: [2023-04-29 17:23:20,369] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 21: [2023-04-29 17:23:20,369] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 21: [2023-04-29 17:23:20,369] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 21: [2023-04-29 17:23:20,369] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 21: [2023-04-29 17:23:20,369] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 21: [2023-04-29 17:23:20,369] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 21: [2023-04-29 17:23:20,369] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 21: [2023-04-29 17:23:20,369] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 7: [2023-04-29 17:23:20,370] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 21: [2023-04-29 17:23:20,370] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 7: [2023-04-29 17:23:20,370] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 7: [2023-04-29 17:23:20,370] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 7: [2023-04-29 17:23:20,370] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 7: [2023-04-29 17:23:20,370] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 7: [2023-04-29 17:23:20,371] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 7: [2023-04-29 17:23:20,373] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 7: [2023-04-29 17:23:20,374] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 7: [2023-04-29 17:23:20,374] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 6: [2023-04-29 17:23:20,374] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 6: [2023-04-29 17:23:20,374] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 6: [2023-04-29 17:23:20,374] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 6: [2023-04-29 17:23:20,374] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 21: [2023-04-29 17:23:20,374] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 21: [2023-04-29 17:23:20,374] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 21: [2023-04-29 17:23:20,375] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 21: [2023-04-29 17:23:20,375] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 21: [2023-04-29 17:23:20,376] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 21: [2023-04-29 17:23:20,376] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 21: [2023-04-29 17:23:20,376] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 21: [2023-04-29 17:23:20,376] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 17: [2023-04-29 17:23:20,377] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 23: [2023-04-29 17:23:20,377] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 8: [2023-04-29 17:23:20,377] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 8: [2023-04-29 17:23:20,377] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 8: [2023-04-29 17:23:20,377] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 8: [2023-04-29 17:23:20,377] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 8: [2023-04-29 17:23:20,377] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 8: [2023-04-29 17:23:20,377] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 8: [2023-04-29 17:23:20,377] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 23: [2023-04-29 17:23:20,377] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 7: [2023-04-29 17:23:20,377] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 7: [2023-04-29 17:23:20,377] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 7: [2023-04-29 17:23:20,377] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 8: [2023-04-29 17:23:20,377] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 23: [2023-04-29 17:23:20,377] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 7: [2023-04-29 17:23:20,377] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 23: [2023-04-29 17:23:20,377] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 7: [2023-04-29 17:23:20,377] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 23: [2023-04-29 17:23:20,377] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 23: [2023-04-29 17:23:20,377] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 23: [2023-04-29 17:23:20,377] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 23: [2023-04-29 17:23:20,378] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 12: [2023-04-29 17:23:20,378] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 12: [2023-04-29 17:23:20,378] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 12: [2023-04-29 17:23:20,379] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 12: [2023-04-29 17:23:20,379] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 12: [2023-04-29 17:23:20,379] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 12: [2023-04-29 17:23:20,379] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 12: [2023-04-29 17:23:20,379] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 12: [2023-04-29 17:23:20,379] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 17: [2023-04-29 17:23:20,381] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 23: [2023-04-29 17:23:20,382] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 23: [2023-04-29 17:23:20,383] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 17: [2023-04-29 17:23:20,383] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 8: [2023-04-29 17:23:20,383] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 8: [2023-04-29 17:23:20,383] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 17: [2023-04-29 17:23:20,384] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 6: [2023-04-29 17:23:20,384] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 17: [2023-04-29 17:23:20,385] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 13: [2023-04-29 17:23:20,385] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 8: [2023-04-29 17:23:20,385] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 8: [2023-04-29 17:23:20,385] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 8: [2023-04-29 17:23:20,385] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 8: [2023-04-29 17:23:20,386] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 13: [2023-04-29 17:23:20,386] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 23: [2023-04-29 17:23:20,386] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 15: [2023-04-29 17:23:20,386] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 23: [2023-04-29 17:23:20,387] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 8: [2023-04-29 17:23:20,387] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 23: [2023-04-29 17:23:20,387] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 8: [2023-04-29 17:23:20,387] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 15: [2023-04-29 17:23:20,387] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 15: [2023-04-29 17:23:20,387] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 11: [2023-04-29 17:23:20,388] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 11: [2023-04-29 17:23:20,388] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 11: [2023-04-29 17:23:20,388] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 23: [2023-04-29 17:23:20,388] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 12: [2023-04-29 17:23:20,388] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 23: [2023-04-29 17:23:20,388] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 15: [2023-04-29 17:23:20,388] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 11: [2023-04-29 17:23:20,388] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 11: [2023-04-29 17:23:20,388] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 12: [2023-04-29 17:23:20,388] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 23: [2023-04-29 17:23:20,388] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 11: [2023-04-29 17:23:20,388] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 11: [2023-04-29 17:23:20,388] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 11: [2023-04-29 17:23:20,389] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 30: [2023-04-29 17:23:20,389] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 25: [2023-04-29 17:23:20,389] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 25: [2023-04-29 17:23:20,389] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 12: [2023-04-29 17:23:20,389] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 24: [2023-04-29 17:23:20,388] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 13: [2023-04-29 17:23:20,389] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 24: [2023-04-29 17:23:20,389] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 24: [2023-04-29 17:23:20,389] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 24: [2023-04-29 17:23:20,389] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 24: [2023-04-29 17:23:20,389] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 24: [2023-04-29 17:23:20,389] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 24: [2023-04-29 17:23:20,389] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 30: [2023-04-29 17:23:20,390] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 30: [2023-04-29 17:23:20,390] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 12: [2023-04-29 17:23:20,390] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 30: [2023-04-29 17:23:20,390] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 12: [2023-04-29 17:23:20,390] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 15: [2023-04-29 17:23:20,390] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 12: [2023-04-29 17:23:20,391] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 15: [2023-04-29 17:23:20,391] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 13: [2023-04-29 17:23:20,391] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 6: [2023-04-29 17:23:20,392] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 30: [2023-04-29 17:23:20,392] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 12: [2023-04-29 17:23:20,392] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 12: [2023-04-29 17:23:20,392] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 11: [2023-04-29 17:23:20,392] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 11: [2023-04-29 17:23:20,393] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 11: [2023-04-29 17:23:20,393] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 30: [2023-04-29 17:23:20,393] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 30: [2023-04-29 17:23:20,393] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 20: [2023-04-29 17:23:20,394] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 20: [2023-04-29 17:23:20,394] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 25: [2023-04-29 17:23:20,393] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 25: [2023-04-29 17:23:20,393] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 25: [2023-04-29 17:23:20,393] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 25: [2023-04-29 17:23:20,393] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 25: [2023-04-29 17:23:20,393] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 25: [2023-04-29 17:23:20,393] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 25: [2023-04-29 17:23:20,394] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 25: [2023-04-29 17:23:20,394] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 15: [2023-04-29 17:23:20,394] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 15: [2023-04-29 17:23:20,394] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 20: [2023-04-29 17:23:20,395] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 13: [2023-04-29 17:23:20,396] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 13: [2023-04-29 17:23:20,396] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 11: [2023-04-29 17:23:20,397] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 11: [2023-04-29 17:23:20,397] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 11: [2023-04-29 17:23:20,398] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 11: [2023-04-29 17:23:20,398] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 11: [2023-04-29 17:23:20,399] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 20: [2023-04-29 17:23:20,401] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 20: [2023-04-29 17:23:20,401] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 20: [2023-04-29 17:23:20,401] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 31: [2023-04-29 17:23:20,400] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 31: [2023-04-29 17:23:20,400] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 31: [2023-04-29 17:23:20,400] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 25: [2023-04-29 17:23:20,403] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 6: [2023-04-29 17:23:20,403] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 20: [2023-04-29 17:23:20,403] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 20: [2023-04-29 17:23:20,403] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 25: [2023-04-29 17:23:20,404] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 25: [2023-04-29 17:23:20,404] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 6: [2023-04-29 17:23:20,405] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 25: [2023-04-29 17:23:20,405] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 25: [2023-04-29 17:23:20,406] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 6: [2023-04-29 17:23:20,406] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 25: [2023-04-29 17:23:20,406] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 6: [2023-04-29 17:23:20,406] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 4: [2023-04-29 17:23:20,410] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 4: [2023-04-29 17:23:20,410] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 0: [2023-04-29 17:23:20,409] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 0: [2023-04-29 17:23:20,409] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 0: [2023-04-29 17:23:20,409] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 0: [2023-04-29 17:23:20,410] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 0: [2023-04-29 17:23:20,410] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 0: [2023-04-29 17:23:20,410] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 0: [2023-04-29 17:23:20,410] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 0: [2023-04-29 17:23:20,410] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 4: [2023-04-29 17:23:20,414] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 4: [2023-04-29 17:23:20,414] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 4: [2023-04-29 17:23:20,414] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 4: [2023-04-29 17:23:20,414] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 4: [2023-04-29 17:23:20,414] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 4: [2023-04-29 17:23:20,414] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 4: [2023-04-29 17:23:20,414] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 4: [2023-04-29 17:23:20,415] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 19: [2023-04-29 17:23:20,415] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 19: [2023-04-29 17:23:20,415] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 31: [2023-04-29 17:23:20,417] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 31: [2023-04-29 17:23:20,417] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 31: [2023-04-29 17:23:20,417] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 19: [2023-04-29 17:23:20,417] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 19: [2023-04-29 17:23:20,417] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 31: [2023-04-29 17:23:20,417] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 31: [2023-04-29 17:23:20,417] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 19: [2023-04-29 17:23:20,417] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 19: [2023-04-29 17:23:20,417] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 19: [2023-04-29 17:23:20,417] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 19: [2023-04-29 17:23:20,418] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 20: [2023-04-29 17:23:20,420] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 31: [2023-04-29 17:23:20,421] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 19: [2023-04-29 17:23:20,420] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 19: [2023-04-29 17:23:20,421] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 19: [2023-04-29 17:23:20,421] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 31: [2023-04-29 17:23:20,422] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 31: [2023-04-29 17:23:20,422] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 0: [2023-04-29 17:23:20,423] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 0: [2023-04-29 17:23:20,423] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 0: [2023-04-29 17:23:20,424] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 0: [2023-04-29 17:23:20,425] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 4: [2023-04-29 17:23:20,425] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 4: [2023-04-29 17:23:20,425] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 0: [2023-04-29 17:23:20,425] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 4: [2023-04-29 17:23:20,425] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 20: [2023-04-29 17:23:20,425] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 0: [2023-04-29 17:23:20,426] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 0: [2023-04-29 17:23:20,426] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 4: [2023-04-29 17:23:20,426] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 19: [2023-04-29 17:23:20,426] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 19: [2023-04-29 17:23:20,426] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 0: [2023-04-29 17:23:20,426] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 19: [2023-04-29 17:23:20,426] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 7: [2023-04-29 17:23:20,426] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 7: [2023-04-29 17:23:20,426] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 7: [2023-04-29 17:23:20,426] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 4: [2023-04-29 17:23:20,427] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 4: [2023-04-29 17:23:20,427] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 19: [2023-04-29 17:23:20,427] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 19: [2023-04-29 17:23:20,427] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 20: [2023-04-29 17:23:20,427] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 14: [2023-04-29 17:23:20,428] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 14: [2023-04-29 17:23:20,429] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 14: [2023-04-29 17:23:20,429] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 14: [2023-04-29 17:23:20,429] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 14: [2023-04-29 17:23:20,429] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 14: [2023-04-29 17:23:20,429] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 14: [2023-04-29 17:23:20,429] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 20: [2023-04-29 17:23:20,430] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 14: [2023-04-29 17:23:20,430] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 21: [2023-04-29 17:23:20,430] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 21: [2023-04-29 17:23:20,430] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 21: [2023-04-29 17:23:20,430] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 24: [2023-04-29 17:23:20,390] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 24: [2023-04-29 17:23:20,393] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 24: [2023-04-29 17:23:20,400] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 24: [2023-04-29 17:23:20,401] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 24: [2023-04-29 17:23:20,401] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 24: [2023-04-29 17:23:20,401] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 24: [2023-04-29 17:23:20,402] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 24: [2023-04-29 17:23:20,402] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 24: [2023-04-29 17:23:20,403] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 20: [2023-04-29 17:23:20,432] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 20: [2023-04-29 17:23:20,433] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 14: [2023-04-29 17:23:20,433] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 21: [2023-04-29 17:23:20,433] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 20: [2023-04-29 17:23:20,434] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 20: [2023-04-29 17:23:20,434] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 23: [2023-04-29 17:23:20,435] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 8: [2023-04-29 17:23:20,437] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 8: [2023-04-29 17:23:20,437] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 23: [2023-04-29 17:23:20,438] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 14: [2023-04-29 17:23:20,439] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 14: [2023-04-29 17:23:20,440] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 14: [2023-04-29 17:23:20,440] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 14: [2023-04-29 17:23:20,441] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 14: [2023-04-29 17:23:20,441] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 8: [2023-04-29 17:23:20,441] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 14: [2023-04-29 17:23:20,442] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 14: [2023-04-29 17:23:20,442] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 7: [2023-04-29 17:23:20,442] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 7: [2023-04-29 17:23:20,442] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 7: [2023-04-29 17:23:20,442] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 7: [2023-04-29 17:23:20,442] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 7: [2023-04-29 17:23:20,442] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 12: [2023-04-29 17:23:20,442] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 12: [2023-04-29 17:23:20,442] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 31: [2023-04-29 17:23:20,443] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 31: [2023-04-29 17:23:20,444] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 21: [2023-04-29 17:23:20,444] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 21: [2023-04-29 17:23:20,444] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 21: [2023-04-29 17:23:20,444] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 21: [2023-04-29 17:23:20,444] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 25: [2023-04-29 17:23:20,444] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 25: [2023-04-29 17:23:20,444] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 31: [2023-04-29 17:23:20,444] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 11: [2023-04-29 17:23:20,444] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 11: [2023-04-29 17:23:20,444] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 11: [2023-04-29 17:23:20,444] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 31: [2023-04-29 17:23:20,445] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 31: [2023-04-29 17:23:20,446] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 8: [2023-04-29 17:23:20,447] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 8: [2023-04-29 17:23:20,447] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 8: [2023-04-29 17:23:20,447] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 23: [2023-04-29 17:23:20,447] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 8: [2023-04-29 17:23:20,447] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 8: [2023-04-29 17:23:20,447] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 7: [2023-04-29 17:23:20,449] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 7: [2023-04-29 17:23:20,449] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 12: [2023-04-29 17:23:20,449] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 7: [2023-04-29 17:23:20,450] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 12: [2023-04-29 17:23:20,455] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 21: [2023-04-29 17:23:20,455] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 21: [2023-04-29 17:23:20,455] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 21: [2023-04-29 17:23:20,456] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 12: [2023-04-29 17:23:20,456] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 12: [2023-04-29 17:23:20,456] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 12: [2023-04-29 17:23:20,456] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 12: [2023-04-29 17:23:20,456] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 23: [2023-04-29 17:23:20,457] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 21: [2023-04-29 17:23:20,459] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 11: [2023-04-29 17:23:20,460] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 11: [2023-04-29 17:23:20,460] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 8: [2023-04-29 17:23:20,461] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 8: [2023-04-29 17:23:20,461] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 23: [2023-04-29 17:23:20,461] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 23: [2023-04-29 17:23:20,462] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 11: [2023-04-29 17:23:20,463] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 11: [2023-04-29 17:23:20,463] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 23: [2023-04-29 17:23:20,464] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 25: [2023-04-29 17:23:20,464] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 11: [2023-04-29 17:23:20,463] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 23: [2023-04-29 17:23:20,465] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 23: [2023-04-29 17:23:20,465] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 23: [2023-04-29 17:23:20,465] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 29: [2023-04-29 17:23:20,464] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 29: [2023-04-29 17:23:20,465] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 25: [2023-04-29 17:23:20,465] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 29: [2023-04-29 17:23:20,465] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 29: [2023-04-29 17:23:20,465] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 4: [2023-04-29 17:23:20,465] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 4: [2023-04-29 17:23:20,465] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 29: [2023-04-29 17:23:20,465] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 29: [2023-04-29 17:23:20,465] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 29: [2023-04-29 17:23:20,465] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 8: [2023-04-29 17:23:20,466] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 29: [2023-04-29 17:23:20,466] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 11: [2023-04-29 17:23:20,468] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 7: [2023-04-29 17:23:20,468] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 23: [2023-04-29 17:23:20,469] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 12: [2023-04-29 17:23:20,469] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 27: [2023-04-29 17:23:20,469] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 29: [2023-04-29 17:23:20,468] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 27: [2023-04-29 17:23:20,469] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 27: [2023-04-29 17:23:20,469] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 27: [2023-04-29 17:23:20,469] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 27: [2023-04-29 17:23:20,469] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 21: [2023-04-29 17:23:20,470] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 27: [2023-04-29 17:23:20,469] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 27: [2023-04-29 17:23:20,470] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 27: [2023-04-29 17:23:20,470] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 11: [2023-04-29 17:23:20,470] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 11: [2023-04-29 17:23:20,470] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 21: [2023-04-29 17:23:20,471] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 7: [2023-04-29 17:23:20,471] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 21: [2023-04-29 17:23:20,471] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 7: [2023-04-29 17:23:20,471] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 25: [2023-04-29 17:23:20,470] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 25: [2023-04-29 17:23:20,470] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 12: [2023-04-29 17:23:20,471] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 21: [2023-04-29 17:23:20,471] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 27: [2023-04-29 17:23:20,472] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 7: [2023-04-29 17:23:20,473] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 7: [2023-04-29 17:23:20,473] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 25: [2023-04-29 17:23:20,475] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 25: [2023-04-29 17:23:20,475] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 25: [2023-04-29 17:23:20,475] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 25: [2023-04-29 17:23:20,475] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 24: [2023-04-29 17:23:20,444] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 24: [2023-04-29 17:23:20,466] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 24: [2023-04-29 17:23:20,470] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 27: [2023-04-29 17:23:20,475] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 19: [2023-04-29 17:23:20,475] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 19: [2023-04-29 17:23:20,475] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 19: [2023-04-29 17:23:20,475] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 29: [2023-04-29 17:23:20,476] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 29: [2023-04-29 17:23:20,477] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 29: [2023-04-29 17:23:20,478] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 29: [2023-04-29 17:23:20,478] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 24: [2023-04-29 17:23:20,478] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 24: [2023-04-29 17:23:20,478] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 24: [2023-04-29 17:23:20,478] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 29: [2023-04-29 17:23:20,478] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 8: [2023-04-29 17:23:20,478] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 29: [2023-04-29 17:23:20,479] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 22: [2023-04-29 17:23:20,479] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 22: [2023-04-29 17:23:20,479] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 29: [2023-04-29 17:23:20,479] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 27: [2023-04-29 17:23:20,479] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 27: [2023-04-29 17:23:20,479] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 27: [2023-04-29 17:23:20,480] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 8: [2023-04-29 17:23:20,480] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 8: [2023-04-29 17:23:20,480] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 8: [2023-04-29 17:23:20,480] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 22: [2023-04-29 17:23:20,480] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 22: [2023-04-29 17:23:20,481] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 22: [2023-04-29 17:23:20,481] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 22: [2023-04-29 17:23:20,481] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 22: [2023-04-29 17:23:20,481] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 27: [2023-04-29 17:23:20,481] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 27: [2023-04-29 17:23:20,481] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 22: [2023-04-29 17:23:20,481] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 27: [2023-04-29 17:23:20,481] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 8: [2023-04-29 17:23:20,482] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 14: [2023-04-29 17:23:20,482] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 24: [2023-04-29 17:23:20,483] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 24: [2023-04-29 17:23:20,483] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 24: [2023-04-29 17:23:20,483] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 22: [2023-04-29 17:23:20,483] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 22: [2023-04-29 17:23:20,483] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 12: [2023-04-29 17:23:20,485] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 4: [2023-04-29 17:23:20,487] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 4: [2023-04-29 17:23:20,488] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 12: [2023-04-29 17:23:20,489] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 11: [2023-04-29 17:23:20,490] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 19: [2023-04-29 17:23:20,490] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 23: [2023-04-29 17:23:20,490] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 12: [2023-04-29 17:23:20,491] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 12: [2023-04-29 17:23:20,492] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 22: [2023-04-29 17:23:20,491] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 22: [2023-04-29 17:23:20,491] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 22: [2023-04-29 17:23:20,492] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 12: [2023-04-29 17:23:20,492] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 12: [2023-04-29 17:23:20,492] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 11: [2023-04-29 17:23:20,493] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 19: [2023-04-29 17:23:20,493] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 19: [2023-04-29 17:23:20,493] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 19: [2023-04-29 17:23:20,493] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 19: [2023-04-29 17:23:20,493] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 11: [2023-04-29 17:23:20,493] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 22: [2023-04-29 17:23:20,493] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 22: [2023-04-29 17:23:20,493] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 22: [2023-04-29 17:23:20,493] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 23: [2023-04-29 17:23:20,494] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 25: [2023-04-29 17:23:20,495] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 23: [2023-04-29 17:23:20,495] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 19: [2023-04-29 17:23:20,495] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 11: [2023-04-29 17:23:20,496] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 11: [2023-04-29 17:23:20,496] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 25: [2023-04-29 17:23:20,497] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 4: [2023-04-29 17:23:20,497] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 23: [2023-04-29 17:23:20,497] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 4: [2023-04-29 17:23:20,497] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 4: [2023-04-29 17:23:20,497] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 4: [2023-04-29 17:23:20,497] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 19: [2023-04-29 17:23:20,498] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 4: [2023-04-29 17:23:20,498] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 4: [2023-04-29 17:23:20,498] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 19: [2023-04-29 17:23:20,499] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 23: [2023-04-29 17:23:20,499] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 14: [2023-04-29 17:23:20,502] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 0: [2023-04-29 17:23:20,502] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 0: [2023-04-29 17:23:20,502] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 0: [2023-04-29 17:23:20,502] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 25: [2023-04-29 17:23:20,502] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 25: [2023-04-29 17:23:20,503] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 2: [2023-04-29 17:23:20,505] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 2: [2023-04-29 17:23:20,505] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 2: [2023-04-29 17:23:20,506] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 25: [2023-04-29 17:23:20,506] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 2: [2023-04-29 17:23:20,507] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 2: [2023-04-29 17:23:20,507] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 2: [2023-04-29 17:23:20,507] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 2: [2023-04-29 17:23:20,507] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 2: [2023-04-29 17:23:20,507] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 25: [2023-04-29 17:23:20,506] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 2: [2023-04-29 17:23:20,510] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 2: [2023-04-29 17:23:20,510] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 26: [2023-04-29 17:23:20,510] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 10: [2023-04-29 17:23:20,510] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 10: [2023-04-29 17:23:20,510] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 10: [2023-04-29 17:23:20,510] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 10: [2023-04-29 17:23:20,510] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 10: [2023-04-29 17:23:20,510] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 2: [2023-04-29 17:23:20,511] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 10: [2023-04-29 17:23:20,510] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 10: [2023-04-29 17:23:20,510] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 26: [2023-04-29 17:23:20,510] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 26: [2023-04-29 17:23:20,511] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 26: [2023-04-29 17:23:20,511] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 10: [2023-04-29 17:23:20,511] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 26: [2023-04-29 17:23:20,511] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 26: [2023-04-29 17:23:20,511] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 26: [2023-04-29 17:23:20,511] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 26: [2023-04-29 17:23:20,511] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 14: [2023-04-29 17:23:20,512] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 14: [2023-04-29 17:23:20,512] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 10: [2023-04-29 17:23:20,515] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 10: [2023-04-29 17:23:20,515] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 27: [2023-04-29 17:23:20,515] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 10: [2023-04-29 17:23:20,516] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 10: [2023-04-29 17:23:20,516] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 2: [2023-04-29 17:23:20,515] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 2: [2023-04-29 17:23:20,516] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 19: [2023-04-29 17:23:20,516] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 2: [2023-04-29 17:23:20,517] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 0: [2023-04-29 17:23:20,517] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 0: [2023-04-29 17:23:20,517] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 0: [2023-04-29 17:23:20,517] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 0: [2023-04-29 17:23:20,517] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 0: [2023-04-29 17:23:20,517] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 29: [2023-04-29 17:23:20,517] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 2: [2023-04-29 17:23:20,517] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 26: [2023-04-29 17:23:20,517] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 26: [2023-04-29 17:23:20,517] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 26: [2023-04-29 17:23:20,517] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 10: [2023-04-29 17:23:20,518] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 2: [2023-04-29 17:23:20,518] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 9: [2023-04-29 17:23:20,518] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 9: [2023-04-29 17:23:20,518] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 9: [2023-04-29 17:23:20,518] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 9: [2023-04-29 17:23:20,518] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 9: [2023-04-29 17:23:20,518] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 26: [2023-04-29 17:23:20,518] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 9: [2023-04-29 17:23:20,518] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 9: [2023-04-29 17:23:20,518] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 9: [2023-04-29 17:23:20,518] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 26: [2023-04-29 17:23:20,519] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 10: [2023-04-29 17:23:20,519] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 26: [2023-04-29 17:23:20,519] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 26: [2023-04-29 17:23:20,519] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 26: [2023-04-29 17:23:20,519] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 10: [2023-04-29 17:23:20,519] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 10: [2023-04-29 17:23:20,520] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 19: [2023-04-29 17:23:20,520] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 28: [2023-04-29 17:23:20,519] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 28: [2023-04-29 17:23:20,519] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 28: [2023-04-29 17:23:20,519] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 28: [2023-04-29 17:23:20,520] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 28: [2023-04-29 17:23:20,520] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 28: [2023-04-29 17:23:20,520] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 28: [2023-04-29 17:23:20,520] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 28: [2023-04-29 17:23:20,520] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 14: [2023-04-29 17:23:20,521] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 14: [2023-04-29 17:23:20,521] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 14: [2023-04-29 17:23:20,521] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 14: [2023-04-29 17:23:20,521] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 19: [2023-04-29 17:23:20,523] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 9: [2023-04-29 17:23:20,523] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 9: [2023-04-29 17:23:20,523] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 19: [2023-04-29 17:23:20,523] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 14: [2023-04-29 17:23:20,523] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 19: [2023-04-29 17:23:20,523] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 9: [2023-04-29 17:23:20,523] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 9: [2023-04-29 17:23:20,523] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 9: [2023-04-29 17:23:20,524] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 9: [2023-04-29 17:23:20,524] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 9: [2023-04-29 17:23:20,524] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 9: [2023-04-29 17:23:20,524] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 24: [2023-04-29 17:23:20,495] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 24: [2023-04-29 17:23:20,507] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 24: [2023-04-29 17:23:20,508] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 24: [2023-04-29 17:23:20,511] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 24: [2023-04-29 17:23:20,516] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 24: [2023-04-29 17:23:20,516] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 24: [2023-04-29 17:23:20,516] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 0: [2023-04-29 17:23:20,529] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 27: [2023-04-29 17:23:20,530] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 18: [2023-04-29 17:23:20,530] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 18: [2023-04-29 17:23:20,530] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 18: [2023-04-29 17:23:20,530] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 18: [2023-04-29 17:23:20,531] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 18: [2023-04-29 17:23:20,531] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 18: [2023-04-29 17:23:20,531] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 18: [2023-04-29 17:23:20,531] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 18: [2023-04-29 17:23:20,531] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 4: [2023-04-29 17:23:20,531] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 4: [2023-04-29 17:23:20,532] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 1: [2023-04-29 17:23:20,532] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 1: [2023-04-29 17:23:20,532] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 1: [2023-04-29 17:23:20,532] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 1: [2023-04-29 17:23:20,532] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 1: [2023-04-29 17:23:20,532] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 1: [2023-04-29 17:23:20,532] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 1: [2023-04-29 17:23:20,532] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 1: [2023-04-29 17:23:20,533] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 28: [2023-04-29 17:23:20,533] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 28: [2023-04-29 17:23:20,534] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 28: [2023-04-29 17:23:20,534] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 28: [2023-04-29 17:23:20,535] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 28: [2023-04-29 17:23:20,535] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 0: [2023-04-29 17:23:20,535] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 27: [2023-04-29 17:23:20,535] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 0: [2023-04-29 17:23:20,535] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 28: [2023-04-29 17:23:20,535] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 28: [2023-04-29 17:23:20,535] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 29: [2023-04-29 17:23:20,536] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 14: [2023-04-29 17:23:20,536] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 22: [2023-04-29 17:23:20,535] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 22: [2023-04-29 17:23:20,535] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 28: [2023-04-29 17:23:20,536] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 14: [2023-04-29 17:23:20,536] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 4: [2023-04-29 17:23:20,537] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 4: [2023-04-29 17:23:20,537] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 1: [2023-04-29 17:23:20,537] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 1: [2023-04-29 17:23:20,538] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 1: [2023-04-29 17:23:20,538] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 1: [2023-04-29 17:23:20,538] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 4: [2023-04-29 17:23:20,539] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 4: [2023-04-29 17:23:20,539] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 1: [2023-04-29 17:23:20,539] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 1: [2023-04-29 17:23:20,539] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 1: [2023-04-29 17:23:20,540] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 1: [2023-04-29 17:23:20,540] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 18: [2023-04-29 17:23:20,542] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 18: [2023-04-29 17:23:20,544] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 18: [2023-04-29 17:23:20,544] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 18: [2023-04-29 17:23:20,544] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 18: [2023-04-29 17:23:20,545] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 18: [2023-04-29 17:23:20,545] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 18: [2023-04-29 17:23:20,545] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 18: [2023-04-29 17:23:20,546] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 27: [2023-04-29 17:23:20,549] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 27: [2023-04-29 17:23:20,549] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 27: [2023-04-29 17:23:20,549] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 0: [2023-04-29 17:23:20,550] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 27: [2023-04-29 17:23:20,550] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 27: [2023-04-29 17:23:20,550] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 27: [2023-04-29 17:23:20,550] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 0: [2023-04-29 17:23:20,551] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 29: [2023-04-29 17:23:20,551] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 29: [2023-04-29 17:23:20,551] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 0: [2023-04-29 17:23:20,551] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 27: [2023-04-29 17:23:20,552] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 14: [2023-04-29 17:23:20,553] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 0: [2023-04-29 17:23:20,554] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 0: [2023-04-29 17:23:20,554] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 14: [2023-04-29 17:23:20,555] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 22: [2023-04-29 17:23:20,556] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 22: [2023-04-29 17:23:20,557] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 29: [2023-04-29 17:23:20,557] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 29: [2023-04-29 17:23:20,557] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 29: [2023-04-29 17:23:20,557] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 29: [2023-04-29 17:23:20,557] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 29: [2023-04-29 17:23:20,557] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 14: [2023-04-29 17:23:20,558] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 14: [2023-04-29 17:23:20,558] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 14: [2023-04-29 17:23:20,558] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 22: [2023-04-29 17:23:20,559] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 22: [2023-04-29 17:23:20,559] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 22: [2023-04-29 17:23:20,559] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 2: [2023-04-29 17:23:20,563] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 2: [2023-04-29 17:23:20,563] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 2: [2023-04-29 17:23:20,563] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 22: [2023-04-29 17:23:20,564] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 22: [2023-04-29 17:23:20,564] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 22: [2023-04-29 17:23:20,565] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 16: [2023-04-29 17:23:20,569] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 16: [2023-04-29 17:23:20,569] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 16: [2023-04-29 17:23:20,569] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 30: [2023-04-29 17:23:20,569] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 16: [2023-04-29 17:23:20,570] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 16: [2023-04-29 17:23:20,570] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 16: [2023-04-29 17:23:20,570] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 16: [2023-04-29 17:23:20,570] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 30: [2023-04-29 17:23:20,570] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 30: [2023-04-29 17:23:20,570] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 30: [2023-04-29 17:23:20,570] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 30: [2023-04-29 17:23:20,570] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 30: [2023-04-29 17:23:20,570] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 30: [2023-04-29 17:23:20,570] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 16: [2023-04-29 17:23:20,570] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 30: [2023-04-29 17:23:20,570] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 26: [2023-04-29 17:23:20,570] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 26: [2023-04-29 17:23:20,570] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 10: [2023-04-29 17:23:20,572] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 10: [2023-04-29 17:23:20,572] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 10: [2023-04-29 17:23:20,572] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 10: [2023-04-29 17:23:20,572] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 26: [2023-04-29 17:23:20,574] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 15: [2023-04-29 17:23:20,575] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 15: [2023-04-29 17:23:20,575] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 15: [2023-04-29 17:23:20,575] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 15: [2023-04-29 17:23:20,575] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 15: [2023-04-29 17:23:20,575] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 16: [2023-04-29 17:23:20,576] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 16: [2023-04-29 17:23:20,576] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 16: [2023-04-29 17:23:20,576] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 16: [2023-04-29 17:23:20,576] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 26: [2023-04-29 17:23:20,576] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 16: [2023-04-29 17:23:20,577] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 16: [2023-04-29 17:23:20,577] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 16: [2023-04-29 17:23:20,577] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 16: [2023-04-29 17:23:20,577] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 10: [2023-04-29 17:23:20,578] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 10: [2023-04-29 17:23:20,578] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 10: [2023-04-29 17:23:20,578] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 10: [2023-04-29 17:23:20,578] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 29: [2023-04-29 17:23:20,579] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 29: [2023-04-29 17:23:20,579] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 27: [2023-04-29 17:23:20,579] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 27: [2023-04-29 17:23:20,579] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 2: [2023-04-29 17:23:20,579] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 2: [2023-04-29 17:23:20,579] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 2: [2023-04-29 17:23:20,579] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 9: [2023-04-29 17:23:20,580] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 9: [2023-04-29 17:23:20,580] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 9: [2023-04-29 17:23:20,580] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 9: [2023-04-29 17:23:20,581] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 30: [2023-04-29 17:23:20,581] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 30: [2023-04-29 17:23:20,581] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 30: [2023-04-29 17:23:20,581] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 30: [2023-04-29 17:23:20,581] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 27: [2023-04-29 17:23:20,581] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 30: [2023-04-29 17:23:20,582] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 30: [2023-04-29 17:23:20,582] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 26: [2023-04-29 17:23:20,582] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 26: [2023-04-29 17:23:20,582] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 26: [2023-04-29 17:23:20,582] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 26: [2023-04-29 17:23:20,582] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 2: [2023-04-29 17:23:20,582] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 2: [2023-04-29 17:23:20,582] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 27: [2023-04-29 17:23:20,582] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 30: [2023-04-29 17:23:20,584] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 2: [2023-04-29 17:23:20,584] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 27: [2023-04-29 17:23:20,584] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 30: [2023-04-29 17:23:20,584] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 9: [2023-04-29 17:23:20,584] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 9: [2023-04-29 17:23:20,584] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 9: [2023-04-29 17:23:20,584] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 9: [2023-04-29 17:23:20,584] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 2: [2023-04-29 17:23:20,584] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 27: [2023-04-29 17:23:20,585] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 2: [2023-04-29 17:23:20,585] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 22: [2023-04-29 17:23:20,585] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 17: [2023-04-29 17:23:20,586] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 17: [2023-04-29 17:23:20,586] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 22: [2023-04-29 17:23:20,587] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 17: [2023-04-29 17:23:20,587] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 17: [2023-04-29 17:23:20,587] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 17: [2023-04-29 17:23:20,587] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 17: [2023-04-29 17:23:20,587] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 17: [2023-04-29 17:23:20,587] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 17: [2023-04-29 17:23:20,587] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 6: [2023-04-29 17:23:20,588] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 6: [2023-04-29 17:23:20,588] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 6: [2023-04-29 17:23:20,588] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 6: [2023-04-29 17:23:20,588] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 6: [2023-04-29 17:23:20,588] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 6: [2023-04-29 17:23:20,588] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 6: [2023-04-29 17:23:20,588] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 6: [2023-04-29 17:23:20,588] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 22: [2023-04-29 17:23:20,589] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 29: [2023-04-29 17:23:20,589] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 17: [2023-04-29 17:23:20,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 29: [2023-04-29 17:23:20,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 29: [2023-04-29 17:23:20,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 29: [2023-04-29 17:23:20,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 6: [2023-04-29 17:23:20,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 6: [2023-04-29 17:23:20,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 17: [2023-04-29 17:23:20,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 29: [2023-04-29 17:23:20,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 26: [2023-04-29 17:23:20,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 26: [2023-04-29 17:23:20,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 22: [2023-04-29 17:23:20,595] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 22: [2023-04-29 17:23:20,595] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 1: [2023-04-29 17:23:20,595] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 1: [2023-04-29 17:23:20,595] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 1: [2023-04-29 17:23:20,595] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 1: [2023-04-29 17:23:20,595] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 22: [2023-04-29 17:23:20,596] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 6: [2023-04-29 17:23:20,597] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 10: [2023-04-29 17:23:20,597] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 17: [2023-04-29 17:23:20,597] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 17: [2023-04-29 17:23:20,597] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 6: [2023-04-29 17:23:20,598] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 6: [2023-04-29 17:23:20,598] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 17: [2023-04-29 17:23:20,598] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 17: [2023-04-29 17:23:20,598] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 6: [2023-04-29 17:23:20,598] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 17: [2023-04-29 17:23:20,599] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 6: [2023-04-29 17:23:20,599] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 10: [2023-04-29 17:23:20,599] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 10: [2023-04-29 17:23:20,599] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 6: [2023-04-29 17:23:20,599] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 17: [2023-04-29 17:23:20,599] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 10: [2023-04-29 17:23:20,600] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 26: [2023-04-29 17:23:20,600] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 1: [2023-04-29 17:23:20,600] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 1: [2023-04-29 17:23:20,601] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 1: [2023-04-29 17:23:20,601] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 1: [2023-04-29 17:23:20,601] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 26: [2023-04-29 17:23:20,602] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 10: [2023-04-29 17:23:20,605] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 2: [2023-04-29 17:23:20,607] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 5: [2023-04-29 17:23:20,607] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 9: [2023-04-29 17:23:20,607] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 10: [2023-04-29 17:23:20,606] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 26: [2023-04-29 17:23:20,607] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 5: [2023-04-29 17:23:20,607] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 10: [2023-04-29 17:23:20,608] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 10: [2023-04-29 17:23:20,608] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 9: [2023-04-29 17:23:20,608] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 9: [2023-04-29 17:23:20,609] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 9: [2023-04-29 17:23:20,609] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 9: [2023-04-29 17:23:20,609] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 9: [2023-04-29 17:23:20,609] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 2: [2023-04-29 17:23:20,610] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 2: [2023-04-29 17:23:20,610] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 28: [2023-04-29 17:23:20,611] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 28: [2023-04-29 17:23:20,611] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 9: [2023-04-29 17:23:20,611] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 5: [2023-04-29 17:23:20,611] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 5: [2023-04-29 17:23:20,611] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 5: [2023-04-29 17:23:20,611] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 5: [2023-04-29 17:23:20,611] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 5: [2023-04-29 17:23:20,611] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 5: [2023-04-29 17:23:20,611] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 28: [2023-04-29 17:23:20,611] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 5: [2023-04-29 17:23:20,611] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 5: [2023-04-29 17:23:20,611] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 9: [2023-04-29 17:23:20,611] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 26: [2023-04-29 17:23:20,612] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 26: [2023-04-29 17:23:20,612] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 26: [2023-04-29 17:23:20,612] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 2: [2023-04-29 17:23:20,613] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 2: [2023-04-29 17:23:20,613] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 1: [2023-04-29 17:23:20,618] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 1: [2023-04-29 17:23:20,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 15: [2023-04-29 17:23:20,575] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 15: [2023-04-29 17:23:20,575] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 15: [2023-04-29 17:23:20,575] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 15: [2023-04-29 17:23:20,589] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 15: [2023-04-29 17:23:20,589] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 15: [2023-04-29 17:23:20,589] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 15: [2023-04-29 17:23:20,590] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 15: [2023-04-29 17:23:20,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 15: [2023-04-29 17:23:20,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 15: [2023-04-29 17:23:20,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 15: [2023-04-29 17:23:20,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 18: [2023-04-29 17:23:20,620] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 18: [2023-04-29 17:23:20,620] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 18: [2023-04-29 17:23:20,620] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 5: [2023-04-29 17:23:20,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 5: [2023-04-29 17:23:20,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 5: [2023-04-29 17:23:20,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 5: [2023-04-29 17:23:20,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 1: [2023-04-29 17:23:20,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 1: [2023-04-29 17:23:20,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 5: [2023-04-29 17:23:20,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 5: [2023-04-29 17:23:20,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt... 28: [2023-04-29 17:23:20,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 28: [2023-04-29 17:23:20,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 28: [2023-04-29 17:23:20,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 28: [2023-04-29 17:23:20,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 28: [2023-04-29 17:23:20,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 1: [2023-04-29 17:23:20,628] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 20: [2023-04-29 17:23:20,629] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 20: [2023-04-29 17:23:20,629] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 20: [2023-04-29 17:23:20,629] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 1: [2023-04-29 17:23:20,630] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 20: [2023-04-29 17:23:20,630] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 20: [2023-04-29 17:23:20,630] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 1: [2023-04-29 17:23:20,630] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 20: [2023-04-29 17:23:20,630] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 20: [2023-04-29 17:23:20,630] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 16: [2023-04-29 17:23:20,630] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 16: [2023-04-29 17:23:20,630] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 1: [2023-04-29 17:23:20,630] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 20: [2023-04-29 17:23:20,631] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 16: [2023-04-29 17:23:20,634] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 18: [2023-04-29 17:23:20,634] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 18: [2023-04-29 17:23:20,634] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 18: [2023-04-29 17:23:20,634] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 18: [2023-04-29 17:23:20,634] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 18: [2023-04-29 17:23:20,634] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 20: [2023-04-29 17:23:20,635] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 20: [2023-04-29 17:23:20,636] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 28: [2023-04-29 17:23:20,636] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 20: [2023-04-29 17:23:20,637] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 28: [2023-04-29 17:23:20,637] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 20: [2023-04-29 17:23:20,638] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 28: [2023-04-29 17:23:20,638] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 20: [2023-04-29 17:23:20,639] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 20: [2023-04-29 17:23:20,639] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 20: [2023-04-29 17:23:20,640] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 20: [2023-04-29 17:23:20,641] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 17: [2023-04-29 17:23:20,643] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 6: [2023-04-29 17:23:20,644] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 6: [2023-04-29 17:23:20,644] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 18: [2023-04-29 17:23:20,645] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 16: [2023-04-29 17:23:20,645] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 16: [2023-04-29 17:23:20,645] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 16: [2023-04-29 17:23:20,645] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 16: [2023-04-29 17:23:20,645] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 16: [2023-04-29 17:23:20,645] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 18: [2023-04-29 17:23:20,645] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 18: [2023-04-29 17:23:20,646] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 17: [2023-04-29 17:23:20,646] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 16: [2023-04-29 17:23:20,653] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 16: [2023-04-29 17:23:20,654] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 30: [2023-04-29 17:23:20,654] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 3: [2023-04-29 17:23:20,659] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 3: [2023-04-29 17:23:20,659] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 28: [2023-04-29 17:23:20,659] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 3: [2023-04-29 17:23:20,659] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 3: [2023-04-29 17:23:20,659] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 3: [2023-04-29 17:23:20,659] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 28: [2023-04-29 17:23:20,659] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 3: [2023-04-29 17:23:20,659] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 3: [2023-04-29 17:23:20,659] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 28: [2023-04-29 17:23:20,659] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 16: [2023-04-29 17:23:20,660] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 3: [2023-04-29 17:23:20,660] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 5: [2023-04-29 17:23:20,661] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 5: [2023-04-29 17:23:20,661] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 28: [2023-04-29 17:23:20,662] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 28: [2023-04-29 17:23:20,663] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 3: [2023-04-29 17:23:20,663] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 3: [2023-04-29 17:23:20,663] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 6: [2023-04-29 17:23:20,664] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 6: [2023-04-29 17:23:20,665] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 17: [2023-04-29 17:23:20,665] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 6: [2023-04-29 17:23:20,665] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 17: [2023-04-29 17:23:20,665] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 18: [2023-04-29 17:23:20,665] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 3: [2023-04-29 17:23:20,665] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 17: [2023-04-29 17:23:20,666] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 3: [2023-04-29 17:23:20,666] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 3: [2023-04-29 17:23:20,667] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 3: [2023-04-29 17:23:20,667] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 3: [2023-04-29 17:23:20,667] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 3: [2023-04-29 17:23:20,667] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 18: [2023-04-29 17:23:20,667] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 18: [2023-04-29 17:23:20,668] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 18: [2023-04-29 17:23:20,668] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 18: [2023-04-29 17:23:20,669] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 15: [2023-04-29 17:23:20,669] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 15: [2023-04-29 17:23:20,669] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 15: [2023-04-29 17:23:20,669] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 15: [2023-04-29 17:23:20,669] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 17: [2023-04-29 17:23:20,669] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 17: [2023-04-29 17:23:20,671] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 17: [2023-04-29 17:23:20,671] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 17: [2023-04-29 17:23:20,671] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 16: [2023-04-29 17:23:20,672] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 16: [2023-04-29 17:23:20,672] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 6: [2023-04-29 17:23:20,672] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 6: [2023-04-29 17:23:20,672] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 6: [2023-04-29 17:23:20,672] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 6: [2023-04-29 17:23:20,672] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 16: [2023-04-29 17:23:20,672] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 6: [2023-04-29 17:23:20,672] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 30: [2023-04-29 17:23:20,672] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 30: [2023-04-29 17:23:20,672] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 30: [2023-04-29 17:23:20,672] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 30: [2023-04-29 17:23:20,672] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 30: [2023-04-29 17:23:20,672] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 30: [2023-04-29 17:23:20,672] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 30: [2023-04-29 17:23:20,672] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 16: [2023-04-29 17:23:20,673] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 15: [2023-04-29 17:23:20,673] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 15: [2023-04-29 17:23:20,673] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 15: [2023-04-29 17:23:20,673] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 15: [2023-04-29 17:23:20,673] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 16: [2023-04-29 17:23:20,674] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 13: [2023-04-29 17:23:20,674] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 13: [2023-04-29 17:23:20,675] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 13: [2023-04-29 17:23:20,675] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 17: [2023-04-29 17:23:20,675] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 13: [2023-04-29 17:23:20,675] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 13: [2023-04-29 17:23:20,675] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 13: [2023-04-29 17:23:20,675] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 13: [2023-04-29 17:23:20,675] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 13: [2023-04-29 17:23:20,676] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 30: [2023-04-29 17:23:20,677] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 13: [2023-04-29 17:23:20,680] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 5: [2023-04-29 17:23:20,681] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 5: [2023-04-29 17:23:20,681] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 13: [2023-04-29 17:23:20,681] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 25: [2023-04-29 17:23:20,683] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 25: [2023-04-29 17:23:20,683] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 8: [2023-04-29 17:23:20,684] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 8: [2023-04-29 17:23:20,684] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 8: [2023-04-29 17:23:20,684] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 8: [2023-04-29 17:23:20,684] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 8: [2023-04-29 17:23:20,684] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 8: [2023-04-29 17:23:20,684] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 8: [2023-04-29 17:23:20,684] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 8: [2023-04-29 17:23:20,685] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 13: [2023-04-29 17:23:20,686] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 13: [2023-04-29 17:23:20,687] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 25: [2023-04-29 17:23:20,687] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 25: [2023-04-29 17:23:20,687] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 25: [2023-04-29 17:23:20,687] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 13: [2023-04-29 17:23:20,687] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 25: [2023-04-29 17:23:20,687] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 13: [2023-04-29 17:23:20,687] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 25: [2023-04-29 17:23:20,687] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 25: [2023-04-29 17:23:20,687] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 25: [2023-04-29 17:23:20,688] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 13: [2023-04-29 17:23:20,688] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 13: [2023-04-29 17:23:20,688] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 17: [2023-04-29 17:23:20,689] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 25: [2023-04-29 17:23:20,689] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 12: [2023-04-29 17:23:20,689] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 12: [2023-04-29 17:23:20,689] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 12: [2023-04-29 17:23:20,689] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 12: [2023-04-29 17:23:20,689] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 12: [2023-04-29 17:23:20,689] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 12: [2023-04-29 17:23:20,689] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 12: [2023-04-29 17:23:20,689] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 12: [2023-04-29 17:23:20,689] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 6: [2023-04-29 17:23:20,690] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 5: [2023-04-29 17:23:20,690] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 5: [2023-04-29 17:23:20,690] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 25: [2023-04-29 17:23:20,691] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 8: [2023-04-29 17:23:20,690] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 17: [2023-04-29 17:23:20,691] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 20: [2023-04-29 17:23:20,691] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 20: [2023-04-29 17:23:20,691] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 8: [2023-04-29 17:23:20,692] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 8: [2023-04-29 17:23:20,692] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 20: [2023-04-29 17:23:20,692] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 8: [2023-04-29 17:23:20,693] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 5: [2023-04-29 17:23:20,693] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 5: [2023-04-29 17:23:20,693] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 5: [2023-04-29 17:23:20,693] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 5: [2023-04-29 17:23:20,693] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_08-model_00-model_states.pt. 8: [2023-04-29 17:23:20,693] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 8: [2023-04-29 17:23:20,694] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 8: [2023-04-29 17:23:20,694] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 8: [2023-04-29 17:23:20,695] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 20: [2023-04-29 17:23:20,695] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 24: [2023-04-29 17:23:20,695] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 24: [2023-04-29 17:23:20,696] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 24: [2023-04-29 17:23:20,696] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 24: [2023-04-29 17:23:20,696] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 24: [2023-04-29 17:23:20,696] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 24: [2023-04-29 17:23:20,696] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 12: [2023-04-29 17:23:20,696] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 12: [2023-04-29 17:23:20,696] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 24: [2023-04-29 17:23:20,696] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 25: [2023-04-29 17:23:20,696] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 25: [2023-04-29 17:23:20,697] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 24: [2023-04-29 17:23:20,697] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 25: [2023-04-29 17:23:20,697] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 12: [2023-04-29 17:23:20,697] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 25: [2023-04-29 17:23:20,697] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 25: [2023-04-29 17:23:20,698] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 17: [2023-04-29 17:23:20,699] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 24: [2023-04-29 17:23:20,699] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 12: [2023-04-29 17:23:20,699] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 12: [2023-04-29 17:23:20,699] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 12: [2023-04-29 17:23:20,700] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 6: [2023-04-29 17:23:20,700] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 12: [2023-04-29 17:23:20,700] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 6: [2023-04-29 17:23:20,700] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 12: [2023-04-29 17:23:20,700] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 17: [2023-04-29 17:23:20,703] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 17: [2023-04-29 17:23:20,703] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 17: [2023-04-29 17:23:20,703] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 6: [2023-04-29 17:23:20,704] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 20: [2023-04-29 17:23:20,704] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 20: [2023-04-29 17:23:20,704] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 6: [2023-04-29 17:23:20,705] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 6: [2023-04-29 17:23:20,705] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 20: [2023-04-29 17:23:20,707] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 20: [2023-04-29 17:23:20,707] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 30: [2023-04-29 17:23:20,707] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 24: [2023-04-29 17:23:20,707] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 30: [2023-04-29 17:23:20,708] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 24: [2023-04-29 17:23:20,708] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 24: [2023-04-29 17:23:20,708] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 24: [2023-04-29 17:23:20,708] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 24: [2023-04-29 17:23:20,709] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 24: [2023-04-29 17:23:20,709] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 24: [2023-04-29 17:23:20,710] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 30: [2023-04-29 17:23:20,712] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 30: [2023-04-29 17:23:20,712] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 30: [2023-04-29 17:23:20,713] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 30: [2023-04-29 17:23:20,714] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 30: [2023-04-29 17:23:20,715] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 3: [2023-04-29 17:23:20,714] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 3: [2023-04-29 17:23:20,714] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 15: [2023-04-29 17:23:20,702] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 15: [2023-04-29 17:23:20,703] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 15: [2023-04-29 17:23:20,705] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 15: [2023-04-29 17:23:20,706] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 15: [2023-04-29 17:23:20,708] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 15: [2023-04-29 17:23:20,711] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 15: [2023-04-29 17:23:20,712] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 15: [2023-04-29 17:23:20,712] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 20: [2023-04-29 17:23:20,715] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 20: [2023-04-29 17:23:20,715] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 5: [2023-04-29 17:23:20,716] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 20: [2023-04-29 17:23:20,720] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 20: [2023-04-29 17:23:20,720] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 19: [2023-04-29 17:23:20,720] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 19: [2023-04-29 17:23:20,720] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 5: [2023-04-29 17:23:20,721] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 23: [2023-04-29 17:23:20,721] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 23: [2023-04-29 17:23:20,721] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 19: [2023-04-29 17:23:20,722] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 19: [2023-04-29 17:23:20,722] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 19: [2023-04-29 17:23:20,722] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 19: [2023-04-29 17:23:20,722] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 19: [2023-04-29 17:23:20,722] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 19: [2023-04-29 17:23:20,723] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 11: [2023-04-29 17:23:20,725] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 11: [2023-04-29 17:23:20,725] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 5: [2023-04-29 17:23:20,725] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 19: [2023-04-29 17:23:20,725] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 19: [2023-04-29 17:23:20,725] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 19: [2023-04-29 17:23:20,726] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 23: [2023-04-29 17:23:20,726] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 23: [2023-04-29 17:23:20,726] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 23: [2023-04-29 17:23:20,726] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 23: [2023-04-29 17:23:20,726] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 23: [2023-04-29 17:23:20,726] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 23: [2023-04-29 17:23:20,726] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 23: [2023-04-29 17:23:20,726] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 11: [2023-04-29 17:23:20,727] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 5: [2023-04-29 17:23:20,727] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 23: [2023-04-29 17:23:20,727] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 5: [2023-04-29 17:23:20,728] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 5: [2023-04-29 17:23:20,728] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 11: [2023-04-29 17:23:20,728] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 11: [2023-04-29 17:23:20,728] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 11: [2023-04-29 17:23:20,728] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 11: [2023-04-29 17:23:20,728] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 11: [2023-04-29 17:23:20,728] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 20: [2023-04-29 17:23:20,729] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 11: [2023-04-29 17:23:20,730] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 3: [2023-04-29 17:23:20,730] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 11: [2023-04-29 17:23:20,730] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 11: [2023-04-29 17:23:20,730] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 19: [2023-04-29 17:23:20,730] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 20: [2023-04-29 17:23:20,731] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 23: [2023-04-29 17:23:20,730] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 19: [2023-04-29 17:23:20,731] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 13: [2023-04-29 17:23:20,731] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 19: [2023-04-29 17:23:20,731] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 19: [2023-04-29 17:23:20,732] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 19: [2023-04-29 17:23:20,732] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 13: [2023-04-29 17:23:20,734] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 20: [2023-04-29 17:23:20,734] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 20: [2023-04-29 17:23:20,734] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 23: [2023-04-29 17:23:20,735] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 23: [2023-04-29 17:23:20,736] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 23: [2023-04-29 17:23:20,736] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 23: [2023-04-29 17:23:20,737] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 23: [2023-04-29 17:23:20,737] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 11: [2023-04-29 17:23:20,737] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 11: [2023-04-29 17:23:20,737] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 11: [2023-04-29 17:23:20,738] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 11: [2023-04-29 17:23:20,738] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 11: [2023-04-29 17:23:20,739] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 25: [2023-04-29 17:23:20,739] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 25: [2023-04-29 17:23:20,739] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 3: [2023-04-29 17:23:20,741] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 3: [2023-04-29 17:23:20,741] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 3: [2023-04-29 17:23:20,741] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 3: [2023-04-29 17:23:20,741] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 3: [2023-04-29 17:23:20,741] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 24: [2023-04-29 17:23:20,742] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 3: [2023-04-29 17:23:20,743] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 3: [2023-04-29 17:23:20,743] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 8: [2023-04-29 17:23:20,745] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 8: [2023-04-29 17:23:20,747] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 8: [2023-04-29 17:23:20,747] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 27: [2023-04-29 17:23:20,747] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 27: [2023-04-29 17:23:20,747] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 21: [2023-04-29 17:23:20,749] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 21: [2023-04-29 17:23:20,749] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 21: [2023-04-29 17:23:20,749] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 21: [2023-04-29 17:23:20,749] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 21: [2023-04-29 17:23:20,749] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 21: [2023-04-29 17:23:20,749] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 21: [2023-04-29 17:23:20,749] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 21: [2023-04-29 17:23:20,750] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 12: [2023-04-29 17:23:20,750] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 12: [2023-04-29 17:23:20,750] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 13: [2023-04-29 17:23:20,752] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 27: [2023-04-29 17:23:20,752] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 27: [2023-04-29 17:23:20,752] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 12: [2023-04-29 17:23:20,752] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 27: [2023-04-29 17:23:20,752] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 27: [2023-04-29 17:23:20,752] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 27: [2023-04-29 17:23:20,753] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 27: [2023-04-29 17:23:20,753] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 27: [2023-04-29 17:23:20,753] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 27: [2023-04-29 17:23:20,753] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 8: [2023-04-29 17:23:20,752] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 8: [2023-04-29 17:23:20,752] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 21: [2023-04-29 17:23:20,754] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 21: [2023-04-29 17:23:20,754] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 21: [2023-04-29 17:23:20,754] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 21: [2023-04-29 17:23:20,756] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 21: [2023-04-29 17:23:20,756] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 3: [2023-04-29 17:23:20,756] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 21: [2023-04-29 17:23:20,756] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 13: [2023-04-29 17:23:20,756] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 21: [2023-04-29 17:23:20,756] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 21: [2023-04-29 17:23:20,756] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 8: [2023-04-29 17:23:20,756] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 8: [2023-04-29 17:23:20,756] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 8: [2023-04-29 17:23:20,756] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 13: [2023-04-29 17:23:20,756] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 13: [2023-04-29 17:23:20,756] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 13: [2023-04-29 17:23:20,756] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 13: [2023-04-29 17:23:20,757] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 13: [2023-04-29 17:23:20,757] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 13: [2023-04-29 17:23:20,758] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 25: [2023-04-29 17:23:20,759] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 4: [2023-04-29 17:23:20,759] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 4: [2023-04-29 17:23:20,759] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 25: [2023-04-29 17:23:20,760] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 14: [2023-04-29 17:23:20,759] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 14: [2023-04-29 17:23:20,759] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 14: [2023-04-29 17:23:20,759] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 14: [2023-04-29 17:23:20,760] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 14: [2023-04-29 17:23:20,760] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 14: [2023-04-29 17:23:20,760] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 14: [2023-04-29 17:23:20,760] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 14: [2023-04-29 17:23:20,760] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 25: [2023-04-29 17:23:20,761] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 12: [2023-04-29 17:23:20,761] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 4: [2023-04-29 17:23:20,763] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 4: [2023-04-29 17:23:20,763] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 4: [2023-04-29 17:23:20,764] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 4: [2023-04-29 17:23:20,764] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 4: [2023-04-29 17:23:20,764] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 24: [2023-04-29 17:23:20,764] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 4: [2023-04-29 17:23:20,764] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 4: [2023-04-29 17:23:20,764] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 4: [2023-04-29 17:23:20,764] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 14: [2023-04-29 17:23:20,764] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 12: [2023-04-29 17:23:20,767] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 12: [2023-04-29 17:23:20,767] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 12: [2023-04-29 17:23:20,767] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 12: [2023-04-29 17:23:20,767] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 25: [2023-04-29 17:23:20,766] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 3: [2023-04-29 17:23:20,769] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 14: [2023-04-29 17:23:20,770] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 25: [2023-04-29 17:23:20,770] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 25: [2023-04-29 17:23:20,770] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 25: [2023-04-29 17:23:20,770] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 26: [2023-04-29 17:23:20,770] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 26: [2023-04-29 17:23:20,770] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 25: [2023-04-29 17:23:20,770] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 14: [2023-04-29 17:23:20,771] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 14: [2023-04-29 17:23:20,771] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 14: [2023-04-29 17:23:20,771] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 26: [2023-04-29 17:23:20,772] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 26: [2023-04-29 17:23:20,772] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 26: [2023-04-29 17:23:20,772] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 26: [2023-04-29 17:23:20,772] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 3: [2023-04-29 17:23:20,772] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 26: [2023-04-29 17:23:20,772] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 3: [2023-04-29 17:23:20,772] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 26: [2023-04-29 17:23:20,772] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 14: [2023-04-29 17:23:20,772] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 3: [2023-04-29 17:23:20,773] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 14: [2023-04-29 17:23:20,773] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 3: [2023-04-29 17:23:20,773] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 14: [2023-04-29 17:23:20,773] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 8: [2023-04-29 17:23:20,774] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 4: [2023-04-29 17:23:20,774] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 4: [2023-04-29 17:23:20,774] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 11: [2023-04-29 17:23:20,775] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 4: [2023-04-29 17:23:20,775] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 4: [2023-04-29 17:23:20,775] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 4: [2023-04-29 17:23:20,776] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 4: [2023-04-29 17:23:20,776] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 8: [2023-04-29 17:23:20,777] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 12: [2023-04-29 17:23:20,777] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 12: [2023-04-29 17:23:20,777] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 26: [2023-04-29 17:23:20,778] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 26: [2023-04-29 17:23:20,778] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 26: [2023-04-29 17:23:20,778] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 26: [2023-04-29 17:23:20,779] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 8: [2023-04-29 17:23:20,779] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 26: [2023-04-29 17:23:20,779] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 26: [2023-04-29 17:23:20,779] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 26: [2023-04-29 17:23:20,780] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 23: [2023-04-29 17:23:20,779] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 24: [2023-04-29 17:23:20,780] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 26: [2023-04-29 17:23:20,780] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 19: [2023-04-29 17:23:20,780] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 19: [2023-04-29 17:23:20,780] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 19: [2023-04-29 17:23:20,780] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 12: [2023-04-29 17:23:20,780] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 8: [2023-04-29 17:23:20,781] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 25: [2023-04-29 17:23:20,781] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 8: [2023-04-29 17:23:20,782] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 23: [2023-04-29 17:23:20,783] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 11: [2023-04-29 17:23:20,785] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 11: [2023-04-29 17:23:20,785] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 24: [2023-04-29 17:23:20,785] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 24: [2023-04-29 17:23:20,785] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 24: [2023-04-29 17:23:20,785] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 8: [2023-04-29 17:23:20,787] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 12: [2023-04-29 17:23:20,788] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 8: [2023-04-29 17:23:20,787] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 8: [2023-04-29 17:23:20,787] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 13: [2023-04-29 17:23:20,789] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 13: [2023-04-29 17:23:20,790] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 24: [2023-04-29 17:23:20,790] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 24: [2023-04-29 17:23:20,790] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 24: [2023-04-29 17:23:20,791] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 11: [2023-04-29 17:23:20,795] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 27: [2023-04-29 17:23:20,758] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 27: [2023-04-29 17:23:20,762] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 27: [2023-04-29 17:23:20,763] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 27: [2023-04-29 17:23:20,763] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 27: [2023-04-29 17:23:20,764] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 27: [2023-04-29 17:23:20,764] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 1: [2023-04-29 17:23:20,795] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 1: [2023-04-29 17:23:20,796] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 12: [2023-04-29 17:23:20,796] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 12: [2023-04-29 17:23:20,796] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 12: [2023-04-29 17:23:20,797] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 23: [2023-04-29 17:23:20,797] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 12: [2023-04-29 17:23:20,797] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 13: [2023-04-29 17:23:20,797] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 13: [2023-04-29 17:23:20,798] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 19: [2023-04-29 17:23:20,798] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 19: [2023-04-29 17:23:20,798] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 13: [2023-04-29 17:23:20,798] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 19: [2023-04-29 17:23:20,798] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 19: [2023-04-29 17:23:20,798] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 13: [2023-04-29 17:23:20,798] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 1: [2023-04-29 17:23:20,797] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 1: [2023-04-29 17:23:20,797] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 1: [2023-04-29 17:23:20,798] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 1: [2023-04-29 17:23:20,798] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 1: [2023-04-29 17:23:20,798] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 25: [2023-04-29 17:23:20,798] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 25: [2023-04-29 17:23:20,799] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 19: [2023-04-29 17:23:20,799] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 11: [2023-04-29 17:23:20,800] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 11: [2023-04-29 17:23:20,800] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 23: [2023-04-29 17:23:20,800] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 19: [2023-04-29 17:23:20,800] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 25: [2023-04-29 17:23:20,801] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 7: [2023-04-29 17:23:20,801] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 7: [2023-04-29 17:23:20,801] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 7: [2023-04-29 17:23:20,801] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 7: [2023-04-29 17:23:20,801] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 7: [2023-04-29 17:23:20,801] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 19: [2023-04-29 17:23:20,802] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 7: [2023-04-29 17:23:20,801] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 7: [2023-04-29 17:23:20,801] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 7: [2023-04-29 17:23:20,802] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 19: [2023-04-29 17:23:20,802] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 11: [2023-04-29 17:23:20,804] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 11: [2023-04-29 17:23:20,804] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 11: [2023-04-29 17:23:20,804] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 25: [2023-04-29 17:23:20,804] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 25: [2023-04-29 17:23:20,805] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 24: [2023-04-29 17:23:20,806] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 11: [2023-04-29 17:23:20,806] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 7: [2023-04-29 17:23:20,806] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 7: [2023-04-29 17:23:20,806] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 23: [2023-04-29 17:23:20,806] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 7: [2023-04-29 17:23:20,806] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 11: [2023-04-29 17:23:20,807] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 7: [2023-04-29 17:23:20,808] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 7: [2023-04-29 17:23:20,808] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 7: [2023-04-29 17:23:20,808] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 7: [2023-04-29 17:23:20,808] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 7: [2023-04-29 17:23:20,808] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 21: [2023-04-29 17:23:20,808] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 21: [2023-04-29 17:23:20,808] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 21: [2023-04-29 17:23:20,808] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 23: [2023-04-29 17:23:20,809] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 23: [2023-04-29 17:23:20,809] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 23: [2023-04-29 17:23:20,809] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 23: [2023-04-29 17:23:20,810] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 31: [2023-04-29 17:23:20,811] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 31: [2023-04-29 17:23:20,811] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 31: [2023-04-29 17:23:20,811] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 31: [2023-04-29 17:23:20,812] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 31: [2023-04-29 17:23:20,812] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 31: [2023-04-29 17:23:20,812] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 31: [2023-04-29 17:23:20,812] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 31: [2023-04-29 17:23:20,812] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 9: [2023-04-29 17:23:20,812] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 9: [2023-04-29 17:23:20,812] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 9: [2023-04-29 17:23:20,812] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 9: [2023-04-29 17:23:20,812] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 9: [2023-04-29 17:23:20,812] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 9: [2023-04-29 17:23:20,812] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 9: [2023-04-29 17:23:20,812] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 9: [2023-04-29 17:23:20,813] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 23: [2023-04-29 17:23:20,814] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 4: [2023-04-29 17:23:20,815] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 4: [2023-04-29 17:23:20,815] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 14: [2023-04-29 17:23:20,816] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 24: [2023-04-29 17:23:20,816] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 31: [2023-04-29 17:23:20,816] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 31: [2023-04-29 17:23:20,816] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 31: [2023-04-29 17:23:20,816] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 9: [2023-04-29 17:23:20,817] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 9: [2023-04-29 17:23:20,818] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 9: [2023-04-29 17:23:20,818] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 31: [2023-04-29 17:23:20,818] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 9: [2023-04-29 17:23:20,818] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 9: [2023-04-29 17:23:20,818] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 10: [2023-04-29 17:23:20,818] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 10: [2023-04-29 17:23:20,818] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 9: [2023-04-29 17:23:20,818] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 31: [2023-04-29 17:23:20,818] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 31: [2023-04-29 17:23:20,818] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 9: [2023-04-29 17:23:20,818] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 29: [2023-04-29 17:23:20,818] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 31: [2023-04-29 17:23:20,818] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 9: [2023-04-29 17:23:20,818] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 31: [2023-04-29 17:23:20,819] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 10: [2023-04-29 17:23:20,819] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 10: [2023-04-29 17:23:20,819] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 29: [2023-04-29 17:23:20,819] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 29: [2023-04-29 17:23:20,819] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 29: [2023-04-29 17:23:20,819] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 29: [2023-04-29 17:23:20,819] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 29: [2023-04-29 17:23:20,819] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 29: [2023-04-29 17:23:20,819] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 23: [2023-04-29 17:23:20,820] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 10: [2023-04-29 17:23:20,819] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 10: [2023-04-29 17:23:20,820] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 10: [2023-04-29 17:23:20,820] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 10: [2023-04-29 17:23:20,820] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 29: [2023-04-29 17:23:20,820] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 24: [2023-04-29 17:23:20,821] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 24: [2023-04-29 17:23:20,822] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 24: [2023-04-29 17:23:20,822] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 29: [2023-04-29 17:23:20,822] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 21: [2023-04-29 17:23:20,822] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 21: [2023-04-29 17:23:20,822] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 21: [2023-04-29 17:23:20,822] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 21: [2023-04-29 17:23:20,822] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 21: [2023-04-29 17:23:20,822] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 24: [2023-04-29 17:23:20,823] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 10: [2023-04-29 17:23:20,824] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 19: [2023-04-29 17:23:20,824] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 10: [2023-04-29 17:23:20,824] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 24: [2023-04-29 17:23:20,824] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 19: [2023-04-29 17:23:20,824] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 10: [2023-04-29 17:23:20,825] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 10: [2023-04-29 17:23:20,825] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 19: [2023-04-29 17:23:20,827] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 10: [2023-04-29 17:23:20,827] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 10: [2023-04-29 17:23:20,828] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 11: [2023-04-29 17:23:20,828] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 11: [2023-04-29 17:23:20,829] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 10: [2023-04-29 17:23:20,829] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 19: [2023-04-29 17:23:20,829] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 10: [2023-04-29 17:23:20,830] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 11: [2023-04-29 17:23:20,831] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 29: [2023-04-29 17:23:20,831] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 29: [2023-04-29 17:23:20,831] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 21: [2023-04-29 17:23:20,832] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 29: [2023-04-29 17:23:20,832] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 11: [2023-04-29 17:23:20,832] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 21: [2023-04-29 17:23:20,832] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 29: [2023-04-29 17:23:20,832] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 19: [2023-04-29 17:23:20,832] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 29: [2023-04-29 17:23:20,832] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 29: [2023-04-29 17:23:20,832] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 21: [2023-04-29 17:23:20,833] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 11: [2023-04-29 17:23:20,834] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 29: [2023-04-29 17:23:20,834] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 26: [2023-04-29 17:23:20,833] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 26: [2023-04-29 17:23:20,835] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 26: [2023-04-29 17:23:20,835] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 4: [2023-04-29 17:23:20,835] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 14: [2023-04-29 17:23:20,835] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 4: [2023-04-29 17:23:20,835] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 23: [2023-04-29 17:23:20,837] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 1: [2023-04-29 17:23:20,798] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 27: [2023-04-29 17:23:20,805] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 1: [2023-04-29 17:23:20,802] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 27: [2023-04-29 17:23:20,813] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 1: [2023-04-29 17:23:20,803] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 27: [2023-04-29 17:23:20,826] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 1: [2023-04-29 17:23:20,803] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 27: [2023-04-29 17:23:20,826] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 26: [2023-04-29 17:23:20,839] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 1: [2023-04-29 17:23:20,804] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 27: [2023-04-29 17:23:20,835] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 1: [2023-04-29 17:23:20,804] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 1: [2023-04-29 17:23:20,804] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 27: [2023-04-29 17:23:20,836] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 27: [2023-04-29 17:23:20,836] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 1: [2023-04-29 17:23:20,804] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 27: [2023-04-29 17:23:20,837] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 1: [2023-04-29 17:23:20,805] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 27: [2023-04-29 17:23:20,837] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 27: [2023-04-29 17:23:20,838] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 23: [2023-04-29 17:23:20,840] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 26: [2023-04-29 17:23:20,842] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 26: [2023-04-29 17:23:20,842] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 26: [2023-04-29 17:23:20,842] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 26: [2023-04-29 17:23:20,843] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 23: [2023-04-29 17:23:20,843] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 14: [2023-04-29 17:23:20,843] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 23: [2023-04-29 17:23:20,844] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 4: [2023-04-29 17:23:20,844] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 4: [2023-04-29 17:23:20,845] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 14: [2023-04-29 17:23:20,845] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 14: [2023-04-29 17:23:20,845] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 18: [2023-04-29 17:23:20,846] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 18: [2023-04-29 17:23:20,846] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 18: [2023-04-29 17:23:20,846] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 18: [2023-04-29 17:23:20,846] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 18: [2023-04-29 17:23:20,846] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 18: [2023-04-29 17:23:20,846] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 18: [2023-04-29 17:23:20,846] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 18: [2023-04-29 17:23:20,846] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 23: [2023-04-29 17:23:20,849] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 4: [2023-04-29 17:23:20,849] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 4: [2023-04-29 17:23:20,849] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 4: [2023-04-29 17:23:20,849] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 4: [2023-04-29 17:23:20,849] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 21: [2023-04-29 17:23:20,850] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 21: [2023-04-29 17:23:20,851] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 21: [2023-04-29 17:23:20,851] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 21: [2023-04-29 17:23:20,851] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 21: [2023-04-29 17:23:20,853] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 28: [2023-04-29 17:23:20,852] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 28: [2023-04-29 17:23:20,853] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 28: [2023-04-29 17:23:20,853] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 28: [2023-04-29 17:23:20,853] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 28: [2023-04-29 17:23:20,853] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 0: [2023-04-29 17:23:20,857] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 0: [2023-04-29 17:23:20,857] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 0: [2023-04-29 17:23:20,857] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 0: [2023-04-29 17:23:20,857] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 0: [2023-04-29 17:23:20,857] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 0: [2023-04-29 17:23:20,857] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 0: [2023-04-29 17:23:20,857] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 0: [2023-04-29 17:23:20,858] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 18: [2023-04-29 17:23:20,858] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 7: [2023-04-29 17:23:20,858] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 7: [2023-04-29 17:23:20,858] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 7: [2023-04-29 17:23:20,858] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 14: [2023-04-29 17:23:20,859] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 14: [2023-04-29 17:23:20,859] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 14: [2023-04-29 17:23:20,859] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 18: [2023-04-29 17:23:20,859] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 18: [2023-04-29 17:23:20,859] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 14: [2023-04-29 17:23:20,859] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 18: [2023-04-29 17:23:20,860] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 18: [2023-04-29 17:23:20,861] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 18: [2023-04-29 17:23:20,861] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 18: [2023-04-29 17:23:20,861] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 18: [2023-04-29 17:23:20,861] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 26: [2023-04-29 17:23:20,864] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 26: [2023-04-29 17:23:20,867] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 26: [2023-04-29 17:23:20,867] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 26: [2023-04-29 17:23:20,867] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 0: [2023-04-29 17:23:20,870] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 0: [2023-04-29 17:23:20,871] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 31: [2023-04-29 17:23:20,870] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 31: [2023-04-29 17:23:20,870] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 31: [2023-04-29 17:23:20,870] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 4: [2023-04-29 17:23:20,871] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 29: [2023-04-29 17:23:20,871] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 4: [2023-04-29 17:23:20,871] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 0: [2023-04-29 17:23:20,871] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 0: [2023-04-29 17:23:20,872] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 0: [2023-04-29 17:23:20,872] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 26: [2023-04-29 17:23:20,872] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 14: [2023-04-29 17:23:20,872] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 30: [2023-04-29 17:23:20,872] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 30: [2023-04-29 17:23:20,872] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 30: [2023-04-29 17:23:20,872] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 30: [2023-04-29 17:23:20,872] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 30: [2023-04-29 17:23:20,872] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 30: [2023-04-29 17:23:20,872] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 30: [2023-04-29 17:23:20,872] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 26: [2023-04-29 17:23:20,873] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 14: [2023-04-29 17:23:20,873] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 30: [2023-04-29 17:23:20,873] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 0: [2023-04-29 17:23:20,873] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 0: [2023-04-29 17:23:20,873] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 5: [2023-04-29 17:23:20,874] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 0: [2023-04-29 17:23:20,874] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 7: [2023-04-29 17:23:20,874] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 7: [2023-04-29 17:23:20,874] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 7: [2023-04-29 17:23:20,874] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 7: [2023-04-29 17:23:20,874] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 5: [2023-04-29 17:23:20,874] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 7: [2023-04-29 17:23:20,874] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 9: [2023-04-29 17:23:20,875] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 9: [2023-04-29 17:23:20,875] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 9: [2023-04-29 17:23:20,875] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 9: [2023-04-29 17:23:20,875] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 26: [2023-04-29 17:23:20,876] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 26: [2023-04-29 17:23:20,876] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 5: [2023-04-29 17:23:20,878] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 5: [2023-04-29 17:23:20,878] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 7: [2023-04-29 17:23:20,878] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 5: [2023-04-29 17:23:20,878] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 5: [2023-04-29 17:23:20,878] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 5: [2023-04-29 17:23:20,878] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 5: [2023-04-29 17:23:20,879] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 5: [2023-04-29 17:23:20,879] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 5: [2023-04-29 17:23:20,879] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 9: [2023-04-29 17:23:20,879] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 9: [2023-04-29 17:23:20,879] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 9: [2023-04-29 17:23:20,879] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 9: [2023-04-29 17:23:20,879] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 14: [2023-04-29 17:23:20,879] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 7: [2023-04-29 17:23:20,880] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 31: [2023-04-29 17:23:20,880] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 7: [2023-04-29 17:23:20,880] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 4: [2023-04-29 17:23:20,881] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 4: [2023-04-29 17:23:20,881] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 10: [2023-04-29 17:23:20,881] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 10: [2023-04-29 17:23:20,881] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 10: [2023-04-29 17:23:20,881] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 10: [2023-04-29 17:23:20,881] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 5: [2023-04-29 17:23:20,882] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 1: [2023-04-29 17:23:20,858] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 1: [2023-04-29 17:23:20,858] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 1: [2023-04-29 17:23:20,858] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 1: [2023-04-29 17:23:20,863] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 1: [2023-04-29 17:23:20,863] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 1: [2023-04-29 17:23:20,863] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 1: [2023-04-29 17:23:20,863] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 1: [2023-04-29 17:23:20,864] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 1: [2023-04-29 17:23:20,883] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 1: [2023-04-29 17:23:20,883] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 27: [2023-04-29 17:23:20,849] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 27: [2023-04-29 17:23:20,867] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 27: [2023-04-29 17:23:20,868] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 27: [2023-04-29 17:23:20,869] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 27: [2023-04-29 17:23:20,869] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 27: [2023-04-29 17:23:20,872] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 30: [2023-04-29 17:23:20,883] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 1: [2023-04-29 17:23:20,884] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 30: [2023-04-29 17:23:20,884] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 30: [2023-04-29 17:23:20,884] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 30: [2023-04-29 17:23:20,884] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 31: [2023-04-29 17:23:20,884] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 31: [2023-04-29 17:23:20,884] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 31: [2023-04-29 17:23:20,884] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 30: [2023-04-29 17:23:20,885] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 31: [2023-04-29 17:23:20,885] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 4: [2023-04-29 17:23:20,885] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 30: [2023-04-29 17:23:20,885] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 30: [2023-04-29 17:23:20,885] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 30: [2023-04-29 17:23:20,886] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 4: [2023-04-29 17:23:20,887] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 10: [2023-04-29 17:23:20,887] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 10: [2023-04-29 17:23:20,887] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 10: [2023-04-29 17:23:20,887] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 10: [2023-04-29 17:23:20,887] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 5: [2023-04-29 17:23:20,887] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 5: [2023-04-29 17:23:20,888] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 5: [2023-04-29 17:23:20,888] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 1: [2023-04-29 17:23:20,889] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 5: [2023-04-29 17:23:20,889] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 1: [2023-04-29 17:23:20,889] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 5: [2023-04-29 17:23:20,889] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 29: [2023-04-29 17:23:20,890] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 1: [2023-04-29 17:23:20,891] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 1: [2023-04-29 17:23:20,891] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 1: [2023-04-29 17:23:20,891] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 14: [2023-04-29 17:23:20,894] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 14: [2023-04-29 17:23:20,894] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 31: [2023-04-29 17:23:20,894] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 31: [2023-04-29 17:23:20,894] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 15: [2023-04-29 17:23:20,894] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 15: [2023-04-29 17:23:20,894] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 15: [2023-04-29 17:23:20,894] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 15: [2023-04-29 17:23:20,894] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 15: [2023-04-29 17:23:20,894] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 15: [2023-04-29 17:23:20,894] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 15: [2023-04-29 17:23:20,894] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 31: [2023-04-29 17:23:20,895] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 15: [2023-04-29 17:23:20,895] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 28: [2023-04-29 17:23:20,853] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 28: [2023-04-29 17:23:20,853] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 28: [2023-04-29 17:23:20,853] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 28: [2023-04-29 17:23:20,865] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 28: [2023-04-29 17:23:20,866] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 28: [2023-04-29 17:23:20,867] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 28: [2023-04-29 17:23:20,867] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 28: [2023-04-29 17:23:20,867] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 28: [2023-04-29 17:23:20,868] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 28: [2023-04-29 17:23:20,868] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 28: [2023-04-29 17:23:20,869] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 14: [2023-04-29 17:23:20,896] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 14: [2023-04-29 17:23:20,896] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 7: [2023-04-29 17:23:20,900] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 7: [2023-04-29 17:23:20,903] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 7: [2023-04-29 17:23:20,904] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 29: [2023-04-29 17:23:20,904] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 29: [2023-04-29 17:23:20,904] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 31: [2023-04-29 17:23:20,904] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 7: [2023-04-29 17:23:20,906] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 7: [2023-04-29 17:23:20,906] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 10: [2023-04-29 17:23:20,907] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 15: [2023-04-29 17:23:20,908] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 15: [2023-04-29 17:23:20,908] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 15: [2023-04-29 17:23:20,909] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 15: [2023-04-29 17:23:20,909] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 15: [2023-04-29 17:23:20,910] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 10: [2023-04-29 17:23:20,910] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 15: [2023-04-29 17:23:20,910] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 10: [2023-04-29 17:23:20,910] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 31: [2023-04-29 17:23:20,910] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 10: [2023-04-29 17:23:20,910] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 31: [2023-04-29 17:23:20,910] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 15: [2023-04-29 17:23:20,910] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 29: [2023-04-29 17:23:20,910] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 29: [2023-04-29 17:23:20,910] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 29: [2023-04-29 17:23:20,910] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 29: [2023-04-29 17:23:20,910] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 29: [2023-04-29 17:23:20,911] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 31: [2023-04-29 17:23:20,911] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 15: [2023-04-29 17:23:20,911] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt... 31: [2023-04-29 17:23:20,911] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 10: [2023-04-29 17:23:20,915] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 10: [2023-04-29 17:23:20,915] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 10: [2023-04-29 17:23:20,919] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 10: [2023-04-29 17:23:20,920] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 9: [2023-04-29 17:23:20,900] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 9: [2023-04-29 17:23:20,902] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 9: [2023-04-29 17:23:20,902] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 9: [2023-04-29 17:23:20,904] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 9: [2023-04-29 17:23:20,904] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 9: [2023-04-29 17:23:20,904] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 9: [2023-04-29 17:23:20,906] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 9: [2023-04-29 17:23:20,906] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 22: [2023-04-29 17:23:20,926] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 22: [2023-04-29 17:23:20,927] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 22: [2023-04-29 17:23:20,927] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 22: [2023-04-29 17:23:20,927] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 22: [2023-04-29 17:23:20,927] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 22: [2023-04-29 17:23:20,927] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 22: [2023-04-29 17:23:20,927] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 22: [2023-04-29 17:23:20,928] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 5: [2023-04-29 17:23:20,929] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 22: [2023-04-29 17:23:20,931] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 22: [2023-04-29 17:23:20,931] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 29: [2023-04-29 17:23:20,934] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 29: [2023-04-29 17:23:20,934] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 2: [2023-04-29 17:23:20,934] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 2: [2023-04-29 17:23:20,934] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 2: [2023-04-29 17:23:20,934] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 18: [2023-04-29 17:23:20,935] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 18: [2023-04-29 17:23:20,935] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 2: [2023-04-29 17:23:20,935] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 2: [2023-04-29 17:23:20,935] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 2: [2023-04-29 17:23:20,935] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 2: [2023-04-29 17:23:20,935] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 5: [2023-04-29 17:23:20,935] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 2: [2023-04-29 17:23:20,935] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 18: [2023-04-29 17:23:20,936] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 22: [2023-04-29 17:23:20,938] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 22: [2023-04-29 17:23:20,938] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 2: [2023-04-29 17:23:20,939] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 2: [2023-04-29 17:23:20,939] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 2: [2023-04-29 17:23:20,940] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 22: [2023-04-29 17:23:20,939] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 22: [2023-04-29 17:23:20,939] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 22: [2023-04-29 17:23:20,940] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 22: [2023-04-29 17:23:20,940] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 29: [2023-04-29 17:23:20,942] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 28: [2023-04-29 17:23:20,943] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 28: [2023-04-29 17:23:20,943] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 28: [2023-04-29 17:23:20,943] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 29: [2023-04-29 17:23:20,944] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 2: [2023-04-29 17:23:20,944] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 2: [2023-04-29 17:23:20,945] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 29: [2023-04-29 17:23:20,946] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 2: [2023-04-29 17:23:20,946] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 2: [2023-04-29 17:23:20,946] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 2: [2023-04-29 17:23:20,947] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 5: [2023-04-29 17:23:20,950] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 29: [2023-04-29 17:23:20,951] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 29: [2023-04-29 17:23:20,951] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 18: [2023-04-29 17:23:20,950] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 18: [2023-04-29 17:23:20,950] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 18: [2023-04-29 17:23:20,950] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 18: [2023-04-29 17:23:20,951] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 18: [2023-04-29 17:23:20,951] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 0: [2023-04-29 17:23:20,951] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 0: [2023-04-29 17:23:20,951] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 0: [2023-04-29 17:23:20,951] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 28: [2023-04-29 17:23:20,954] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 28: [2023-04-29 17:23:20,954] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 28: [2023-04-29 17:23:20,954] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 28: [2023-04-29 17:23:20,954] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 28: [2023-04-29 17:23:20,954] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 5: [2023-04-29 17:23:20,955] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 5: [2023-04-29 17:23:20,955] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 30: [2023-04-29 17:23:20,955] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 5: [2023-04-29 17:23:20,959] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 5: [2023-04-29 17:23:20,959] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 18: [2023-04-29 17:23:20,961] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 18: [2023-04-29 17:23:20,961] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 5: [2023-04-29 17:23:20,961] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 5: [2023-04-29 17:23:20,961] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 5: [2023-04-29 17:23:20,962] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 18: [2023-04-29 17:23:20,962] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 0: [2023-04-29 17:23:20,962] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 0: [2023-04-29 17:23:20,962] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 0: [2023-04-29 17:23:20,962] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 0: [2023-04-29 17:23:20,962] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 0: [2023-04-29 17:23:20,965] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 16: [2023-04-29 17:23:20,973] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 16: [2023-04-29 17:23:20,974] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 16: [2023-04-29 17:23:20,974] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 16: [2023-04-29 17:23:20,974] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 16: [2023-04-29 17:23:20,974] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 16: [2023-04-29 17:23:20,974] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 16: [2023-04-29 17:23:20,974] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 16: [2023-04-29 17:23:20,974] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 30: [2023-04-29 17:23:20,975] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 30: [2023-04-29 17:23:20,975] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 30: [2023-04-29 17:23:20,975] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 30: [2023-04-29 17:23:20,975] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 30: [2023-04-29 17:23:20,975] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 30: [2023-04-29 17:23:20,975] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 30: [2023-04-29 17:23:20,976] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 0: [2023-04-29 17:23:20,977] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 30: [2023-04-29 17:23:20,977] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 5: [2023-04-29 17:23:20,980] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 16: [2023-04-29 17:23:20,980] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 16: [2023-04-29 17:23:20,980] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 0: [2023-04-29 17:23:20,980] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 16: [2023-04-29 17:23:20,980] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 16: [2023-04-29 17:23:20,981] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 16: [2023-04-29 17:23:20,981] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 16: [2023-04-29 17:23:20,981] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 16: [2023-04-29 17:23:20,981] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 16: [2023-04-29 17:23:20,981] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 0: [2023-04-29 17:23:20,982] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 18: [2023-04-29 17:23:20,982] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 22: [2023-04-29 17:23:20,982] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 18: [2023-04-29 17:23:20,984] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 22: [2023-04-29 17:23:20,984] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 18: [2023-04-29 17:23:20,984] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 28: [2023-04-29 17:23:20,985] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 18: [2023-04-29 17:23:20,986] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 18: [2023-04-29 17:23:20,987] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 5: [2023-04-29 17:23:20,987] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 28: [2023-04-29 17:23:20,988] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 28: [2023-04-29 17:23:20,988] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 15: [2023-04-29 17:23:20,988] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 15: [2023-04-29 17:23:20,988] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 15: [2023-04-29 17:23:20,988] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 15: [2023-04-29 17:23:20,988] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 5: [2023-04-29 17:23:20,990] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 6: [2023-04-29 17:23:20,991] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 6: [2023-04-29 17:23:20,991] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 6: [2023-04-29 17:23:20,991] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 6: [2023-04-29 17:23:20,992] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 6: [2023-04-29 17:23:20,992] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 6: [2023-04-29 17:23:20,992] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 6: [2023-04-29 17:23:20,992] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 6: [2023-04-29 17:23:20,992] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 5: [2023-04-29 17:23:20,992] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 15: [2023-04-29 17:23:20,992] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 15: [2023-04-29 17:23:20,992] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 15: [2023-04-29 17:23:20,992] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 15: [2023-04-29 17:23:20,992] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_09-model_00-model_states.pt. 2: [2023-04-29 17:23:20,992] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 2: [2023-04-29 17:23:20,992] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 2: [2023-04-29 17:23:20,992] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 5: [2023-04-29 17:23:20,995] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 5: [2023-04-29 17:23:20,995] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 0: [2023-04-29 17:23:20,996] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 6: [2023-04-29 17:23:20,996] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 6: [2023-04-29 17:23:20,996] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 0: [2023-04-29 17:23:20,999] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 0: [2023-04-29 17:23:21,000] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 6: [2023-04-29 17:23:21,001] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 6: [2023-04-29 17:23:21,001] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 6: [2023-04-29 17:23:21,001] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 6: [2023-04-29 17:23:21,002] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 6: [2023-04-29 17:23:21,003] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 0: [2023-04-29 17:23:21,003] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 6: [2023-04-29 17:23:21,003] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 0: [2023-04-29 17:23:21,003] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 22: [2023-04-29 17:23:21,004] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 28: [2023-04-29 17:23:21,004] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 22: [2023-04-29 17:23:21,004] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 28: [2023-04-29 17:23:21,005] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 28: [2023-04-29 17:23:21,006] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 22: [2023-04-29 17:23:21,007] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 22: [2023-04-29 17:23:21,007] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 22: [2023-04-29 17:23:21,007] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 2: [2023-04-29 17:23:21,008] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 2: [2023-04-29 17:23:21,008] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 2: [2023-04-29 17:23:21,008] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 30: [2023-04-29 17:23:21,009] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 28: [2023-04-29 17:23:21,009] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 28: [2023-04-29 17:23:21,009] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 30: [2023-04-29 17:23:21,010] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 22: [2023-04-29 17:23:21,011] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 22: [2023-04-29 17:23:21,011] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 30: [2023-04-29 17:23:21,011] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 22: [2023-04-29 17:23:21,012] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 2: [2023-04-29 17:23:21,012] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 2: [2023-04-29 17:23:21,013] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 2: [2023-04-29 17:23:21,013] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 30: [2023-04-29 17:23:21,014] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 30: [2023-04-29 17:23:21,014] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 30: [2023-04-29 17:23:21,015] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 2: [2023-04-29 17:23:21,015] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 30: [2023-04-29 17:23:21,015] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 2: [2023-04-29 17:23:21,017] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 17: [2023-04-29 17:23:21,018] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 17: [2023-04-29 17:23:21,018] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 17: [2023-04-29 17:23:21,021] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 17: [2023-04-29 17:23:21,021] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 17: [2023-04-29 17:23:21,021] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 17: [2023-04-29 17:23:21,021] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 17: [2023-04-29 17:23:21,021] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 17: [2023-04-29 17:23:21,022] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 17: [2023-04-29 17:23:21,022] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 17: [2023-04-29 17:23:21,026] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 17: [2023-04-29 17:23:21,026] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 17: [2023-04-29 17:23:21,032] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 17: [2023-04-29 17:23:21,032] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 17: [2023-04-29 17:23:21,033] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 17: [2023-04-29 17:23:21,034] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 16: [2023-04-29 17:23:21,033] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 16: [2023-04-29 17:23:21,033] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 17: [2023-04-29 17:23:21,034] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 22: [2023-04-29 17:23:21,035] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 15: [2023-04-29 17:23:21,024] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 15: [2023-04-29 17:23:21,027] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 15: [2023-04-29 17:23:21,034] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 15: [2023-04-29 17:23:21,035] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 15: [2023-04-29 17:23:21,035] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 15: [2023-04-29 17:23:21,035] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 15: [2023-04-29 17:23:21,035] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 15: [2023-04-29 17:23:21,035] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 20: [2023-04-29 17:23:21,036] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 20: [2023-04-29 17:23:21,036] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 20: [2023-04-29 17:23:21,036] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 22: [2023-04-29 17:23:21,037] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 20: [2023-04-29 17:23:21,037] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 20: [2023-04-29 17:23:21,037] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 20: [2023-04-29 17:23:21,037] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 20: [2023-04-29 17:23:21,037] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 22: [2023-04-29 17:23:21,037] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 20: [2023-04-29 17:23:21,037] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 16: [2023-04-29 17:23:21,040] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 2: [2023-04-29 17:23:21,041] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 2: [2023-04-29 17:23:21,041] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 2: [2023-04-29 17:23:21,041] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 22: [2023-04-29 17:23:21,041] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 22: [2023-04-29 17:23:21,041] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 22: [2023-04-29 17:23:21,042] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 2: [2023-04-29 17:23:21,043] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 2: [2023-04-29 17:23:21,043] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 20: [2023-04-29 17:23:21,043] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 20: [2023-04-29 17:23:21,043] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 20: [2023-04-29 17:23:21,044] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 20: [2023-04-29 17:23:21,044] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 20: [2023-04-29 17:23:21,044] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 20: [2023-04-29 17:23:21,045] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 20: [2023-04-29 17:23:21,046] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 20: [2023-04-29 17:23:21,046] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 6: [2023-04-29 17:23:21,046] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 6: [2023-04-29 17:23:21,046] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 16: [2023-04-29 17:23:21,049] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 16: [2023-04-29 17:23:21,049] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 16: [2023-04-29 17:23:21,049] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 16: [2023-04-29 17:23:21,049] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 16: [2023-04-29 17:23:21,049] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 16: [2023-04-29 17:23:21,056] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 16: [2023-04-29 17:23:21,056] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 12: [2023-04-29 17:23:21,059] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 12: [2023-04-29 17:23:21,059] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 12: [2023-04-29 17:23:21,059] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 12: [2023-04-29 17:23:21,059] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 12: [2023-04-29 17:23:21,059] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 12: [2023-04-29 17:23:21,059] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 12: [2023-04-29 17:23:21,059] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 12: [2023-04-29 17:23:21,060] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 3: [2023-04-29 17:23:21,061] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 3: [2023-04-29 17:23:21,061] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 3: [2023-04-29 17:23:21,061] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 3: [2023-04-29 17:23:21,061] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 3: [2023-04-29 17:23:21,061] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 3: [2023-04-29 17:23:21,061] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 3: [2023-04-29 17:23:21,061] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 3: [2023-04-29 17:23:21,061] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 16: [2023-04-29 17:23:21,065] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 3: [2023-04-29 17:23:21,065] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 3: [2023-04-29 17:23:21,065] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 12: [2023-04-29 17:23:21,065] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 12: [2023-04-29 17:23:21,067] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 12: [2023-04-29 17:23:21,067] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 6: [2023-04-29 17:23:21,067] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 6: [2023-04-29 17:23:21,067] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 8: [2023-04-29 17:23:21,067] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 8: [2023-04-29 17:23:21,067] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 6: [2023-04-29 17:23:21,068] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 3: [2023-04-29 17:23:21,068] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 3: [2023-04-29 17:23:21,068] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 3: [2023-04-29 17:23:21,068] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 3: [2023-04-29 17:23:21,069] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 3: [2023-04-29 17:23:21,069] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 3: [2023-04-29 17:23:21,069] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 8: [2023-04-29 17:23:21,069] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 8: [2023-04-29 17:23:21,070] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 8: [2023-04-29 17:23:21,070] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 8: [2023-04-29 17:23:21,070] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 12: [2023-04-29 17:23:21,069] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 12: [2023-04-29 17:23:21,070] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 8: [2023-04-29 17:23:21,070] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 12: [2023-04-29 17:23:21,070] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 8: [2023-04-29 17:23:21,070] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 12: [2023-04-29 17:23:21,070] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 12: [2023-04-29 17:23:21,071] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 8: [2023-04-29 17:23:21,074] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 8: [2023-04-29 17:23:21,074] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 6: [2023-04-29 17:23:21,074] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 6: [2023-04-29 17:23:21,074] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 6: [2023-04-29 17:23:21,074] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 6: [2023-04-29 17:23:21,074] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 6: [2023-04-29 17:23:21,074] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 16: [2023-04-29 17:23:21,075] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 17: [2023-04-29 17:23:21,075] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 16: [2023-04-29 17:23:21,076] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 8: [2023-04-29 17:23:21,076] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 8: [2023-04-29 17:23:21,077] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 16: [2023-04-29 17:23:21,077] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 8: [2023-04-29 17:23:21,078] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 8: [2023-04-29 17:23:21,078] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 8: [2023-04-29 17:23:21,078] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 8: [2023-04-29 17:23:21,078] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 16: [2023-04-29 17:23:21,080] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 16: [2023-04-29 17:23:21,080] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 17: [2023-04-29 17:23:21,080] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 21: [2023-04-29 17:23:21,093] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 21: [2023-04-29 17:23:21,093] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 21: [2023-04-29 17:23:21,093] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 21: [2023-04-29 17:23:21,093] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 21: [2023-04-29 17:23:21,093] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 21: [2023-04-29 17:23:21,093] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 21: [2023-04-29 17:23:21,093] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 21: [2023-04-29 17:23:21,094] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 17: [2023-04-29 17:23:21,097] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 20: [2023-04-29 17:23:21,096] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 20: [2023-04-29 17:23:21,096] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 20: [2023-04-29 17:23:21,097] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 21: [2023-04-29 17:23:21,098] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 21: [2023-04-29 17:23:21,098] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 21: [2023-04-29 17:23:21,098] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 21: [2023-04-29 17:23:21,099] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 21: [2023-04-29 17:23:21,099] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 21: [2023-04-29 17:23:21,100] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 17: [2023-04-29 17:23:21,100] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 21: [2023-04-29 17:23:21,100] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 21: [2023-04-29 17:23:21,100] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 6: [2023-04-29 17:23:21,102] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 17: [2023-04-29 17:23:21,102] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 17: [2023-04-29 17:23:21,102] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 17: [2023-04-29 17:23:21,103] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 19: [2023-04-29 17:23:21,104] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 19: [2023-04-29 17:23:21,104] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 6: [2023-04-29 17:23:21,105] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 19: [2023-04-29 17:23:21,105] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 19: [2023-04-29 17:23:21,105] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 19: [2023-04-29 17:23:21,106] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 19: [2023-04-29 17:23:21,106] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 19: [2023-04-29 17:23:21,106] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 19: [2023-04-29 17:23:21,106] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 17: [2023-04-29 17:23:21,106] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 17: [2023-04-29 17:23:21,106] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 17: [2023-04-29 17:23:21,106] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 6: [2023-04-29 17:23:21,108] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 19: [2023-04-29 17:23:21,108] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 20: [2023-04-29 17:23:21,109] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 20: [2023-04-29 17:23:21,109] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 20: [2023-04-29 17:23:21,109] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 19: [2023-04-29 17:23:21,109] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 19: [2023-04-29 17:23:21,110] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 20: [2023-04-29 17:23:21,111] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 20: [2023-04-29 17:23:21,111] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 19: [2023-04-29 17:23:21,112] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 6: [2023-04-29 17:23:21,113] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 6: [2023-04-29 17:23:21,113] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 19: [2023-04-29 17:23:21,113] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 19: [2023-04-29 17:23:21,113] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 19: [2023-04-29 17:23:21,114] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 19: [2023-04-29 17:23:21,114] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 6: [2023-04-29 17:23:21,115] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 3: [2023-04-29 17:23:21,116] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 3: [2023-04-29 17:23:21,116] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 12: [2023-04-29 17:23:21,118] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 7: [2023-04-29 17:23:21,118] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 7: [2023-04-29 17:23:21,118] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 20: [2023-04-29 17:23:21,119] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 7: [2023-04-29 17:23:21,121] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 7: [2023-04-29 17:23:21,121] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 7: [2023-04-29 17:23:21,121] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 7: [2023-04-29 17:23:21,121] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 7: [2023-04-29 17:23:21,121] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 7: [2023-04-29 17:23:21,121] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 20: [2023-04-29 17:23:21,122] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 12: [2023-04-29 17:23:21,122] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 12: [2023-04-29 17:23:21,122] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 7: [2023-04-29 17:23:21,123] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 7: [2023-04-29 17:23:21,123] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 13: [2023-04-29 17:23:21,123] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 13: [2023-04-29 17:23:21,124] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 20: [2023-04-29 17:23:21,124] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 17: [2023-04-29 17:23:21,124] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 13: [2023-04-29 17:23:21,124] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 13: [2023-04-29 17:23:21,124] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 13: [2023-04-29 17:23:21,124] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 13: [2023-04-29 17:23:21,124] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 13: [2023-04-29 17:23:21,124] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 13: [2023-04-29 17:23:21,124] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 7: [2023-04-29 17:23:21,125] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 7: [2023-04-29 17:23:21,127] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 7: [2023-04-29 17:23:21,128] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 7: [2023-04-29 17:23:21,128] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 7: [2023-04-29 17:23:21,128] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 7: [2023-04-29 17:23:21,128] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 13: [2023-04-29 17:23:21,130] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 13: [2023-04-29 17:23:21,131] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 12: [2023-04-29 17:23:21,131] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 13: [2023-04-29 17:23:21,132] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 8: [2023-04-29 17:23:21,132] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 8: [2023-04-29 17:23:21,132] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 8: [2023-04-29 17:23:21,133] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 13: [2023-04-29 17:23:21,134] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 20: [2023-04-29 17:23:21,134] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 20: [2023-04-29 17:23:21,135] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 17: [2023-04-29 17:23:21,135] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 13: [2023-04-29 17:23:21,136] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 3: [2023-04-29 17:23:21,136] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 13: [2023-04-29 17:23:21,136] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 13: [2023-04-29 17:23:21,136] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 20: [2023-04-29 17:23:21,136] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 13: [2023-04-29 17:23:21,136] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 8: [2023-04-29 17:23:21,136] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 8: [2023-04-29 17:23:21,136] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 8: [2023-04-29 17:23:21,136] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 17: [2023-04-29 17:23:21,137] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 8: [2023-04-29 17:23:21,138] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 8: [2023-04-29 17:23:21,138] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 20: [2023-04-29 17:23:21,138] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 12: [2023-04-29 17:23:21,139] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 12: [2023-04-29 17:23:21,139] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 12: [2023-04-29 17:23:21,139] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 12: [2023-04-29 17:23:21,139] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 3: [2023-04-29 17:23:21,139] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 3: [2023-04-29 17:23:21,139] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 3: [2023-04-29 17:23:21,139] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 3: [2023-04-29 17:23:21,139] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 3: [2023-04-29 17:23:21,139] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 3: [2023-04-29 17:23:21,139] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 3: [2023-04-29 17:23:21,139] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 17: [2023-04-29 17:23:21,139] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 12: [2023-04-29 17:23:21,140] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 17: [2023-04-29 17:23:21,141] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 20: [2023-04-29 17:23:21,141] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 17: [2023-04-29 17:23:21,141] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 12: [2023-04-29 17:23:21,148] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 12: [2023-04-29 17:23:21,148] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 21: [2023-04-29 17:23:21,155] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 21: [2023-04-29 17:23:21,155] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 21: [2023-04-29 17:23:21,155] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 21: [2023-04-29 17:23:21,156] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 12: [2023-04-29 17:23:21,157] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 11: [2023-04-29 17:23:21,157] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 11: [2023-04-29 17:23:21,157] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 11: [2023-04-29 17:23:21,157] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 8: [2023-04-29 17:23:21,157] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 8: [2023-04-29 17:23:21,157] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 11: [2023-04-29 17:23:21,158] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 11: [2023-04-29 17:23:21,158] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 11: [2023-04-29 17:23:21,158] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 11: [2023-04-29 17:23:21,158] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 11: [2023-04-29 17:23:21,158] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 11: [2023-04-29 17:23:21,162] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 11: [2023-04-29 17:23:21,162] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 11: [2023-04-29 17:23:21,162] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 8: [2023-04-29 17:23:21,163] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 23: [2023-04-29 17:23:21,163] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 23: [2023-04-29 17:23:21,163] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 4: [2023-04-29 17:23:21,163] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 4: [2023-04-29 17:23:21,163] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 23: [2023-04-29 17:23:21,163] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 4: [2023-04-29 17:23:21,164] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 4: [2023-04-29 17:23:21,164] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 19: [2023-04-29 17:23:21,164] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 19: [2023-04-29 17:23:21,164] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 19: [2023-04-29 17:23:21,164] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 4: [2023-04-29 17:23:21,164] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 4: [2023-04-29 17:23:21,164] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 4: [2023-04-29 17:23:21,164] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 23: [2023-04-29 17:23:21,164] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 23: [2023-04-29 17:23:21,164] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 4: [2023-04-29 17:23:21,164] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 26: [2023-04-29 17:23:21,164] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 26: [2023-04-29 17:23:21,164] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 26: [2023-04-29 17:23:21,164] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 26: [2023-04-29 17:23:21,164] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 26: [2023-04-29 17:23:21,164] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 26: [2023-04-29 17:23:21,164] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 26: [2023-04-29 17:23:21,164] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 23: [2023-04-29 17:23:21,165] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 23: [2023-04-29 17:23:21,165] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 26: [2023-04-29 17:23:21,165] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 23: [2023-04-29 17:23:21,165] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 27: [2023-04-29 17:23:21,165] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 27: [2023-04-29 17:23:21,165] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 27: [2023-04-29 17:23:21,166] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 27: [2023-04-29 17:23:21,166] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 27: [2023-04-29 17:23:21,166] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 27: [2023-04-29 17:23:21,166] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 27: [2023-04-29 17:23:21,166] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 27: [2023-04-29 17:23:21,167] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 3: [2023-04-29 17:23:21,166] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 11: [2023-04-29 17:23:21,167] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 11: [2023-04-29 17:23:21,167] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 11: [2023-04-29 17:23:21,168] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 4: [2023-04-29 17:23:21,168] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 4: [2023-04-29 17:23:21,168] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 3: [2023-04-29 17:23:21,168] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 3: [2023-04-29 17:23:21,168] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 11: [2023-04-29 17:23:21,169] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 19: [2023-04-29 17:23:21,168] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 21: [2023-04-29 17:23:21,169] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 21: [2023-04-29 17:23:21,169] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 21: [2023-04-29 17:23:21,169] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 21: [2023-04-29 17:23:21,169] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 11: [2023-04-29 17:23:21,169] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 23: [2023-04-29 17:23:21,169] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 9: [2023-04-29 17:23:21,169] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 9: [2023-04-29 17:23:21,169] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 9: [2023-04-29 17:23:21,169] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 9: [2023-04-29 17:23:21,169] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 9: [2023-04-29 17:23:21,169] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 9: [2023-04-29 17:23:21,169] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 9: [2023-04-29 17:23:21,169] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 9: [2023-04-29 17:23:21,170] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 1: [2023-04-29 17:23:21,169] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 1: [2023-04-29 17:23:21,169] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 1: [2023-04-29 17:23:21,169] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 1: [2023-04-29 17:23:21,169] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 1: [2023-04-29 17:23:21,169] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 8: [2023-04-29 17:23:21,164] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 8: [2023-04-29 17:23:21,164] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 1: [2023-04-29 17:23:21,169] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 1: [2023-04-29 17:23:21,169] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 8: [2023-04-29 17:23:21,166] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 12: [2023-04-29 17:23:21,170] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 1: [2023-04-29 17:23:21,170] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 8: [2023-04-29 17:23:21,168] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 23: [2023-04-29 17:23:21,170] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 8: [2023-04-29 17:23:21,170] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 23: [2023-04-29 17:23:21,170] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 12: [2023-04-29 17:23:21,171] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 26: [2023-04-29 17:23:21,171] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 27: [2023-04-29 17:23:21,171] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 3: [2023-04-29 17:23:21,172] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 3: [2023-04-29 17:23:21,172] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 27: [2023-04-29 17:23:21,173] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 26: [2023-04-29 17:23:21,172] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 26: [2023-04-29 17:23:21,172] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 26: [2023-04-29 17:23:21,173] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 26: [2023-04-29 17:23:21,173] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 26: [2023-04-29 17:23:21,173] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 12: [2023-04-29 17:23:21,173] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 12: [2023-04-29 17:23:21,173] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 26: [2023-04-29 17:23:21,173] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 23: [2023-04-29 17:23:21,173] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 26: [2023-04-29 17:23:21,173] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 3: [2023-04-29 17:23:21,174] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 23: [2023-04-29 17:23:21,174] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 9: [2023-04-29 17:23:21,174] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 9: [2023-04-29 17:23:21,174] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 9: [2023-04-29 17:23:21,174] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 23: [2023-04-29 17:23:21,174] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 9: [2023-04-29 17:23:21,175] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 1: [2023-04-29 17:23:21,175] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 9: [2023-04-29 17:23:21,175] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 9: [2023-04-29 17:23:21,175] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 1: [2023-04-29 17:23:21,175] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 27: [2023-04-29 17:23:21,175] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 9: [2023-04-29 17:23:21,175] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 9: [2023-04-29 17:23:21,175] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 4: [2023-04-29 17:23:21,175] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 23: [2023-04-29 17:23:21,175] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 1: [2023-04-29 17:23:21,175] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 27: [2023-04-29 17:23:21,175] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 23: [2023-04-29 17:23:21,175] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 1: [2023-04-29 17:23:21,175] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 7: [2023-04-29 17:23:21,175] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 7: [2023-04-29 17:23:21,175] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 7: [2023-04-29 17:23:21,175] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 4: [2023-04-29 17:23:21,176] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 27: [2023-04-29 17:23:21,176] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 4: [2023-04-29 17:23:21,176] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 1: [2023-04-29 17:23:21,176] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 4: [2023-04-29 17:23:21,177] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 1: [2023-04-29 17:23:21,177] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 27: [2023-04-29 17:23:21,177] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 4: [2023-04-29 17:23:21,177] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 27: [2023-04-29 17:23:21,178] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 27: [2023-04-29 17:23:21,178] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 4: [2023-04-29 17:23:21,178] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 1: [2023-04-29 17:23:21,178] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 1: [2023-04-29 17:23:21,178] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 21: [2023-04-29 17:23:21,179] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 21: [2023-04-29 17:23:21,179] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 21: [2023-04-29 17:23:21,180] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 21: [2023-04-29 17:23:21,180] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 14: [2023-04-29 17:23:21,183] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 14: [2023-04-29 17:23:21,183] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 14: [2023-04-29 17:23:21,183] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 14: [2023-04-29 17:23:21,183] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 14: [2023-04-29 17:23:21,183] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 14: [2023-04-29 17:23:21,183] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 14: [2023-04-29 17:23:21,183] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 14: [2023-04-29 17:23:21,184] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 19: [2023-04-29 17:23:21,184] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 19: [2023-04-29 17:23:21,184] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 19: [2023-04-29 17:23:21,184] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 19: [2023-04-29 17:23:21,184] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 19: [2023-04-29 17:23:21,184] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 13: [2023-04-29 17:23:21,184] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 13: [2023-04-29 17:23:21,185] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 19: [2023-04-29 17:23:21,186] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 19: [2023-04-29 17:23:21,187] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 14: [2023-04-29 17:23:21,187] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 13: [2023-04-29 17:23:21,189] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 19: [2023-04-29 17:23:21,191] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 21: [2023-04-29 17:23:21,194] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 14: [2023-04-29 17:23:21,193] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 14: [2023-04-29 17:23:21,193] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 14: [2023-04-29 17:23:21,195] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 7: [2023-04-29 17:23:21,194] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 7: [2023-04-29 17:23:21,194] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 7: [2023-04-29 17:23:21,194] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 7: [2023-04-29 17:23:21,194] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 7: [2023-04-29 17:23:21,194] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 21: [2023-04-29 17:23:21,195] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 14: [2023-04-29 17:23:21,195] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 14: [2023-04-29 17:23:21,195] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 14: [2023-04-29 17:23:21,195] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 14: [2023-04-29 17:23:21,196] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 21: [2023-04-29 17:23:21,196] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 7: [2023-04-29 17:23:21,198] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 21: [2023-04-29 17:23:21,198] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 7: [2023-04-29 17:23:21,198] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 7: [2023-04-29 17:23:21,200] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 13: [2023-04-29 17:23:21,205] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 0: [2023-04-29 17:23:21,206] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 0: [2023-04-29 17:23:21,206] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 0: [2023-04-29 17:23:21,206] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 0: [2023-04-29 17:23:21,206] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 0: [2023-04-29 17:23:21,206] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 0: [2023-04-29 17:23:21,206] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 0: [2023-04-29 17:23:21,206] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 0: [2023-04-29 17:23:21,207] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 13: [2023-04-29 17:23:21,209] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 13: [2023-04-29 17:23:21,209] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 13: [2023-04-29 17:23:21,209] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 13: [2023-04-29 17:23:21,210] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 19: [2023-04-29 17:23:21,211] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 13: [2023-04-29 17:23:21,211] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 13: [2023-04-29 17:23:21,211] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 13: [2023-04-29 17:23:21,211] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 19: [2023-04-29 17:23:21,212] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 19: [2023-04-29 17:23:21,212] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 19: [2023-04-29 17:23:21,213] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 25: [2023-04-29 17:23:21,214] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 25: [2023-04-29 17:23:21,214] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 11: [2023-04-29 17:23:21,214] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 11: [2023-04-29 17:23:21,214] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 11: [2023-04-29 17:23:21,214] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 24: [2023-04-29 17:23:21,218] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 24: [2023-04-29 17:23:21,218] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 24: [2023-04-29 17:23:21,218] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 24: [2023-04-29 17:23:21,218] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 24: [2023-04-29 17:23:21,219] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 24: [2023-04-29 17:23:21,219] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 24: [2023-04-29 17:23:21,219] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 4: [2023-04-29 17:23:21,219] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 24: [2023-04-29 17:23:21,219] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 25: [2023-04-29 17:23:21,219] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 25: [2023-04-29 17:23:21,219] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 25: [2023-04-29 17:23:21,219] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 25: [2023-04-29 17:23:21,219] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 25: [2023-04-29 17:23:21,219] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 25: [2023-04-29 17:23:21,219] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 25: [2023-04-29 17:23:21,219] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 25: [2023-04-29 17:23:21,219] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 0: [2023-04-29 17:23:21,220] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 31: [2023-04-29 17:23:21,220] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 31: [2023-04-29 17:23:21,220] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 31: [2023-04-29 17:23:21,220] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 4: [2023-04-29 17:23:21,220] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 31: [2023-04-29 17:23:21,220] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 31: [2023-04-29 17:23:21,220] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 31: [2023-04-29 17:23:21,220] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 31: [2023-04-29 17:23:21,220] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 31: [2023-04-29 17:23:21,220] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 0: [2023-04-29 17:23:21,221] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 0: [2023-04-29 17:23:21,221] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 7: [2023-04-29 17:23:21,222] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 0: [2023-04-29 17:23:21,222] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 0: [2023-04-29 17:23:21,222] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 0: [2023-04-29 17:23:21,222] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 24: [2023-04-29 17:23:21,222] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 23: [2023-04-29 17:23:21,223] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 0: [2023-04-29 17:23:21,223] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 27: [2023-04-29 17:23:21,224] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 0: [2023-04-29 17:23:21,224] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 7: [2023-04-29 17:23:21,225] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 26: [2023-04-29 17:23:21,224] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 26: [2023-04-29 17:23:21,224] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 31: [2023-04-29 17:23:21,225] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 31: [2023-04-29 17:23:21,225] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 31: [2023-04-29 17:23:21,225] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 27: [2023-04-29 17:23:21,226] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 23: [2023-04-29 17:23:21,226] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 7: [2023-04-29 17:23:21,226] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 7: [2023-04-29 17:23:21,227] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 7: [2023-04-29 17:23:21,227] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 31: [2023-04-29 17:23:21,226] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 31: [2023-04-29 17:23:21,227] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 31: [2023-04-29 17:23:21,227] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 31: [2023-04-29 17:23:21,227] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 31: [2023-04-29 17:23:21,227] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 26: [2023-04-29 17:23:21,229] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 25: [2023-04-29 17:23:21,229] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 25: [2023-04-29 17:23:21,229] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 25: [2023-04-29 17:23:21,229] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 25: [2023-04-29 17:23:21,230] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 11: [2023-04-29 17:23:21,230] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 11: [2023-04-29 17:23:21,230] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 2: [2023-04-29 17:23:21,230] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 2: [2023-04-29 17:23:21,230] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 25: [2023-04-29 17:23:21,230] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 24: [2023-04-29 17:23:21,230] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 24: [2023-04-29 17:23:21,230] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 24: [2023-04-29 17:23:21,231] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 23: [2023-04-29 17:23:21,231] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 25: [2023-04-29 17:23:21,231] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 24: [2023-04-29 17:23:21,231] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 9: [2023-04-29 17:23:21,231] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 9: [2023-04-29 17:23:21,231] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 9: [2023-04-29 17:23:21,232] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 24: [2023-04-29 17:23:21,232] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 1: [2023-04-29 17:23:21,232] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 1: [2023-04-29 17:23:21,232] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 1: [2023-04-29 17:23:21,232] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 1: [2023-04-29 17:23:21,232] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 24: [2023-04-29 17:23:21,232] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 24: [2023-04-29 17:23:21,233] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 2: [2023-04-29 17:23:21,233] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 11: [2023-04-29 17:23:21,233] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 11: [2023-04-29 17:23:21,233] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 11: [2023-04-29 17:23:21,233] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 2: [2023-04-29 17:23:21,233] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 2: [2023-04-29 17:23:21,233] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 9: [2023-04-29 17:23:21,233] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 2: [2023-04-29 17:23:21,233] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 2: [2023-04-29 17:23:21,233] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 9: [2023-04-29 17:23:21,234] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 9: [2023-04-29 17:23:21,234] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 26: [2023-04-29 17:23:21,234] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 2: [2023-04-29 17:23:21,234] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 9: [2023-04-29 17:23:21,234] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 2: [2023-04-29 17:23:21,235] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 2: [2023-04-29 17:23:21,235] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 11: [2023-04-29 17:23:21,236] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 11: [2023-04-29 17:23:21,236] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 13: [2023-04-29 17:23:21,236] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 9: [2023-04-29 17:23:21,236] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 11: [2023-04-29 17:23:21,237] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 2: [2023-04-29 17:23:21,237] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 26: [2023-04-29 17:23:21,237] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 26: [2023-04-29 17:23:21,237] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 26: [2023-04-29 17:23:21,237] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 26: [2023-04-29 17:23:21,237] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 1: [2023-04-29 17:23:21,237] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 14: [2023-04-29 17:23:21,237] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 1: [2023-04-29 17:23:21,238] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 1: [2023-04-29 17:23:21,238] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 1: [2023-04-29 17:23:21,238] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 10: [2023-04-29 17:23:21,238] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 10: [2023-04-29 17:23:21,238] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 4: [2023-04-29 17:23:21,239] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 10: [2023-04-29 17:23:21,240] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 10: [2023-04-29 17:23:21,240] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 13: [2023-04-29 17:23:21,240] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 4: [2023-04-29 17:23:21,240] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 10: [2023-04-29 17:23:21,240] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 10: [2023-04-29 17:23:21,240] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 10: [2023-04-29 17:23:21,240] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 10: [2023-04-29 17:23:21,240] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 2: [2023-04-29 17:23:21,240] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 13: [2023-04-29 17:23:21,241] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 13: [2023-04-29 17:23:21,242] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 13: [2023-04-29 17:23:21,242] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 2: [2023-04-29 17:23:21,243] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 2: [2023-04-29 17:23:21,244] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 2: [2023-04-29 17:23:21,244] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 10: [2023-04-29 17:23:21,244] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 10: [2023-04-29 17:23:21,244] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 2: [2023-04-29 17:23:21,245] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 10: [2023-04-29 17:23:21,245] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 10: [2023-04-29 17:23:21,245] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 23: [2023-04-29 17:23:21,245] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 4: [2023-04-29 17:23:21,245] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 4: [2023-04-29 17:23:21,245] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 27: [2023-04-29 17:23:21,246] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 22: [2023-04-29 17:23:21,247] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 22: [2023-04-29 17:23:21,247] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 22: [2023-04-29 17:23:21,247] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 22: [2023-04-29 17:23:21,247] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 22: [2023-04-29 17:23:21,247] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 22: [2023-04-29 17:23:21,247] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 22: [2023-04-29 17:23:21,247] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 27: [2023-04-29 17:23:21,247] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 27: [2023-04-29 17:23:21,247] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 27: [2023-04-29 17:23:21,247] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 27: [2023-04-29 17:23:21,247] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 22: [2023-04-29 17:23:21,247] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 27: [2023-04-29 17:23:21,247] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 10: [2023-04-29 17:23:21,248] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 10: [2023-04-29 17:23:21,248] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 23: [2023-04-29 17:23:21,249] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 23: [2023-04-29 17:23:21,249] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 10: [2023-04-29 17:23:21,249] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 23: [2023-04-29 17:23:21,250] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 10: [2023-04-29 17:23:21,250] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 27: [2023-04-29 17:23:21,250] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 22: [2023-04-29 17:23:21,250] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 4: [2023-04-29 17:23:21,250] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 4: [2023-04-29 17:23:21,250] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 4: [2023-04-29 17:23:21,250] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 4: [2023-04-29 17:23:21,250] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 27: [2023-04-29 17:23:21,251] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 22: [2023-04-29 17:23:21,251] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 23: [2023-04-29 17:23:21,253] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 23: [2023-04-29 17:23:21,253] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 23: [2023-04-29 17:23:21,253] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 26: [2023-04-29 17:23:21,253] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 26: [2023-04-29 17:23:21,254] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 23: [2023-04-29 17:23:21,255] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 11: [2023-04-29 17:23:21,256] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 14: [2023-04-29 17:23:21,257] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 9: [2023-04-29 17:23:21,257] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 11: [2023-04-29 17:23:21,257] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 22: [2023-04-29 17:23:21,257] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 22: [2023-04-29 17:23:21,258] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 22: [2023-04-29 17:23:21,258] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 22: [2023-04-29 17:23:21,259] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 9: [2023-04-29 17:23:21,259] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 26: [2023-04-29 17:23:21,259] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 9: [2023-04-29 17:23:21,259] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 9: [2023-04-29 17:23:21,259] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 22: [2023-04-29 17:23:21,259] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 26: [2023-04-29 17:23:21,260] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 22: [2023-04-29 17:23:21,260] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 9: [2023-04-29 17:23:21,260] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 9: [2023-04-29 17:23:21,260] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 1: [2023-04-29 17:23:21,261] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 1: [2023-04-29 17:23:21,261] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 1: [2023-04-29 17:23:21,261] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 11: [2023-04-29 17:23:21,261] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 29: [2023-04-29 17:23:21,262] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 9: [2023-04-29 17:23:21,262] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 9: [2023-04-29 17:23:21,263] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 29: [2023-04-29 17:23:21,263] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 29: [2023-04-29 17:23:21,263] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 11: [2023-04-29 17:23:21,263] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 11: [2023-04-29 17:23:21,263] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 29: [2023-04-29 17:23:21,263] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 29: [2023-04-29 17:23:21,263] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 29: [2023-04-29 17:23:21,263] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 29: [2023-04-29 17:23:21,263] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 29: [2023-04-29 17:23:21,264] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 26: [2023-04-29 17:23:21,265] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 1: [2023-04-29 17:23:21,266] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 14: [2023-04-29 17:23:21,266] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 14: [2023-04-29 17:23:21,266] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 29: [2023-04-29 17:23:21,266] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 1: [2023-04-29 17:23:21,268] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 26: [2023-04-29 17:23:21,268] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 18: [2023-04-29 17:23:21,268] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 18: [2023-04-29 17:23:21,268] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 18: [2023-04-29 17:23:21,268] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 18: [2023-04-29 17:23:21,268] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 18: [2023-04-29 17:23:21,268] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 18: [2023-04-29 17:23:21,268] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 18: [2023-04-29 17:23:21,268] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 26: [2023-04-29 17:23:21,269] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 18: [2023-04-29 17:23:21,269] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 26: [2023-04-29 17:23:21,269] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 30: [2023-04-29 17:23:21,269] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 30: [2023-04-29 17:23:21,270] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 30: [2023-04-29 17:23:21,270] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 30: [2023-04-29 17:23:21,270] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 30: [2023-04-29 17:23:21,270] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 30: [2023-04-29 17:23:21,270] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 30: [2023-04-29 17:23:21,270] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 30: [2023-04-29 17:23:21,270] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 1: [2023-04-29 17:23:21,271] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 25: [2023-04-29 17:23:21,270] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 25: [2023-04-29 17:23:21,270] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 24: [2023-04-29 17:23:21,272] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 1: [2023-04-29 17:23:21,273] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 1: [2023-04-29 17:23:21,273] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 29: [2023-04-29 17:23:21,274] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 4: [2023-04-29 17:23:21,274] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 29: [2023-04-29 17:23:21,275] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 29: [2023-04-29 17:23:21,275] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 4: [2023-04-29 17:23:21,275] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 29: [2023-04-29 17:23:21,276] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 5: [2023-04-29 17:23:21,276] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 5: [2023-04-29 17:23:21,276] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 29: [2023-04-29 17:23:21,276] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 29: [2023-04-29 17:23:21,277] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 29: [2023-04-29 17:23:21,277] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 14: [2023-04-29 17:23:21,277] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 14: [2023-04-29 17:23:21,277] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 14: [2023-04-29 17:23:21,277] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 14: [2023-04-29 17:23:21,278] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 14: [2023-04-29 17:23:21,277] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 31: [2023-04-29 17:23:21,278] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 31: [2023-04-29 17:23:21,278] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 31: [2023-04-29 17:23:21,278] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 27: [2023-04-29 17:23:21,278] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 23: [2023-04-29 17:23:21,279] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 5: [2023-04-29 17:23:21,279] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 5: [2023-04-29 17:23:21,279] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 5: [2023-04-29 17:23:21,279] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 5: [2023-04-29 17:23:21,279] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 5: [2023-04-29 17:23:21,279] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 5: [2023-04-29 17:23:21,279] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 5: [2023-04-29 17:23:21,280] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 5: [2023-04-29 17:23:21,281] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 27: [2023-04-29 17:23:21,281] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 27: [2023-04-29 17:23:21,281] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 4: [2023-04-29 17:23:21,281] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 30: [2023-04-29 17:23:21,281] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 30: [2023-04-29 17:23:21,281] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 18: [2023-04-29 17:23:21,281] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 18: [2023-04-29 17:23:21,281] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 23: [2023-04-29 17:23:21,281] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 30: [2023-04-29 17:23:21,281] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 30: [2023-04-29 17:23:21,281] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 30: [2023-04-29 17:23:21,282] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 23: [2023-04-29 17:23:21,282] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 30: [2023-04-29 17:23:21,282] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 27: [2023-04-29 17:23:21,282] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 30: [2023-04-29 17:23:21,282] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 4: [2023-04-29 17:23:21,282] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 18: [2023-04-29 17:23:21,283] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 27: [2023-04-29 17:23:21,283] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 23: [2023-04-29 17:23:21,283] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 18: [2023-04-29 17:23:21,283] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 30: [2023-04-29 17:23:21,283] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 18: [2023-04-29 17:23:21,283] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 18: [2023-04-29 17:23:21,284] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 18: [2023-04-29 17:23:21,284] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 6: [2023-04-29 17:23:21,283] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 6: [2023-04-29 17:23:21,283] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 6: [2023-04-29 17:23:21,283] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 6: [2023-04-29 17:23:21,284] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 6: [2023-04-29 17:23:21,284] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 6: [2023-04-29 17:23:21,284] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 6: [2023-04-29 17:23:21,284] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 6: [2023-04-29 17:23:21,284] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 15: [2023-04-29 17:23:21,284] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 15: [2023-04-29 17:23:21,285] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 15: [2023-04-29 17:23:21,285] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 15: [2023-04-29 17:23:21,285] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 27: [2023-04-29 17:23:21,285] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 15: [2023-04-29 17:23:21,285] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 15: [2023-04-29 17:23:21,285] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 15: [2023-04-29 17:23:21,285] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 18: [2023-04-29 17:23:21,285] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 15: [2023-04-29 17:23:21,285] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 23: [2023-04-29 17:23:21,285] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 4: [2023-04-29 17:23:21,286] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 4: [2023-04-29 17:23:21,286] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 6: [2023-04-29 17:23:21,288] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 6: [2023-04-29 17:23:21,288] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 20: [2023-04-29 17:23:21,289] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 20: [2023-04-29 17:23:21,289] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 5: [2023-04-29 17:23:21,289] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 5: [2023-04-29 17:23:21,289] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 5: [2023-04-29 17:23:21,290] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 5: [2023-04-29 17:23:21,290] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 2: [2023-04-29 17:23:21,290] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 2: [2023-04-29 17:23:21,290] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 2: [2023-04-29 17:23:21,290] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 5: [2023-04-29 17:23:21,291] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 5: [2023-04-29 17:23:21,291] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 6: [2023-04-29 17:23:21,292] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 14: [2023-04-29 17:23:21,292] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 20: [2023-04-29 17:23:21,292] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 20: [2023-04-29 17:23:21,292] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 20: [2023-04-29 17:23:21,292] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 20: [2023-04-29 17:23:21,292] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 20: [2023-04-29 17:23:21,292] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 14: [2023-04-29 17:23:21,292] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 20: [2023-04-29 17:23:21,292] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 2: [2023-04-29 17:23:21,292] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 24: [2023-04-29 17:23:21,293] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 25: [2023-04-29 17:23:21,293] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 6: [2023-04-29 17:23:21,293] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 31: [2023-04-29 17:23:21,293] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 31: [2023-04-29 17:23:21,293] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 31: [2023-04-29 17:23:21,293] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 31: [2023-04-29 17:23:21,293] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 25: [2023-04-29 17:23:21,293] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 31: [2023-04-29 17:23:21,293] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 6: [2023-04-29 17:23:21,294] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 20: [2023-04-29 17:23:21,294] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 6: [2023-04-29 17:23:21,294] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 20: [2023-04-29 17:23:21,294] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 6: [2023-04-29 17:23:21,295] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 6: [2023-04-29 17:23:21,295] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 22: [2023-04-29 17:23:21,294] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 15: [2023-04-29 17:23:21,298] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 20: [2023-04-29 17:23:21,298] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 25: [2023-04-29 17:23:21,297] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 25: [2023-04-29 17:23:21,297] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 15: [2023-04-29 17:23:21,298] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 15: [2023-04-29 17:23:21,298] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 15: [2023-04-29 17:23:21,299] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 16: [2023-04-29 17:23:21,299] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 16: [2023-04-29 17:23:21,299] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 16: [2023-04-29 17:23:21,299] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 16: [2023-04-29 17:23:21,299] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 16: [2023-04-29 17:23:21,299] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 16: [2023-04-29 17:23:21,299] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 16: [2023-04-29 17:23:21,299] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 16: [2023-04-29 17:23:21,299] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 31: [2023-04-29 17:23:21,299] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 15: [2023-04-29 17:23:21,300] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 25: [2023-04-29 17:23:21,300] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 25: [2023-04-29 17:23:21,300] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 25: [2023-04-29 17:23:21,300] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 15: [2023-04-29 17:23:21,300] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 25: [2023-04-29 17:23:21,300] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 31: [2023-04-29 17:23:21,300] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 15: [2023-04-29 17:23:21,300] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 0: [2023-04-29 17:23:21,300] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 0: [2023-04-29 17:23:21,300] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 15: [2023-04-29 17:23:21,300] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 0: [2023-04-29 17:23:21,300] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 31: [2023-04-29 17:23:21,301] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 10: [2023-04-29 17:23:21,301] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 10: [2023-04-29 17:23:21,301] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 10: [2023-04-29 17:23:21,301] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 10: [2023-04-29 17:23:21,301] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 20: [2023-04-29 17:23:21,301] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 20: [2023-04-29 17:23:21,301] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 20: [2023-04-29 17:23:21,302] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 20: [2023-04-29 17:23:21,303] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 20: [2023-04-29 17:23:21,303] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 22: [2023-04-29 17:23:21,303] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 16: [2023-04-29 17:23:21,305] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 16: [2023-04-29 17:23:21,305] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 16: [2023-04-29 17:23:21,305] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 16: [2023-04-29 17:23:21,305] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 16: [2023-04-29 17:23:21,306] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 24: [2023-04-29 17:23:21,305] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 24: [2023-04-29 17:23:21,305] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 24: [2023-04-29 17:23:21,305] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 10: [2023-04-29 17:23:21,306] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 10: [2023-04-29 17:23:21,306] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 10: [2023-04-29 17:23:21,306] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 16: [2023-04-29 17:23:21,306] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 16: [2023-04-29 17:23:21,307] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 16: [2023-04-29 17:23:21,307] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 10: [2023-04-29 17:23:21,307] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 17: [2023-04-29 17:23:21,307] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 17: [2023-04-29 17:23:21,308] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 17: [2023-04-29 17:23:21,308] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 17: [2023-04-29 17:23:21,308] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 17: [2023-04-29 17:23:21,308] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 17: [2023-04-29 17:23:21,309] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 17: [2023-04-29 17:23:21,309] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 17: [2023-04-29 17:23:21,309] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 24: [2023-04-29 17:23:21,309] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 24: [2023-04-29 17:23:21,309] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 24: [2023-04-29 17:23:21,309] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 24: [2023-04-29 17:23:21,310] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 14: [2023-04-29 17:23:21,310] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 2: [2023-04-29 17:23:21,311] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 2: [2023-04-29 17:23:21,311] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 14: [2023-04-29 17:23:21,312] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 2: [2023-04-29 17:23:21,312] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 2: [2023-04-29 17:23:21,313] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 2: [2023-04-29 17:23:21,313] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 2: [2023-04-29 17:23:21,313] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 14: [2023-04-29 17:23:21,313] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 2: [2023-04-29 17:23:21,313] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 0: [2023-04-29 17:23:21,313] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 0: [2023-04-29 17:23:21,313] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 0: [2023-04-29 17:23:21,313] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 0: [2023-04-29 17:23:21,314] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 17: [2023-04-29 17:23:21,313] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 14: [2023-04-29 17:23:21,314] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 17: [2023-04-29 17:23:21,315] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 14: [2023-04-29 17:23:21,315] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 3: [2023-04-29 17:23:21,315] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 3: [2023-04-29 17:23:21,315] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 0: [2023-04-29 17:23:21,316] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 2: [2023-04-29 17:23:21,316] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 29: [2023-04-29 17:23:21,315] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 22: [2023-04-29 17:23:21,316] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 3: [2023-04-29 17:23:21,316] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 3: [2023-04-29 17:23:21,316] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 3: [2023-04-29 17:23:21,316] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 3: [2023-04-29 17:23:21,316] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 3: [2023-04-29 17:23:21,316] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 3: [2023-04-29 17:23:21,317] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 17: [2023-04-29 17:23:21,318] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 17: [2023-04-29 17:23:21,318] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 17: [2023-04-29 17:23:21,319] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 3: [2023-04-29 17:23:21,319] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 3: [2023-04-29 17:23:21,319] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 31: [2023-04-29 17:23:21,320] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 17: [2023-04-29 17:23:21,320] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 17: [2023-04-29 17:23:21,320] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 17: [2023-04-29 17:23:21,320] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 31: [2023-04-29 17:23:21,320] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 31: [2023-04-29 17:23:21,321] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 31: [2023-04-29 17:23:21,321] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 31: [2023-04-29 17:23:21,322] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 3: [2023-04-29 17:23:21,323] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 3: [2023-04-29 17:23:21,323] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 3: [2023-04-29 17:23:21,324] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 3: [2023-04-29 17:23:21,324] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 3: [2023-04-29 17:23:21,324] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 3: [2023-04-29 17:23:21,324] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 25: [2023-04-29 17:23:21,325] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 10: [2023-04-29 17:23:21,326] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 22: [2023-04-29 17:23:21,326] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 0: [2023-04-29 17:23:21,327] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 10: [2023-04-29 17:23:21,327] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 22: [2023-04-29 17:23:21,327] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 10: [2023-04-29 17:23:21,328] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 22: [2023-04-29 17:23:21,328] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 22: [2023-04-29 17:23:21,328] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 0: [2023-04-29 17:23:21,328] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 25: [2023-04-29 17:23:21,326] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 0: [2023-04-29 17:23:21,329] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 28: [2023-04-29 17:23:21,328] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 28: [2023-04-29 17:23:21,329] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 10: [2023-04-29 17:23:21,329] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 28: [2023-04-29 17:23:21,329] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 28: [2023-04-29 17:23:21,329] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 28: [2023-04-29 17:23:21,329] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 28: [2023-04-29 17:23:21,329] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 28: [2023-04-29 17:23:21,329] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 22: [2023-04-29 17:23:21,329] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 22: [2023-04-29 17:23:21,329] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 22: [2023-04-29 17:23:21,329] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 28: [2023-04-29 17:23:21,329] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 5: [2023-04-29 17:23:21,330] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 5: [2023-04-29 17:23:21,330] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 10: [2023-04-29 17:23:21,334] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 25: [2023-04-29 17:23:21,334] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 25: [2023-04-29 17:23:21,334] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 10: [2023-04-29 17:23:21,334] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 10: [2023-04-29 17:23:21,334] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 10: [2023-04-29 17:23:21,335] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 25: [2023-04-29 17:23:21,336] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 2: [2023-04-29 17:23:21,337] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 24: [2023-04-29 17:23:21,338] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 25: [2023-04-29 17:23:21,339] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 29: [2023-04-29 17:23:21,339] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 24: [2023-04-29 17:23:21,340] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 6: [2023-04-29 17:23:21,340] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 6: [2023-04-29 17:23:21,340] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 24: [2023-04-29 17:23:21,341] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 2: [2023-04-29 17:23:21,343] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 2: [2023-04-29 17:23:21,343] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 2: [2023-04-29 17:23:21,343] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 24: [2023-04-29 17:23:21,344] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 24: [2023-04-29 17:23:21,344] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 29: [2023-04-29 17:23:21,345] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 28: [2023-04-29 17:23:21,345] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 28: [2023-04-29 17:23:21,345] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 28: [2023-04-29 17:23:21,346] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 0: [2023-04-29 17:23:21,347] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 24: [2023-04-29 17:23:21,346] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 28: [2023-04-29 17:23:21,347] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 28: [2023-04-29 17:23:21,347] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 0: [2023-04-29 17:23:21,348] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 28: [2023-04-29 17:23:21,348] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 20: [2023-04-29 17:23:21,348] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 20: [2023-04-29 17:23:21,348] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 0: [2023-04-29 17:23:21,349] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 24: [2023-04-29 17:23:21,349] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 28: [2023-04-29 17:23:21,349] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 28: [2023-04-29 17:23:21,349] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt... 29: [2023-04-29 17:23:21,349] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 29: [2023-04-29 17:23:21,349] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 5: [2023-04-29 17:23:21,351] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 5: [2023-04-29 17:23:21,351] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 0: [2023-04-29 17:23:21,351] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 0: [2023-04-29 17:23:21,352] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 30: [2023-04-29 17:23:21,352] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 20: [2023-04-29 17:23:21,353] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 6: [2023-04-29 17:23:21,357] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 16: [2023-04-29 17:23:21,357] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 16: [2023-04-29 17:23:21,357] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 18: [2023-04-29 17:23:21,358] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 18: [2023-04-29 17:23:21,358] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 5: [2023-04-29 17:23:21,359] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 5: [2023-04-29 17:23:21,359] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 5: [2023-04-29 17:23:21,359] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 5: [2023-04-29 17:23:21,359] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 22: [2023-04-29 17:23:21,360] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 22: [2023-04-29 17:23:21,360] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 5: [2023-04-29 17:23:21,360] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 5: [2023-04-29 17:23:21,360] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 6: [2023-04-29 17:23:21,361] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 6: [2023-04-29 17:23:21,361] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 29: [2023-04-29 17:23:21,362] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 29: [2023-04-29 17:23:21,362] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 29: [2023-04-29 17:23:21,362] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 29: [2023-04-29 17:23:21,362] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 22: [2023-04-29 17:23:21,362] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 22: [2023-04-29 17:23:21,362] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 6: [2023-04-29 17:23:21,362] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 18: [2023-04-29 17:23:21,362] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 20: [2023-04-29 17:23:21,366] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 20: [2023-04-29 17:23:21,366] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 17: [2023-04-29 17:23:21,367] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 22: [2023-04-29 17:23:21,367] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 16: [2023-04-29 17:23:21,367] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 20: [2023-04-29 17:23:21,367] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 20: [2023-04-29 17:23:21,367] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 20: [2023-04-29 17:23:21,367] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 22: [2023-04-29 17:23:21,368] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 17: [2023-04-29 17:23:21,370] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 3: [2023-04-29 17:23:21,370] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 6: [2023-04-29 17:23:21,371] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 6: [2023-04-29 17:23:21,371] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 6: [2023-04-29 17:23:21,371] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 20: [2023-04-29 17:23:21,371] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 29: [2023-04-29 17:23:21,372] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 20: [2023-04-29 17:23:21,372] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 3: [2023-04-29 17:23:21,371] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 30: [2023-04-29 17:23:21,373] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 30: [2023-04-29 17:23:21,373] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 30: [2023-04-29 17:23:21,373] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 30: [2023-04-29 17:23:21,373] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 30: [2023-04-29 17:23:21,373] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 30: [2023-04-29 17:23:21,373] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 18: [2023-04-29 17:23:21,373] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 18: [2023-04-29 17:23:21,373] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 18: [2023-04-29 17:23:21,373] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 18: [2023-04-29 17:23:21,373] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 18: [2023-04-29 17:23:21,373] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 16: [2023-04-29 17:23:21,374] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 16: [2023-04-29 17:23:21,374] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 16: [2023-04-29 17:23:21,374] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 16: [2023-04-29 17:23:21,374] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 16: [2023-04-29 17:23:21,374] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 30: [2023-04-29 17:23:21,375] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 6: [2023-04-29 17:23:21,376] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 30: [2023-04-29 17:23:21,377] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 15: [2023-04-29 17:23:21,377] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 15: [2023-04-29 17:23:21,377] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 15: [2023-04-29 17:23:21,377] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 15: [2023-04-29 17:23:21,377] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 20: [2023-04-29 17:23:21,379] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 29: [2023-04-29 17:23:21,379] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 15: [2023-04-29 17:23:21,380] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 15: [2023-04-29 17:23:21,380] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 15: [2023-04-29 17:23:21,380] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 15: [2023-04-29 17:23:21,381] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 16: [2023-04-29 17:23:21,381] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 16: [2023-04-29 17:23:21,381] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 29: [2023-04-29 17:23:21,382] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 6: [2023-04-29 17:23:21,384] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 18: [2023-04-29 17:23:21,384] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 18: [2023-04-29 17:23:21,386] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 18: [2023-04-29 17:23:21,387] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 6: [2023-04-29 17:23:21,389] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 17: [2023-04-29 17:23:21,389] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 3: [2023-04-29 17:23:21,390] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 3: [2023-04-29 17:23:21,390] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 5: [2023-04-29 17:23:21,391] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 17: [2023-04-29 17:23:21,390] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 17: [2023-04-29 17:23:21,391] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 3: [2023-04-29 17:23:21,391] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 29: [2023-04-29 17:23:21,392] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 3: [2023-04-29 17:23:21,392] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 17: [2023-04-29 17:23:21,392] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 17: [2023-04-29 17:23:21,392] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 17: [2023-04-29 17:23:21,392] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 17: [2023-04-29 17:23:21,392] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 20: [2023-04-29 17:23:21,393] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 29: [2023-04-29 17:23:21,393] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 20: [2023-04-29 17:23:21,394] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 5: [2023-04-29 17:23:21,394] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 29: [2023-04-29 17:23:21,395] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 20: [2023-04-29 17:23:21,395] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 17: [2023-04-29 17:23:21,395] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 5: [2023-04-29 17:23:21,395] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 29: [2023-04-29 17:23:21,395] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 20: [2023-04-29 17:23:21,395] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 5: [2023-04-29 17:23:21,396] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 5: [2023-04-29 17:23:21,398] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 5: [2023-04-29 17:23:21,398] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 20: [2023-04-29 17:23:21,399] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 8: [2023-04-29 17:23:21,400] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 8: [2023-04-29 17:23:21,400] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 3: [2023-04-29 17:23:21,400] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 3: [2023-04-29 17:23:21,400] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 3: [2023-04-29 17:23:21,400] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 3: [2023-04-29 17:23:21,400] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 8: [2023-04-29 17:23:21,401] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 8: [2023-04-29 17:23:21,401] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 8: [2023-04-29 17:23:21,401] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 8: [2023-04-29 17:23:21,401] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 8: [2023-04-29 17:23:21,401] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 8: [2023-04-29 17:23:21,401] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 16: [2023-04-29 17:23:21,402] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 6: [2023-04-29 17:23:21,403] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 16: [2023-04-29 17:23:21,403] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 6: [2023-04-29 17:23:21,404] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 6: [2023-04-29 17:23:21,405] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 6: [2023-04-29 17:23:21,406] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 8: [2023-04-29 17:23:21,406] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 16: [2023-04-29 17:23:21,406] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 18: [2023-04-29 17:23:21,406] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 8: [2023-04-29 17:23:21,407] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 30: [2023-04-29 17:23:21,407] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 30: [2023-04-29 17:23:21,407] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 8: [2023-04-29 17:23:21,407] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 30: [2023-04-29 17:23:21,407] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 8: [2023-04-29 17:23:21,408] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 16: [2023-04-29 17:23:21,408] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 30: [2023-04-29 17:23:21,408] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 8: [2023-04-29 17:23:21,409] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 8: [2023-04-29 17:23:21,409] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 18: [2023-04-29 17:23:21,409] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 30: [2023-04-29 17:23:21,409] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 12: [2023-04-29 17:23:21,410] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 8: [2023-04-29 17:23:21,410] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 12: [2023-04-29 17:23:21,410] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 16: [2023-04-29 17:23:21,410] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 16: [2023-04-29 17:23:21,410] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 12: [2023-04-29 17:23:21,410] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 12: [2023-04-29 17:23:21,410] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 8: [2023-04-29 17:23:21,410] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 12: [2023-04-29 17:23:21,410] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 12: [2023-04-29 17:23:21,410] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 12: [2023-04-29 17:23:21,410] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 12: [2023-04-29 17:23:21,410] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 15: [2023-04-29 17:23:21,412] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 30: [2023-04-29 17:23:21,413] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 18: [2023-04-29 17:23:21,413] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 18: [2023-04-29 17:23:21,413] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 30: [2023-04-29 17:23:21,414] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 18: [2023-04-29 17:23:21,414] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 12: [2023-04-29 17:23:21,417] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 12: [2023-04-29 17:23:21,417] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 3: [2023-04-29 17:23:21,417] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 3: [2023-04-29 17:23:21,417] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 12: [2023-04-29 17:23:21,418] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 12: [2023-04-29 17:23:21,419] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 12: [2023-04-29 17:23:21,420] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 23: [2023-04-29 17:23:21,420] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 23: [2023-04-29 17:23:21,420] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 12: [2023-04-29 17:23:21,421] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 12: [2023-04-29 17:23:21,421] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 12: [2023-04-29 17:23:21,421] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 15: [2023-04-29 17:23:21,413] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 23: [2023-04-29 17:23:21,422] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 15: [2023-04-29 17:23:21,414] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 15: [2023-04-29 17:23:21,416] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 15: [2023-04-29 17:23:21,418] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 28: [2023-04-29 17:23:21,422] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 28: [2023-04-29 17:23:21,422] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 15: [2023-04-29 17:23:21,419] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 15: [2023-04-29 17:23:21,421] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 28: [2023-04-29 17:23:21,422] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 23: [2023-04-29 17:23:21,423] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 23: [2023-04-29 17:23:21,423] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 23: [2023-04-29 17:23:21,423] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 23: [2023-04-29 17:23:21,423] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 23: [2023-04-29 17:23:21,423] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 23: [2023-04-29 17:23:21,427] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 17: [2023-04-29 17:23:21,428] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 23: [2023-04-29 17:23:21,429] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 17: [2023-04-29 17:23:21,429] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 23: [2023-04-29 17:23:21,429] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 26: [2023-04-29 17:23:21,429] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 26: [2023-04-29 17:23:21,429] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 23: [2023-04-29 17:23:21,429] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 3: [2023-04-29 17:23:21,430] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 26: [2023-04-29 17:23:21,431] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 26: [2023-04-29 17:23:21,431] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 26: [2023-04-29 17:23:21,431] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 17: [2023-04-29 17:23:21,431] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 26: [2023-04-29 17:23:21,431] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 26: [2023-04-29 17:23:21,431] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 3: [2023-04-29 17:23:21,431] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 3: [2023-04-29 17:23:21,431] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 26: [2023-04-29 17:23:21,431] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 3: [2023-04-29 17:23:21,432] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 23: [2023-04-29 17:23:21,432] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 23: [2023-04-29 17:23:21,433] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 23: [2023-04-29 17:23:21,433] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 23: [2023-04-29 17:23:21,433] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 17: [2023-04-29 17:23:21,434] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 17: [2023-04-29 17:23:21,435] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 17: [2023-04-29 17:23:21,435] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 26: [2023-04-29 17:23:21,436] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 26: [2023-04-29 17:23:21,437] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 28: [2023-04-29 17:23:21,437] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 28: [2023-04-29 17:23:21,437] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 28: [2023-04-29 17:23:21,437] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 28: [2023-04-29 17:23:21,437] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 28: [2023-04-29 17:23:21,437] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_10-model_00-model_states.pt. 26: [2023-04-29 17:23:21,437] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 26: [2023-04-29 17:23:21,438] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 26: [2023-04-29 17:23:21,438] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 26: [2023-04-29 17:23:21,438] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 26: [2023-04-29 17:23:21,439] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 26: [2023-04-29 17:23:21,440] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 21: [2023-04-29 17:23:21,444] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 21: [2023-04-29 17:23:21,444] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 21: [2023-04-29 17:23:21,444] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 21: [2023-04-29 17:23:21,444] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 21: [2023-04-29 17:23:21,444] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 21: [2023-04-29 17:23:21,444] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 21: [2023-04-29 17:23:21,444] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 21: [2023-04-29 17:23:21,445] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 21: [2023-04-29 17:23:21,449] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 21: [2023-04-29 17:23:21,449] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 21: [2023-04-29 17:23:21,450] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 21: [2023-04-29 17:23:21,450] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 21: [2023-04-29 17:23:21,451] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 21: [2023-04-29 17:23:21,451] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 21: [2023-04-29 17:23:21,452] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 21: [2023-04-29 17:23:21,452] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 28: [2023-04-29 17:23:21,456] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 28: [2023-04-29 17:23:21,456] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 1: [2023-04-29 17:23:21,456] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 1: [2023-04-29 17:23:21,456] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 1: [2023-04-29 17:23:21,456] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 1: [2023-04-29 17:23:21,456] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 1: [2023-04-29 17:23:21,456] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 1: [2023-04-29 17:23:21,456] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 1: [2023-04-29 17:23:21,456] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 1: [2023-04-29 17:23:21,457] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 28: [2023-04-29 17:23:21,461] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 1: [2023-04-29 17:23:21,461] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 1: [2023-04-29 17:23:21,462] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 8: [2023-04-29 17:23:21,461] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 1: [2023-04-29 17:23:21,462] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 1: [2023-04-29 17:23:21,462] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 8: [2023-04-29 17:23:21,462] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 8: [2023-04-29 17:23:21,462] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 15: [2023-04-29 17:23:21,422] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 1: [2023-04-29 17:23:21,463] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 1: [2023-04-29 17:23:21,463] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 1: [2023-04-29 17:23:21,464] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 1: [2023-04-29 17:23:21,465] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 11: [2023-04-29 17:23:21,465] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 11: [2023-04-29 17:23:21,465] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 8: [2023-04-29 17:23:21,467] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 8: [2023-04-29 17:23:21,467] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 8: [2023-04-29 17:23:21,467] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 11: [2023-04-29 17:23:21,467] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 11: [2023-04-29 17:23:21,468] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 11: [2023-04-29 17:23:21,468] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 11: [2023-04-29 17:23:21,468] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 11: [2023-04-29 17:23:21,468] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 11: [2023-04-29 17:23:21,469] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 11: [2023-04-29 17:23:21,469] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 4: [2023-04-29 17:23:21,469] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 4: [2023-04-29 17:23:21,469] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 11: [2023-04-29 17:23:21,470] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 8: [2023-04-29 17:23:21,470] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 8: [2023-04-29 17:23:21,470] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 12: [2023-04-29 17:23:21,470] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 12: [2023-04-29 17:23:21,470] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 4: [2023-04-29 17:23:21,472] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 4: [2023-04-29 17:23:21,472] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 4: [2023-04-29 17:23:21,472] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 4: [2023-04-29 17:23:21,472] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 4: [2023-04-29 17:23:21,472] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 4: [2023-04-29 17:23:21,472] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 12: [2023-04-29 17:23:21,472] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 11: [2023-04-29 17:23:21,472] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 4: [2023-04-29 17:23:21,473] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 4: [2023-04-29 17:23:21,474] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 28: [2023-04-29 17:23:21,474] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 28: [2023-04-29 17:23:21,477] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 11: [2023-04-29 17:23:21,477] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 28: [2023-04-29 17:23:21,478] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 11: [2023-04-29 17:23:21,478] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 11: [2023-04-29 17:23:21,479] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 23: [2023-04-29 17:23:21,479] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 11: [2023-04-29 17:23:21,479] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 11: [2023-04-29 17:23:21,480] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 12: [2023-04-29 17:23:21,482] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 23: [2023-04-29 17:23:21,482] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 4: [2023-04-29 17:23:21,483] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 4: [2023-04-29 17:23:21,483] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 28: [2023-04-29 17:23:21,483] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 28: [2023-04-29 17:23:21,483] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 7: [2023-04-29 17:23:21,484] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 7: [2023-04-29 17:23:21,484] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 7: [2023-04-29 17:23:21,484] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 4: [2023-04-29 17:23:21,484] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 7: [2023-04-29 17:23:21,484] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 7: [2023-04-29 17:23:21,484] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 7: [2023-04-29 17:23:21,484] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 7: [2023-04-29 17:23:21,484] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 7: [2023-04-29 17:23:21,484] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 4: [2023-04-29 17:23:21,484] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 4: [2023-04-29 17:23:21,485] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 4: [2023-04-29 17:23:21,485] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 8: [2023-04-29 17:23:21,488] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 12: [2023-04-29 17:23:21,488] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 12: [2023-04-29 17:23:21,488] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 12: [2023-04-29 17:23:21,488] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 12: [2023-04-29 17:23:21,488] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 7: [2023-04-29 17:23:21,488] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 7: [2023-04-29 17:23:21,489] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 7: [2023-04-29 17:23:21,489] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 27: [2023-04-29 17:23:21,489] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 27: [2023-04-29 17:23:21,489] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 7: [2023-04-29 17:23:21,490] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 27: [2023-04-29 17:23:21,490] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 27: [2023-04-29 17:23:21,490] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 7: [2023-04-29 17:23:21,490] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 7: [2023-04-29 17:23:21,491] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 27: [2023-04-29 17:23:21,491] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 27: [2023-04-29 17:23:21,491] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 27: [2023-04-29 17:23:21,491] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 7: [2023-04-29 17:23:21,491] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 27: [2023-04-29 17:23:21,491] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 7: [2023-04-29 17:23:21,491] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 26: [2023-04-29 17:23:21,491] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 26: [2023-04-29 17:23:21,491] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 8: [2023-04-29 17:23:21,491] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 8: [2023-04-29 17:23:21,491] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 8: [2023-04-29 17:23:21,495] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 26: [2023-04-29 17:23:21,495] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 8: [2023-04-29 17:23:21,495] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 8: [2023-04-29 17:23:21,495] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 26: [2023-04-29 17:23:21,496] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 27: [2023-04-29 17:23:21,496] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 27: [2023-04-29 17:23:21,497] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 8: [2023-04-29 17:23:21,498] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 23: [2023-04-29 17:23:21,499] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 23: [2023-04-29 17:23:21,499] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 23: [2023-04-29 17:23:21,499] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 27: [2023-04-29 17:23:21,499] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 27: [2023-04-29 17:23:21,499] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 8: [2023-04-29 17:23:21,500] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 27: [2023-04-29 17:23:21,500] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 26: [2023-04-29 17:23:21,501] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 26: [2023-04-29 17:23:21,501] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 26: [2023-04-29 17:23:21,501] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 26: [2023-04-29 17:23:21,501] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 27: [2023-04-29 17:23:21,501] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 27: [2023-04-29 17:23:21,501] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 27: [2023-04-29 17:23:21,501] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 12: [2023-04-29 17:23:21,502] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 23: [2023-04-29 17:23:21,503] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 9: [2023-04-29 17:23:21,503] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 9: [2023-04-29 17:23:21,503] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 9: [2023-04-29 17:23:21,503] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 9: [2023-04-29 17:23:21,503] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 9: [2023-04-29 17:23:21,503] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 9: [2023-04-29 17:23:21,503] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 9: [2023-04-29 17:23:21,503] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 9: [2023-04-29 17:23:21,504] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 21: [2023-04-29 17:23:21,503] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 21: [2023-04-29 17:23:21,503] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 21: [2023-04-29 17:23:21,503] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 12: [2023-04-29 17:23:21,504] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 12: [2023-04-29 17:23:21,504] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 23: [2023-04-29 17:23:21,505] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 23: [2023-04-29 17:23:21,505] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 23: [2023-04-29 17:23:21,505] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 23: [2023-04-29 17:23:21,505] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 19: [2023-04-29 17:23:21,505] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 19: [2023-04-29 17:23:21,505] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 19: [2023-04-29 17:23:21,507] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 19: [2023-04-29 17:23:21,507] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 19: [2023-04-29 17:23:21,507] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 19: [2023-04-29 17:23:21,507] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 19: [2023-04-29 17:23:21,507] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 19: [2023-04-29 17:23:21,508] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 9: [2023-04-29 17:23:21,508] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 9: [2023-04-29 17:23:21,508] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 9: [2023-04-29 17:23:21,508] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 9: [2023-04-29 17:23:21,509] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 9: [2023-04-29 17:23:21,509] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 9: [2023-04-29 17:23:21,509] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 9: [2023-04-29 17:23:21,509] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 9: [2023-04-29 17:23:21,509] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 12: [2023-04-29 17:23:21,510] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 19: [2023-04-29 17:23:21,510] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 19: [2023-04-29 17:23:21,510] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 19: [2023-04-29 17:23:21,511] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 11: [2023-04-29 17:23:21,514] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 19: [2023-04-29 17:23:21,515] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 19: [2023-04-29 17:23:21,515] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 19: [2023-04-29 17:23:21,516] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 26: [2023-04-29 17:23:21,517] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 26: [2023-04-29 17:23:21,517] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 19: [2023-04-29 17:23:21,517] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 19: [2023-04-29 17:23:21,517] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 4: [2023-04-29 17:23:21,517] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 21: [2023-04-29 17:23:21,518] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 21: [2023-04-29 17:23:21,518] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 21: [2023-04-29 17:23:21,518] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 21: [2023-04-29 17:23:21,518] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 21: [2023-04-29 17:23:21,518] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 13: [2023-04-29 17:23:21,518] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 13: [2023-04-29 17:23:21,518] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 13: [2023-04-29 17:23:21,519] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 13: [2023-04-29 17:23:21,519] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 13: [2023-04-29 17:23:21,519] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 13: [2023-04-29 17:23:21,519] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 13: [2023-04-29 17:23:21,519] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 13: [2023-04-29 17:23:21,519] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 1: [2023-04-29 17:23:21,519] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 1: [2023-04-29 17:23:21,519] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 1: [2023-04-29 17:23:21,519] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 1: [2023-04-29 17:23:21,519] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 12: [2023-04-29 17:23:21,520] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 12: [2023-04-29 17:23:21,520] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 26: [2023-04-29 17:23:21,520] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 12: [2023-04-29 17:23:21,520] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 12: [2023-04-29 17:23:21,520] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 25: [2023-04-29 17:23:21,524] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 25: [2023-04-29 17:23:21,524] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 26: [2023-04-29 17:23:21,524] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 1: [2023-04-29 17:23:21,524] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 1: [2023-04-29 17:23:21,524] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 1: [2023-04-29 17:23:21,524] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 1: [2023-04-29 17:23:21,524] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 13: [2023-04-29 17:23:21,524] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 23: [2023-04-29 17:23:21,525] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 13: [2023-04-29 17:23:21,525] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 23: [2023-04-29 17:23:21,526] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 25: [2023-04-29 17:23:21,525] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 25: [2023-04-29 17:23:21,525] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 25: [2023-04-29 17:23:21,526] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 25: [2023-04-29 17:23:21,526] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 25: [2023-04-29 17:23:21,526] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 25: [2023-04-29 17:23:21,526] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 4: [2023-04-29 17:23:21,526] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 23: [2023-04-29 17:23:21,527] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 21: [2023-04-29 17:23:21,527] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 11: [2023-04-29 17:23:21,527] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 21: [2023-04-29 17:23:21,527] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 26: [2023-04-29 17:23:21,528] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 21: [2023-04-29 17:23:21,528] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 26: [2023-04-29 17:23:21,528] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 25: [2023-04-29 17:23:21,528] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 25: [2023-04-29 17:23:21,528] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 11: [2023-04-29 17:23:21,529] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 13: [2023-04-29 17:23:21,529] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 13: [2023-04-29 17:23:21,529] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 26: [2023-04-29 17:23:21,529] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 13: [2023-04-29 17:23:21,529] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 26: [2023-04-29 17:23:21,530] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 13: [2023-04-29 17:23:21,530] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 13: [2023-04-29 17:23:21,531] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 13: [2023-04-29 17:23:21,531] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 11: [2023-04-29 17:23:21,533] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 23: [2023-04-29 17:23:21,534] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 23: [2023-04-29 17:23:21,535] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 25: [2023-04-29 17:23:21,535] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 24: [2023-04-29 17:23:21,536] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 25: [2023-04-29 17:23:21,536] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 25: [2023-04-29 17:23:21,536] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 24: [2023-04-29 17:23:21,537] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 24: [2023-04-29 17:23:21,537] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 24: [2023-04-29 17:23:21,537] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 24: [2023-04-29 17:23:21,537] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 24: [2023-04-29 17:23:21,537] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 4: [2023-04-29 17:23:21,537] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 25: [2023-04-29 17:23:21,537] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 23: [2023-04-29 17:23:21,537] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 25: [2023-04-29 17:23:21,537] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 25: [2023-04-29 17:23:21,538] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 11: [2023-04-29 17:23:21,541] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 11: [2023-04-29 17:23:21,541] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 7: [2023-04-29 17:23:21,541] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 7: [2023-04-29 17:23:21,541] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 7: [2023-04-29 17:23:21,541] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 1: [2023-04-29 17:23:21,542] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 1: [2023-04-29 17:23:21,544] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 1: [2023-04-29 17:23:21,545] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 1: [2023-04-29 17:23:21,545] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 21: [2023-04-29 17:23:21,545] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 21: [2023-04-29 17:23:21,545] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 21: [2023-04-29 17:23:21,545] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 11: [2023-04-29 17:23:21,545] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 11: [2023-04-29 17:23:21,545] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 11: [2023-04-29 17:23:21,545] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 4: [2023-04-29 17:23:21,547] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 21: [2023-04-29 17:23:21,548] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 21: [2023-04-29 17:23:21,548] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 11: [2023-04-29 17:23:21,550] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 11: [2023-04-29 17:23:21,551] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 1: [2023-04-29 17:23:21,552] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 22: [2023-04-29 17:23:21,552] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 22: [2023-04-29 17:23:21,552] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 1: [2023-04-29 17:23:21,552] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 10: [2023-04-29 17:23:21,552] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 10: [2023-04-29 17:23:21,552] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 10: [2023-04-29 17:23:21,552] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 10: [2023-04-29 17:23:21,552] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 1: [2023-04-29 17:23:21,553] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 10: [2023-04-29 17:23:21,553] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 10: [2023-04-29 17:23:21,553] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 10: [2023-04-29 17:23:21,553] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 10: [2023-04-29 17:23:21,553] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 1: [2023-04-29 17:23:21,553] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 27: [2023-04-29 17:23:21,553] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 27: [2023-04-29 17:23:21,553] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 14: [2023-04-29 17:23:21,553] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 14: [2023-04-29 17:23:21,553] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 14: [2023-04-29 17:23:21,553] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 14: [2023-04-29 17:23:21,554] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 14: [2023-04-29 17:23:21,554] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 14: [2023-04-29 17:23:21,554] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 14: [2023-04-29 17:23:21,554] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 14: [2023-04-29 17:23:21,554] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 22: [2023-04-29 17:23:21,554] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 4: [2023-04-29 17:23:21,554] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 4: [2023-04-29 17:23:21,554] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 22: [2023-04-29 17:23:21,554] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 22: [2023-04-29 17:23:21,554] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 22: [2023-04-29 17:23:21,554] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 22: [2023-04-29 17:23:21,554] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 22: [2023-04-29 17:23:21,555] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 29: [2023-04-29 17:23:21,555] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 29: [2023-04-29 17:23:21,556] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 29: [2023-04-29 17:23:21,556] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 29: [2023-04-29 17:23:21,556] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 29: [2023-04-29 17:23:21,556] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 29: [2023-04-29 17:23:21,556] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 29: [2023-04-29 17:23:21,556] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 22: [2023-04-29 17:23:21,556] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 29: [2023-04-29 17:23:21,556] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 22: [2023-04-29 17:23:21,557] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 7: [2023-04-29 17:23:21,557] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 7: [2023-04-29 17:23:21,557] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 7: [2023-04-29 17:23:21,557] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 7: [2023-04-29 17:23:21,557] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 7: [2023-04-29 17:23:21,557] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 4: [2023-04-29 17:23:21,556] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 4: [2023-04-29 17:23:21,556] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 4: [2023-04-29 17:23:21,556] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 4: [2023-04-29 17:23:21,556] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 14: [2023-04-29 17:23:21,558] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 10: [2023-04-29 17:23:21,558] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 10: [2023-04-29 17:23:21,558] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 10: [2023-04-29 17:23:21,558] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 10: [2023-04-29 17:23:21,558] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 10: [2023-04-29 17:23:21,558] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 31: [2023-04-29 17:23:21,559] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 31: [2023-04-29 17:23:21,559] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 31: [2023-04-29 17:23:21,559] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 31: [2023-04-29 17:23:21,560] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 31: [2023-04-29 17:23:21,560] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 31: [2023-04-29 17:23:21,560] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 31: [2023-04-29 17:23:21,560] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 9: [2023-04-29 17:23:21,559] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 31: [2023-04-29 17:23:21,560] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 29: [2023-04-29 17:23:21,559] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 10: [2023-04-29 17:23:21,560] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 10: [2023-04-29 17:23:21,560] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 27: [2023-04-29 17:23:21,560] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 9: [2023-04-29 17:23:21,561] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 7: [2023-04-29 17:23:21,562] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 10: [2023-04-29 17:23:21,562] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 7: [2023-04-29 17:23:21,563] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 7: [2023-04-29 17:23:21,563] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 31: [2023-04-29 17:23:21,563] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 31: [2023-04-29 17:23:21,564] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 31: [2023-04-29 17:23:21,564] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 2: [2023-04-29 17:23:21,564] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 2: [2023-04-29 17:23:21,564] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 19: [2023-04-29 17:23:21,564] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 19: [2023-04-29 17:23:21,564] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 19: [2023-04-29 17:23:21,564] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 31: [2023-04-29 17:23:21,565] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 14: [2023-04-29 17:23:21,565] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 22: [2023-04-29 17:23:21,564] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 22: [2023-04-29 17:23:21,565] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 22: [2023-04-29 17:23:21,565] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 14: [2023-04-29 17:23:21,565] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 14: [2023-04-29 17:23:21,566] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 22: [2023-04-29 17:23:21,566] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 31: [2023-04-29 17:23:21,566] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 14: [2023-04-29 17:23:21,566] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 31: [2023-04-29 17:23:21,566] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 14: [2023-04-29 17:23:21,566] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 31: [2023-04-29 17:23:21,566] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 31: [2023-04-29 17:23:21,566] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 22: [2023-04-29 17:23:21,567] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 2: [2023-04-29 17:23:21,566] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 2: [2023-04-29 17:23:21,567] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 2: [2023-04-29 17:23:21,567] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 2: [2023-04-29 17:23:21,567] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 2: [2023-04-29 17:23:21,567] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 14: [2023-04-29 17:23:21,567] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 22: [2023-04-29 17:23:21,567] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 2: [2023-04-29 17:23:21,567] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 11: [2023-04-29 17:23:21,567] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 9: [2023-04-29 17:23:21,567] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 9: [2023-04-29 17:23:21,567] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 9: [2023-04-29 17:23:21,567] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 14: [2023-04-29 17:23:21,568] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 29: [2023-04-29 17:23:21,568] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 29: [2023-04-29 17:23:21,568] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 29: [2023-04-29 17:23:21,568] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 29: [2023-04-29 17:23:21,569] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 29: [2023-04-29 17:23:21,569] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 2: [2023-04-29 17:23:21,569] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 2: [2023-04-29 17:23:21,569] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 11: [2023-04-29 17:23:21,570] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 29: [2023-04-29 17:23:21,570] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 29: [2023-04-29 17:23:21,570] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 2: [2023-04-29 17:23:21,570] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 9: [2023-04-29 17:23:21,573] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 9: [2023-04-29 17:23:21,573] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 9: [2023-04-29 17:23:21,573] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 27: [2023-04-29 17:23:21,573] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 27: [2023-04-29 17:23:21,573] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 27: [2023-04-29 17:23:21,573] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 27: [2023-04-29 17:23:21,573] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 27: [2023-04-29 17:23:21,573] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 11: [2023-04-29 17:23:21,574] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 11: [2023-04-29 17:23:21,574] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 11: [2023-04-29 17:23:21,574] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 20: [2023-04-29 17:23:21,576] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 20: [2023-04-29 17:23:21,576] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 2: [2023-04-29 17:23:21,576] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 2: [2023-04-29 17:23:21,576] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 13: [2023-04-29 17:23:21,576] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 27: [2023-04-29 17:23:21,576] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 20: [2023-04-29 17:23:21,576] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 20: [2023-04-29 17:23:21,576] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 20: [2023-04-29 17:23:21,576] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 20: [2023-04-29 17:23:21,577] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 20: [2023-04-29 17:23:21,577] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 20: [2023-04-29 17:23:21,577] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 2: [2023-04-29 17:23:21,577] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 27: [2023-04-29 17:23:21,578] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 2: [2023-04-29 17:23:21,578] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 2: [2023-04-29 17:23:21,578] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 13: [2023-04-29 17:23:21,578] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 25: [2023-04-29 17:23:21,578] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 25: [2023-04-29 17:23:21,578] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 24: [2023-04-29 17:23:21,537] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 24: [2023-04-29 17:23:21,537] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 24: [2023-04-29 17:23:21,540] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 24: [2023-04-29 17:23:21,549] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 24: [2023-04-29 17:23:21,550] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 24: [2023-04-29 17:23:21,550] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 24: [2023-04-29 17:23:21,550] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 24: [2023-04-29 17:23:21,551] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 24: [2023-04-29 17:23:21,552] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 24: [2023-04-29 17:23:21,552] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 19: [2023-04-29 17:23:21,579] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 19: [2023-04-29 17:23:21,582] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 19: [2023-04-29 17:23:21,582] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 19: [2023-04-29 17:23:21,582] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 19: [2023-04-29 17:23:21,582] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 20: [2023-04-29 17:23:21,582] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 20: [2023-04-29 17:23:21,583] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 27: [2023-04-29 17:23:21,583] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 20: [2023-04-29 17:23:21,584] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 20: [2023-04-29 17:23:21,584] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 18: [2023-04-29 17:23:21,584] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 18: [2023-04-29 17:23:21,584] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 18: [2023-04-29 17:23:21,584] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 20: [2023-04-29 17:23:21,584] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 18: [2023-04-29 17:23:21,584] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 18: [2023-04-29 17:23:21,584] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 18: [2023-04-29 17:23:21,584] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 18: [2023-04-29 17:23:21,584] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 7: [2023-04-29 17:23:21,584] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 19: [2023-04-29 17:23:21,584] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 18: [2023-04-29 17:23:21,584] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 0: [2023-04-29 17:23:21,584] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 0: [2023-04-29 17:23:21,584] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 0: [2023-04-29 17:23:21,584] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 20: [2023-04-29 17:23:21,585] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 0: [2023-04-29 17:23:21,585] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 0: [2023-04-29 17:23:21,585] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 0: [2023-04-29 17:23:21,585] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 0: [2023-04-29 17:23:21,585] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 0: [2023-04-29 17:23:21,585] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 5: [2023-04-29 17:23:21,585] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 5: [2023-04-29 17:23:21,585] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 4: [2023-04-29 17:23:21,585] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 9: [2023-04-29 17:23:21,585] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 20: [2023-04-29 17:23:21,586] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 20: [2023-04-29 17:23:21,586] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 3: [2023-04-29 17:23:21,586] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 3: [2023-04-29 17:23:21,586] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 7: [2023-04-29 17:23:21,586] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 3: [2023-04-29 17:23:21,586] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 3: [2023-04-29 17:23:21,586] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 3: [2023-04-29 17:23:21,586] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 3: [2023-04-29 17:23:21,586] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 3: [2023-04-29 17:23:21,587] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 30: [2023-04-29 17:23:21,586] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 3: [2023-04-29 17:23:21,587] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 17: [2023-04-29 17:23:21,587] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 4: [2023-04-29 17:23:21,587] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 7: [2023-04-29 17:23:21,587] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 17: [2023-04-29 17:23:21,587] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 19: [2023-04-29 17:23:21,587] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 30: [2023-04-29 17:23:21,587] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 30: [2023-04-29 17:23:21,587] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 30: [2023-04-29 17:23:21,587] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 30: [2023-04-29 17:23:21,587] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 30: [2023-04-29 17:23:21,587] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 30: [2023-04-29 17:23:21,587] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 30: [2023-04-29 17:23:21,587] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 19: [2023-04-29 17:23:21,588] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 17: [2023-04-29 17:23:21,588] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 17: [2023-04-29 17:23:21,588] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 17: [2023-04-29 17:23:21,588] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 17: [2023-04-29 17:23:21,588] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 17: [2023-04-29 17:23:21,588] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 17: [2023-04-29 17:23:21,588] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 7: [2023-04-29 17:23:21,589] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 7: [2023-04-29 17:23:21,589] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 5: [2023-04-29 17:23:21,589] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 5: [2023-04-29 17:23:21,589] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 5: [2023-04-29 17:23:21,589] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 5: [2023-04-29 17:23:21,589] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 5: [2023-04-29 17:23:21,589] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 4: [2023-04-29 17:23:21,589] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 5: [2023-04-29 17:23:21,589] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 5: [2023-04-29 17:23:21,590] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 5: [2023-04-29 17:23:21,590] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 3: [2023-04-29 17:23:21,590] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 3: [2023-04-29 17:23:21,590] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 9: [2023-04-29 17:23:21,590] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 4: [2023-04-29 17:23:21,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 17: [2023-04-29 17:23:21,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 4: [2023-04-29 17:23:21,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 3: [2023-04-29 17:23:21,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 3: [2023-04-29 17:23:21,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 3: [2023-04-29 17:23:21,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 18: [2023-04-29 17:23:21,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 17: [2023-04-29 17:23:21,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 3: [2023-04-29 17:23:21,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 4: [2023-04-29 17:23:21,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 3: [2023-04-29 17:23:21,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 3: [2023-04-29 17:23:21,595] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 9: [2023-04-29 17:23:21,595] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 9: [2023-04-29 17:23:21,596] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 13: [2023-04-29 17:23:21,597] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 18: [2023-04-29 17:23:21,597] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 18: [2023-04-29 17:23:21,598] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 0: [2023-04-29 17:23:21,598] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 30: [2023-04-29 17:23:21,597] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 30: [2023-04-29 17:23:21,598] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 0: [2023-04-29 17:23:21,598] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 25: [2023-04-29 17:23:21,598] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 18: [2023-04-29 17:23:21,598] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 30: [2023-04-29 17:23:21,598] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 18: [2023-04-29 17:23:21,598] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 13: [2023-04-29 17:23:21,599] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 13: [2023-04-29 17:23:21,599] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 13: [2023-04-29 17:23:21,599] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 5: [2023-04-29 17:23:21,599] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 18: [2023-04-29 17:23:21,599] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 5: [2023-04-29 17:23:21,599] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 30: [2023-04-29 17:23:21,599] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 17: [2023-04-29 17:23:21,598] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 17: [2023-04-29 17:23:21,599] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 30: [2023-04-29 17:23:21,599] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 0: [2023-04-29 17:23:21,599] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 17: [2023-04-29 17:23:21,599] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 5: [2023-04-29 17:23:21,599] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 9: [2023-04-29 17:23:21,599] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 13: [2023-04-29 17:23:21,599] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 13: [2023-04-29 17:23:21,599] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 30: [2023-04-29 17:23:21,599] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 13: [2023-04-29 17:23:21,599] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 25: [2023-04-29 17:23:21,599] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 5: [2023-04-29 17:23:21,599] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 30: [2023-04-29 17:23:21,599] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 30: [2023-04-29 17:23:21,599] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 0: [2023-04-29 17:23:21,599] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 18: [2023-04-29 17:23:21,600] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 17: [2023-04-29 17:23:21,600] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 18: [2023-04-29 17:23:21,600] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 0: [2023-04-29 17:23:21,600] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 17: [2023-04-29 17:23:21,600] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 17: [2023-04-29 17:23:21,600] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 5: [2023-04-29 17:23:21,600] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 0: [2023-04-29 17:23:21,600] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 5: [2023-04-29 17:23:21,601] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 0: [2023-04-29 17:23:21,601] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 9: [2023-04-29 17:23:21,601] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 9: [2023-04-29 17:23:21,601] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 9: [2023-04-29 17:23:21,601] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 0: [2023-04-29 17:23:21,603] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 13: [2023-04-29 17:23:21,603] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 25: [2023-04-29 17:23:21,602] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 25: [2023-04-29 17:23:21,602] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 27: [2023-04-29 17:23:21,605] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 10: [2023-04-29 17:23:21,605] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 19: [2023-04-29 17:23:21,606] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 25: [2023-04-29 17:23:21,606] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 25: [2023-04-29 17:23:21,606] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 25: [2023-04-29 17:23:21,606] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 25: [2023-04-29 17:23:21,606] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 6: [2023-04-29 17:23:21,607] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 6: [2023-04-29 17:23:21,607] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 6: [2023-04-29 17:23:21,607] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 6: [2023-04-29 17:23:21,608] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 6: [2023-04-29 17:23:21,608] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 6: [2023-04-29 17:23:21,608] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 6: [2023-04-29 17:23:21,608] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 29: [2023-04-29 17:23:21,608] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 6: [2023-04-29 17:23:21,608] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 22: [2023-04-29 17:23:21,609] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 22: [2023-04-29 17:23:21,609] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 19: [2023-04-29 17:23:21,609] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 19: [2023-04-29 17:23:21,610] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 19: [2023-04-29 17:23:21,610] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 14: [2023-04-29 17:23:21,609] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 27: [2023-04-29 17:23:21,611] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 27: [2023-04-29 17:23:21,611] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 27: [2023-04-29 17:23:21,611] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 27: [2023-04-29 17:23:21,611] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 6: [2023-04-29 17:23:21,612] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 6: [2023-04-29 17:23:21,612] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 19: [2023-04-29 17:23:21,613] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 6: [2023-04-29 17:23:21,617] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 31: [2023-04-29 17:23:21,617] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 31: [2023-04-29 17:23:21,617] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 31: [2023-04-29 17:23:21,617] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 6: [2023-04-29 17:23:21,618] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 10: [2023-04-29 17:23:21,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 10: [2023-04-29 17:23:21,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 10: [2023-04-29 17:23:21,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 10: [2023-04-29 17:23:21,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 6: [2023-04-29 17:23:21,618] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 6: [2023-04-29 17:23:21,618] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 6: [2023-04-29 17:23:21,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 6: [2023-04-29 17:23:21,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 10: [2023-04-29 17:23:21,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 24: [2023-04-29 17:23:21,591] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 24: [2023-04-29 17:23:21,613] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 2: [2023-04-29 17:23:21,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 2: [2023-04-29 17:23:21,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 2: [2023-04-29 17:23:21,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 10: [2023-04-29 17:23:21,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 10: [2023-04-29 17:23:21,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 10: [2023-04-29 17:23:21,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 24: [2023-04-29 17:23:21,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 24: [2023-04-29 17:23:21,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 24: [2023-04-29 17:23:21,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 29: [2023-04-29 17:23:21,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 24: [2023-04-29 17:23:21,628] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 24: [2023-04-29 17:23:21,628] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 24: [2023-04-29 17:23:21,628] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 24: [2023-04-29 17:23:21,628] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 14: [2023-04-29 17:23:21,629] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 25: [2023-04-29 17:23:21,630] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 22: [2023-04-29 17:23:21,631] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 22: [2023-04-29 17:23:21,631] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 22: [2023-04-29 17:23:21,631] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 22: [2023-04-29 17:23:21,631] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 22: [2023-04-29 17:23:21,631] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 13: [2023-04-29 17:23:21,631] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 31: [2023-04-29 17:23:21,632] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 31: [2023-04-29 17:23:21,632] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 31: [2023-04-29 17:23:21,632] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 31: [2023-04-29 17:23:21,632] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 31: [2023-04-29 17:23:21,632] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 13: [2023-04-29 17:23:21,632] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 13: [2023-04-29 17:23:21,634] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 16: [2023-04-29 17:23:21,634] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 16: [2023-04-29 17:23:21,634] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 16: [2023-04-29 17:23:21,634] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 13: [2023-04-29 17:23:21,634] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 16: [2023-04-29 17:23:21,634] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 16: [2023-04-29 17:23:21,634] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 16: [2023-04-29 17:23:21,634] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 16: [2023-04-29 17:23:21,634] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 13: [2023-04-29 17:23:21,634] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 16: [2023-04-29 17:23:21,634] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 13: [2023-04-29 17:23:21,635] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 20: [2023-04-29 17:23:21,635] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 20: [2023-04-29 17:23:21,635] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 22: [2023-04-29 17:23:21,638] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 22: [2023-04-29 17:23:21,638] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 31: [2023-04-29 17:23:21,638] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 16: [2023-04-29 17:23:21,638] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 22: [2023-04-29 17:23:21,638] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 31: [2023-04-29 17:23:21,639] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 14: [2023-04-29 17:23:21,638] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 14: [2023-04-29 17:23:21,638] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 20: [2023-04-29 17:23:21,639] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 31: [2023-04-29 17:23:21,639] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 16: [2023-04-29 17:23:21,640] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 5: [2023-04-29 17:23:21,640] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 5: [2023-04-29 17:23:21,640] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 25: [2023-04-29 17:23:21,640] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 3: [2023-04-29 17:23:21,640] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 3: [2023-04-29 17:23:21,640] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 16: [2023-04-29 17:23:21,641] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 25: [2023-04-29 17:23:21,641] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 25: [2023-04-29 17:23:21,641] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 2: [2023-04-29 17:23:21,640] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 2: [2023-04-29 17:23:21,640] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 2: [2023-04-29 17:23:21,640] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 16: [2023-04-29 17:23:21,641] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 16: [2023-04-29 17:23:21,641] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 16: [2023-04-29 17:23:21,641] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 2: [2023-04-29 17:23:21,641] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 2: [2023-04-29 17:23:21,641] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 16: [2023-04-29 17:23:21,641] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 16: [2023-04-29 17:23:21,642] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 29: [2023-04-29 17:23:21,642] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 29: [2023-04-29 17:23:21,642] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 10: [2023-04-29 17:23:21,643] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 10: [2023-04-29 17:23:21,643] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 25: [2023-04-29 17:23:21,644] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 10: [2023-04-29 17:23:21,644] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 25: [2023-04-29 17:23:21,646] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 17: [2023-04-29 17:23:21,646] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 17: [2023-04-29 17:23:21,646] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 2: [2023-04-29 17:23:21,646] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 2: [2023-04-29 17:23:21,646] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 29: [2023-04-29 17:23:21,647] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 29: [2023-04-29 17:23:21,647] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 29: [2023-04-29 17:23:21,647] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 29: [2023-04-29 17:23:21,647] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 29: [2023-04-29 17:23:21,647] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 14: [2023-04-29 17:23:21,647] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 14: [2023-04-29 17:23:21,647] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 14: [2023-04-29 17:23:21,647] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 14: [2023-04-29 17:23:21,647] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 14: [2023-04-29 17:23:21,647] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 20: [2023-04-29 17:23:21,648] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 20: [2023-04-29 17:23:21,648] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 20: [2023-04-29 17:23:21,648] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 2: [2023-04-29 17:23:21,648] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 15: [2023-04-29 17:23:21,649] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 15: [2023-04-29 17:23:21,649] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 15: [2023-04-29 17:23:21,649] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 15: [2023-04-29 17:23:21,649] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 15: [2023-04-29 17:23:21,649] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 20: [2023-04-29 17:23:21,650] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 20: [2023-04-29 17:23:21,650] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 15: [2023-04-29 17:23:21,649] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 15: [2023-04-29 17:23:21,649] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 15: [2023-04-29 17:23:21,650] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 10: [2023-04-29 17:23:21,646] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 10: [2023-04-29 17:23:21,649] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 10: [2023-04-29 17:23:21,649] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 10: [2023-04-29 17:23:21,652] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 20: [2023-04-29 17:23:21,658] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 28: [2023-04-29 17:23:21,659] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 28: [2023-04-29 17:23:21,659] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 28: [2023-04-29 17:23:21,659] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 28: [2023-04-29 17:23:21,659] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 28: [2023-04-29 17:23:21,659] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 28: [2023-04-29 17:23:21,659] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 28: [2023-04-29 17:23:21,659] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 20: [2023-04-29 17:23:21,660] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 15: [2023-04-29 17:23:21,660] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 24: [2023-04-29 17:23:21,660] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 28: [2023-04-29 17:23:21,660] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 5: [2023-04-29 17:23:21,660] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 31: [2023-04-29 17:23:21,660] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 5: [2023-04-29 17:23:21,660] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 3: [2023-04-29 17:23:21,660] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 3: [2023-04-29 17:23:21,662] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 15: [2023-04-29 17:23:21,662] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 15: [2023-04-29 17:23:21,662] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 15: [2023-04-29 17:23:21,662] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 22: [2023-04-29 17:23:21,662] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 24: [2023-04-29 17:23:21,663] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 22: [2023-04-29 17:23:21,663] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 31: [2023-04-29 17:23:21,663] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 31: [2023-04-29 17:23:21,663] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 31: [2023-04-29 17:23:21,663] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 22: [2023-04-29 17:23:21,663] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 14: [2023-04-29 17:23:21,663] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 15: [2023-04-29 17:23:21,664] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 15: [2023-04-29 17:23:21,664] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 15: [2023-04-29 17:23:21,664] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 14: [2023-04-29 17:23:21,664] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 15: [2023-04-29 17:23:21,664] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 6: [2023-04-29 17:23:21,664] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 6: [2023-04-29 17:23:21,664] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 24: [2023-04-29 17:23:21,665] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 24: [2023-04-29 17:23:21,665] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 3: [2023-04-29 17:23:21,665] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 3: [2023-04-29 17:23:21,665] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 3: [2023-04-29 17:23:21,665] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 3: [2023-04-29 17:23:21,665] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 3: [2023-04-29 17:23:21,665] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 3: [2023-04-29 17:23:21,665] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 20: [2023-04-29 17:23:21,666] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 24: [2023-04-29 17:23:21,667] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 17: [2023-04-29 17:23:21,667] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 17: [2023-04-29 17:23:21,668] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 17: [2023-04-29 17:23:21,668] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 2: [2023-04-29 17:23:21,668] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 5: [2023-04-29 17:23:21,669] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 5: [2023-04-29 17:23:21,669] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 17: [2023-04-29 17:23:21,670] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 2: [2023-04-29 17:23:21,670] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 5: [2023-04-29 17:23:21,670] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 5: [2023-04-29 17:23:21,670] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 5: [2023-04-29 17:23:21,670] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 5: [2023-04-29 17:23:21,670] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 22: [2023-04-29 17:23:21,670] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 22: [2023-04-29 17:23:21,670] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 30: [2023-04-29 17:23:21,670] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 2: [2023-04-29 17:23:21,670] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 24: [2023-04-29 17:23:21,670] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 24: [2023-04-29 17:23:21,670] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 22: [2023-04-29 17:23:21,671] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 29: [2023-04-29 17:23:21,671] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 2: [2023-04-29 17:23:21,671] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 2: [2023-04-29 17:23:21,672] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 17: [2023-04-29 17:23:21,673] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 17: [2023-04-29 17:23:21,673] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 17: [2023-04-29 17:23:21,673] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 17: [2023-04-29 17:23:21,673] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 18: [2023-04-29 17:23:21,673] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 18: [2023-04-29 17:23:21,673] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 18: [2023-04-29 17:23:21,673] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 28: [2023-04-29 17:23:21,674] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 28: [2023-04-29 17:23:21,674] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 28: [2023-04-29 17:23:21,674] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 20: [2023-04-29 17:23:21,675] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 28: [2023-04-29 17:23:21,675] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 28: [2023-04-29 17:23:21,676] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 0: [2023-04-29 17:23:21,676] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 28: [2023-04-29 17:23:21,677] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 20: [2023-04-29 17:23:21,677] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 29: [2023-04-29 17:23:21,677] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 28: [2023-04-29 17:23:21,677] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 20: [2023-04-29 17:23:21,677] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 28: [2023-04-29 17:23:21,677] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt... 20: [2023-04-29 17:23:21,677] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 0: [2023-04-29 17:23:21,679] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 0: [2023-04-29 17:23:21,679] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 20: [2023-04-29 17:23:21,680] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 0: [2023-04-29 17:23:21,680] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 14: [2023-04-29 17:23:21,680] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 30: [2023-04-29 17:23:21,680] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 14: [2023-04-29 17:23:21,681] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 29: [2023-04-29 17:23:21,683] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 29: [2023-04-29 17:23:21,683] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 14: [2023-04-29 17:23:21,684] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 6: [2023-04-29 17:23:21,684] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 6: [2023-04-29 17:23:21,685] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 29: [2023-04-29 17:23:21,685] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 29: [2023-04-29 17:23:21,685] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 14: [2023-04-29 17:23:21,685] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 14: [2023-04-29 17:23:21,685] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 6: [2023-04-29 17:23:21,686] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 29: [2023-04-29 17:23:21,686] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 16: [2023-04-29 17:23:21,686] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 18: [2023-04-29 17:23:21,688] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 18: [2023-04-29 17:23:21,688] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 18: [2023-04-29 17:23:21,688] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 18: [2023-04-29 17:23:21,688] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 18: [2023-04-29 17:23:21,688] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 6: [2023-04-29 17:23:21,693] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 6: [2023-04-29 17:23:21,693] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 6: [2023-04-29 17:23:21,693] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 6: [2023-04-29 17:23:21,693] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 6: [2023-04-29 17:23:21,693] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 16: [2023-04-29 17:23:21,693] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 3: [2023-04-29 17:23:21,693] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 30: [2023-04-29 17:23:21,693] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 30: [2023-04-29 17:23:21,693] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 30: [2023-04-29 17:23:21,693] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 30: [2023-04-29 17:23:21,693] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 30: [2023-04-29 17:23:21,693] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 30: [2023-04-29 17:23:21,693] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 30: [2023-04-29 17:23:21,694] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 17: [2023-04-29 17:23:21,694] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 3: [2023-04-29 17:23:21,694] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 3: [2023-04-29 17:23:21,695] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 3: [2023-04-29 17:23:21,696] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 3: [2023-04-29 17:23:21,696] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 17: [2023-04-29 17:23:21,696] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 3: [2023-04-29 17:23:21,697] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 5: [2023-04-29 17:23:21,698] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 18: [2023-04-29 17:23:21,699] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 0: [2023-04-29 17:23:21,700] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 0: [2023-04-29 17:23:21,700] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 0: [2023-04-29 17:23:21,700] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 0: [2023-04-29 17:23:21,700] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 18: [2023-04-29 17:23:21,702] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 5: [2023-04-29 17:23:21,703] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 5: [2023-04-29 17:23:21,703] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 16: [2023-04-29 17:23:21,704] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 5: [2023-04-29 17:23:21,705] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 17: [2023-04-29 17:23:21,706] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 23: [2023-04-29 17:23:21,705] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 23: [2023-04-29 17:23:21,705] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 23: [2023-04-29 17:23:21,706] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 23: [2023-04-29 17:23:21,706] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 23: [2023-04-29 17:23:21,706] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 23: [2023-04-29 17:23:21,706] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 23: [2023-04-29 17:23:21,706] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 23: [2023-04-29 17:23:21,706] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 5: [2023-04-29 17:23:21,706] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 5: [2023-04-29 17:23:21,706] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 31: [2023-04-29 17:23:21,666] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 30: [2023-04-29 17:23:21,707] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 17: [2023-04-29 17:23:21,707] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 17: [2023-04-29 17:23:21,708] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 17: [2023-04-29 17:23:21,708] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 16: [2023-04-29 17:23:21,709] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 16: [2023-04-29 17:23:21,709] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 16: [2023-04-29 17:23:21,709] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 16: [2023-04-29 17:23:21,709] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 16: [2023-04-29 17:23:21,709] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 18: [2023-04-29 17:23:21,709] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 0: [2023-04-29 17:23:21,710] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 0: [2023-04-29 17:23:21,710] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 23: [2023-04-29 17:23:21,711] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 6: [2023-04-29 17:23:21,711] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 23: [2023-04-29 17:23:21,712] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 0: [2023-04-29 17:23:21,712] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 16: [2023-04-29 17:23:21,712] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 0: [2023-04-29 17:23:21,712] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 11: [2023-04-29 17:23:21,713] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 11: [2023-04-29 17:23:21,713] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 11: [2023-04-29 17:23:21,713] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 11: [2023-04-29 17:23:21,715] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 11: [2023-04-29 17:23:21,715] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 11: [2023-04-29 17:23:21,715] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 11: [2023-04-29 17:23:21,715] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 11: [2023-04-29 17:23:21,715] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 23: [2023-04-29 17:23:21,716] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 23: [2023-04-29 17:23:21,716] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 23: [2023-04-29 17:23:21,716] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 23: [2023-04-29 17:23:21,717] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 23: [2023-04-29 17:23:21,717] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 16: [2023-04-29 17:23:21,717] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 11: [2023-04-29 17:23:21,718] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 23: [2023-04-29 17:23:21,718] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 11: [2023-04-29 17:23:21,718] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 11: [2023-04-29 17:23:21,718] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 26: [2023-04-29 17:23:21,721] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 26: [2023-04-29 17:23:21,721] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 26: [2023-04-29 17:23:21,721] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 26: [2023-04-29 17:23:21,721] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 26: [2023-04-29 17:23:21,721] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 26: [2023-04-29 17:23:21,721] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 26: [2023-04-29 17:23:21,721] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 26: [2023-04-29 17:23:21,721] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 6: [2023-04-29 17:23:21,722] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 18: [2023-04-29 17:23:21,722] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 18: [2023-04-29 17:23:21,722] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 18: [2023-04-29 17:23:21,723] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 6: [2023-04-29 17:23:21,724] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 6: [2023-04-29 17:23:21,724] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 11: [2023-04-29 17:23:21,724] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 11: [2023-04-29 17:23:21,725] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 6: [2023-04-29 17:23:21,725] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 11: [2023-04-29 17:23:21,725] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 11: [2023-04-29 17:23:21,726] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 18: [2023-04-29 17:23:21,726] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 18: [2023-04-29 17:23:21,726] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 11: [2023-04-29 17:23:21,726] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 6: [2023-04-29 17:23:21,727] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 26: [2023-04-29 17:23:21,728] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 26: [2023-04-29 17:23:21,729] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 26: [2023-04-29 17:23:21,729] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 26: [2023-04-29 17:23:21,729] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 15: [2023-04-29 17:23:21,729] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 26: [2023-04-29 17:23:21,729] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 26: [2023-04-29 17:23:21,730] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 26: [2023-04-29 17:23:21,730] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 30: [2023-04-29 17:23:21,730] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 26: [2023-04-29 17:23:21,730] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 0: [2023-04-29 17:23:21,731] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 30: [2023-04-29 17:23:21,731] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 30: [2023-04-29 17:23:21,731] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 0: [2023-04-29 17:23:21,732] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 30: [2023-04-29 17:23:21,733] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 30: [2023-04-29 17:23:21,733] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 30: [2023-04-29 17:23:21,733] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 0: [2023-04-29 17:23:21,734] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 0: [2023-04-29 17:23:21,734] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 16: [2023-04-29 17:23:21,735] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 16: [2023-04-29 17:23:21,737] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 1: [2023-04-29 17:23:21,737] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 1: [2023-04-29 17:23:21,737] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 16: [2023-04-29 17:23:21,737] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 1: [2023-04-29 17:23:21,737] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 16: [2023-04-29 17:23:21,737] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 1: [2023-04-29 17:23:21,737] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 1: [2023-04-29 17:23:21,737] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 1: [2023-04-29 17:23:21,737] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 1: [2023-04-29 17:23:21,737] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 1: [2023-04-29 17:23:21,738] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 8: [2023-04-29 17:23:21,741] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 8: [2023-04-29 17:23:21,741] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 8: [2023-04-29 17:23:21,741] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 8: [2023-04-29 17:23:21,741] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 8: [2023-04-29 17:23:21,741] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 8: [2023-04-29 17:23:21,741] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 8: [2023-04-29 17:23:21,741] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 8: [2023-04-29 17:23:21,741] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 16: [2023-04-29 17:23:21,742] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 16: [2023-04-29 17:23:21,742] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 1: [2023-04-29 17:23:21,743] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 1: [2023-04-29 17:23:21,743] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 1: [2023-04-29 17:23:21,743] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 1: [2023-04-29 17:23:21,743] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 1: [2023-04-29 17:23:21,744] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 1: [2023-04-29 17:23:21,744] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 1: [2023-04-29 17:23:21,745] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 15: [2023-04-29 17:23:21,745] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 15: [2023-04-29 17:23:21,745] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 15: [2023-04-29 17:23:21,745] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 1: [2023-04-29 17:23:21,746] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 8: [2023-04-29 17:23:21,748] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 8: [2023-04-29 17:23:21,749] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 8: [2023-04-29 17:23:21,750] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 8: [2023-04-29 17:23:21,750] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 8: [2023-04-29 17:23:21,750] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 15: [2023-04-29 17:23:21,750] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 15: [2023-04-29 17:23:21,751] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 15: [2023-04-29 17:23:21,751] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 15: [2023-04-29 17:23:21,751] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 15: [2023-04-29 17:23:21,751] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 28: [2023-04-29 17:23:21,751] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 28: [2023-04-29 17:23:21,751] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 28: [2023-04-29 17:23:21,751] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 8: [2023-04-29 17:23:21,751] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 8: [2023-04-29 17:23:21,751] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 8: [2023-04-29 17:23:21,751] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 27: [2023-04-29 17:23:21,760] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 27: [2023-04-29 17:23:21,760] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 27: [2023-04-29 17:23:21,760] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 27: [2023-04-29 17:23:21,760] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 27: [2023-04-29 17:23:21,760] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 27: [2023-04-29 17:23:21,760] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 27: [2023-04-29 17:23:21,760] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 27: [2023-04-29 17:23:21,761] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 23: [2023-04-29 17:23:21,764] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 27: [2023-04-29 17:23:21,764] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 28: [2023-04-29 17:23:21,765] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 28: [2023-04-29 17:23:21,765] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 28: [2023-04-29 17:23:21,765] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 28: [2023-04-29 17:23:21,765] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 28: [2023-04-29 17:23:21,765] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_11-model_00-model_states.pt. 23: [2023-04-29 17:23:21,767] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 11: [2023-04-29 17:23:21,770] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 11: [2023-04-29 17:23:21,770] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 11: [2023-04-29 17:23:21,770] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 27: [2023-04-29 17:23:21,772] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 27: [2023-04-29 17:23:21,772] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 4: [2023-04-29 17:23:21,773] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 4: [2023-04-29 17:23:21,773] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 4: [2023-04-29 17:23:21,773] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 4: [2023-04-29 17:23:21,773] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 4: [2023-04-29 17:23:21,773] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 4: [2023-04-29 17:23:21,773] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 4: [2023-04-29 17:23:21,773] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 27: [2023-04-29 17:23:21,774] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 4: [2023-04-29 17:23:21,774] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 27: [2023-04-29 17:23:21,774] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 27: [2023-04-29 17:23:21,774] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 27: [2023-04-29 17:23:21,774] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 27: [2023-04-29 17:23:21,775] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 15: [2023-04-29 17:23:21,775] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 15: [2023-04-29 17:23:21,775] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 4: [2023-04-29 17:23:21,777] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 4: [2023-04-29 17:23:21,778] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 28: [2023-04-29 17:23:21,779] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 15: [2023-04-29 17:23:21,780] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 28: [2023-04-29 17:23:21,780] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 28: [2023-04-29 17:23:21,780] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 26: [2023-04-29 17:23:21,782] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 26: [2023-04-29 17:23:21,782] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 15: [2023-04-29 17:23:21,782] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 15: [2023-04-29 17:23:21,784] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 4: [2023-04-29 17:23:21,784] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 4: [2023-04-29 17:23:21,785] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 4: [2023-04-29 17:23:21,785] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 15: [2023-04-29 17:23:21,785] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 4: [2023-04-29 17:23:21,786] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 4: [2023-04-29 17:23:21,786] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 11: [2023-04-29 17:23:21,786] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 11: [2023-04-29 17:23:21,786] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 23: [2023-04-29 17:23:21,786] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 4: [2023-04-29 17:23:21,787] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 23: [2023-04-29 17:23:21,787] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 23: [2023-04-29 17:23:21,787] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 23: [2023-04-29 17:23:21,787] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 26: [2023-04-29 17:23:21,787] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 15: [2023-04-29 17:23:21,788] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 23: [2023-04-29 17:23:21,790] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 26: [2023-04-29 17:23:21,791] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 23: [2023-04-29 17:23:21,790] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 23: [2023-04-29 17:23:21,790] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 23: [2023-04-29 17:23:21,790] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 11: [2023-04-29 17:23:21,791] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 11: [2023-04-29 17:23:21,791] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 11: [2023-04-29 17:23:21,791] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 11: [2023-04-29 17:23:21,792] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 11: [2023-04-29 17:23:21,793] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 11: [2023-04-29 17:23:21,793] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 7: [2023-04-29 17:23:21,793] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 7: [2023-04-29 17:23:21,793] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 7: [2023-04-29 17:23:21,793] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 7: [2023-04-29 17:23:21,793] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 7: [2023-04-29 17:23:21,793] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 26: [2023-04-29 17:23:21,795] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 26: [2023-04-29 17:23:21,795] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 26: [2023-04-29 17:23:21,795] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 26: [2023-04-29 17:23:21,795] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 28: [2023-04-29 17:23:21,800] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 1: [2023-04-29 17:23:21,801] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 1: [2023-04-29 17:23:21,801] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 1: [2023-04-29 17:23:21,801] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 1: [2023-04-29 17:23:21,801] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 8: [2023-04-29 17:23:21,803] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 8: [2023-04-29 17:23:21,803] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 28: [2023-04-29 17:23:21,803] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 28: [2023-04-29 17:23:21,803] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 28: [2023-04-29 17:23:21,803] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 8: [2023-04-29 17:23:21,806] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 1: [2023-04-29 17:23:21,806] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 28: [2023-04-29 17:23:21,806] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 1: [2023-04-29 17:23:21,806] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 1: [2023-04-29 17:23:21,806] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 1: [2023-04-29 17:23:21,806] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 25: [2023-04-29 17:23:21,806] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 25: [2023-04-29 17:23:21,806] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 10: [2023-04-29 17:23:21,807] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 10: [2023-04-29 17:23:21,807] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 9: [2023-04-29 17:23:21,806] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 9: [2023-04-29 17:23:21,806] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 9: [2023-04-29 17:23:21,806] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 9: [2023-04-29 17:23:21,806] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 9: [2023-04-29 17:23:21,806] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 9: [2023-04-29 17:23:21,806] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 9: [2023-04-29 17:23:21,806] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 10: [2023-04-29 17:23:21,807] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 10: [2023-04-29 17:23:21,807] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 10: [2023-04-29 17:23:21,807] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 10: [2023-04-29 17:23:21,807] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 10: [2023-04-29 17:23:21,807] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 9: [2023-04-29 17:23:21,807] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 26: [2023-04-29 17:23:21,807] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 26: [2023-04-29 17:23:21,807] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 11: [2023-04-29 17:23:21,809] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 19: [2023-04-29 17:23:21,809] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 19: [2023-04-29 17:23:21,809] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 8: [2023-04-29 17:23:21,810] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 8: [2023-04-29 17:23:21,810] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 25: [2023-04-29 17:23:21,810] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 25: [2023-04-29 17:23:21,810] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 25: [2023-04-29 17:23:21,810] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 25: [2023-04-29 17:23:21,810] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 25: [2023-04-29 17:23:21,810] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 25: [2023-04-29 17:23:21,811] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 19: [2023-04-29 17:23:21,811] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 19: [2023-04-29 17:23:21,811] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 19: [2023-04-29 17:23:21,811] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 19: [2023-04-29 17:23:21,811] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 19: [2023-04-29 17:23:21,811] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 25: [2023-04-29 17:23:21,811] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 9: [2023-04-29 17:23:21,811] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 25: [2023-04-29 17:23:21,811] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 19: [2023-04-29 17:23:21,811] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 9: [2023-04-29 17:23:21,812] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 11: [2023-04-29 17:23:21,812] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 9: [2023-04-29 17:23:21,812] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 9: [2023-04-29 17:23:21,812] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 9: [2023-04-29 17:23:21,813] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 9: [2023-04-29 17:23:21,813] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 9: [2023-04-29 17:23:21,813] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 9: [2023-04-29 17:23:21,813] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 8: [2023-04-29 17:23:21,813] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 8: [2023-04-29 17:23:21,813] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 8: [2023-04-29 17:23:21,813] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 26: [2023-04-29 17:23:21,814] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 19: [2023-04-29 17:23:21,814] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 19: [2023-04-29 17:23:21,814] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 19: [2023-04-29 17:23:21,815] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 27: [2023-04-29 17:23:21,815] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 19: [2023-04-29 17:23:21,816] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 26: [2023-04-29 17:23:21,816] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 19: [2023-04-29 17:23:21,818] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 19: [2023-04-29 17:23:21,818] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 19: [2023-04-29 17:23:21,819] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 25: [2023-04-29 17:23:21,819] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 19: [2023-04-29 17:23:21,819] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 11: [2023-04-29 17:23:21,819] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 11: [2023-04-29 17:23:21,820] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 11: [2023-04-29 17:23:21,820] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 25: [2023-04-29 17:23:21,820] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 25: [2023-04-29 17:23:21,821] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 26: [2023-04-29 17:23:21,821] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 25: [2023-04-29 17:23:21,822] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 25: [2023-04-29 17:23:21,822] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 26: [2023-04-29 17:23:21,822] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 25: [2023-04-29 17:23:21,822] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 26: [2023-04-29 17:23:21,823] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 26: [2023-04-29 17:23:21,824] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 23: [2023-04-29 17:23:21,825] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 23: [2023-04-29 17:23:21,825] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 23: [2023-04-29 17:23:21,825] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 23: [2023-04-29 17:23:21,825] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 1: [2023-04-29 17:23:21,826] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 1: [2023-04-29 17:23:21,826] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 8: [2023-04-29 17:23:21,827] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 8: [2023-04-29 17:23:21,827] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 4: [2023-04-29 17:23:21,828] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 4: [2023-04-29 17:23:21,828] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 23: [2023-04-29 17:23:21,829] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 1: [2023-04-29 17:23:21,830] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 1: [2023-04-29 17:23:21,830] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 23: [2023-04-29 17:23:21,831] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 8: [2023-04-29 17:23:21,833] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 1: [2023-04-29 17:23:21,835] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 1: [2023-04-29 17:23:21,835] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 1: [2023-04-29 17:23:21,835] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 7: [2023-04-29 17:23:21,793] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 7: [2023-04-29 17:23:21,793] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 7: [2023-04-29 17:23:21,793] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 7: [2023-04-29 17:23:21,797] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 7: [2023-04-29 17:23:21,797] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 1: [2023-04-29 17:23:21,835] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 7: [2023-04-29 17:23:21,798] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 7: [2023-04-29 17:23:21,799] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 7: [2023-04-29 17:23:21,799] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 7: [2023-04-29 17:23:21,799] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 7: [2023-04-29 17:23:21,800] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 7: [2023-04-29 17:23:21,800] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 27: [2023-04-29 17:23:21,835] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 24: [2023-04-29 17:23:21,835] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 8: [2023-04-29 17:23:21,836] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 24: [2023-04-29 17:23:21,836] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 24: [2023-04-29 17:23:21,836] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 24: [2023-04-29 17:23:21,836] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 24: [2023-04-29 17:23:21,836] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 24: [2023-04-29 17:23:21,836] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 24: [2023-04-29 17:23:21,836] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 24: [2023-04-29 17:23:21,837] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 8: [2023-04-29 17:23:21,837] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 29: [2023-04-29 17:23:21,839] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 8: [2023-04-29 17:23:21,839] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 29: [2023-04-29 17:23:21,840] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 29: [2023-04-29 17:23:21,840] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 29: [2023-04-29 17:23:21,840] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 29: [2023-04-29 17:23:21,840] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 29: [2023-04-29 17:23:21,840] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 29: [2023-04-29 17:23:21,840] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 24: [2023-04-29 17:23:21,840] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 29: [2023-04-29 17:23:21,841] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 8: [2023-04-29 17:23:21,841] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 8: [2023-04-29 17:23:21,841] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 29: [2023-04-29 17:23:21,843] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 27: [2023-04-29 17:23:21,846] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 27: [2023-04-29 17:23:21,846] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 27: [2023-04-29 17:23:21,846] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 24: [2023-04-29 17:23:21,847] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 24: [2023-04-29 17:23:21,848] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 24: [2023-04-29 17:23:21,848] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 4: [2023-04-29 17:23:21,848] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 24: [2023-04-29 17:23:21,848] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 4: [2023-04-29 17:23:21,848] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 24: [2023-04-29 17:23:21,849] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 24: [2023-04-29 17:23:21,850] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 24: [2023-04-29 17:23:21,850] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 27: [2023-04-29 17:23:21,850] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 27: [2023-04-29 17:23:21,850] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 27: [2023-04-29 17:23:21,850] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 27: [2023-04-29 17:23:21,850] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 10: [2023-04-29 17:23:21,807] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 10: [2023-04-29 17:23:21,812] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 10: [2023-04-29 17:23:21,813] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 10: [2023-04-29 17:23:21,813] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 10: [2023-04-29 17:23:21,813] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 10: [2023-04-29 17:23:21,814] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 10: [2023-04-29 17:23:21,815] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 10: [2023-04-29 17:23:21,816] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 10: [2023-04-29 17:23:21,816] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 29: [2023-04-29 17:23:21,851] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 29: [2023-04-29 17:23:21,851] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 29: [2023-04-29 17:23:21,852] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 29: [2023-04-29 17:23:21,852] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 29: [2023-04-29 17:23:21,853] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 29: [2023-04-29 17:23:21,853] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 29: [2023-04-29 17:23:21,854] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 4: [2023-04-29 17:23:21,854] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 4: [2023-04-29 17:23:21,854] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 5: [2023-04-29 17:23:21,858] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 5: [2023-04-29 17:23:21,858] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 4: [2023-04-29 17:23:21,860] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 4: [2023-04-29 17:23:21,860] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 4: [2023-04-29 17:23:21,860] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 4: [2023-04-29 17:23:21,860] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 5: [2023-04-29 17:23:21,861] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 5: [2023-04-29 17:23:21,861] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 5: [2023-04-29 17:23:21,861] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 5: [2023-04-29 17:23:21,861] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 5: [2023-04-29 17:23:21,861] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 5: [2023-04-29 17:23:21,861] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 5: [2023-04-29 17:23:21,862] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 5: [2023-04-29 17:23:21,863] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 25: [2023-04-29 17:23:21,863] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 25: [2023-04-29 17:23:21,863] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 9: [2023-04-29 17:23:21,862] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 19: [2023-04-29 17:23:21,869] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 19: [2023-04-29 17:23:21,870] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 19: [2023-04-29 17:23:21,870] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 19: [2023-04-29 17:23:21,870] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 13: [2023-04-29 17:23:21,869] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 13: [2023-04-29 17:23:21,869] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 13: [2023-04-29 17:23:21,869] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 13: [2023-04-29 17:23:21,869] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 13: [2023-04-29 17:23:21,869] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 13: [2023-04-29 17:23:21,869] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 13: [2023-04-29 17:23:21,869] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 13: [2023-04-29 17:23:21,870] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 9: [2023-04-29 17:23:21,870] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 9: [2023-04-29 17:23:21,870] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 9: [2023-04-29 17:23:21,870] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 9: [2023-04-29 17:23:21,870] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 5: [2023-04-29 17:23:21,870] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 5: [2023-04-29 17:23:21,871] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 5: [2023-04-29 17:23:21,871] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 5: [2023-04-29 17:23:21,872] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 5: [2023-04-29 17:23:21,873] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 5: [2023-04-29 17:23:21,873] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 13: [2023-04-29 17:23:21,874] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 13: [2023-04-29 17:23:21,874] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 13: [2023-04-29 17:23:21,875] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 27: [2023-04-29 17:23:21,876] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 9: [2023-04-29 17:23:21,877] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 9: [2023-04-29 17:23:21,877] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 9: [2023-04-29 17:23:21,877] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 27: [2023-04-29 17:23:21,877] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 7: [2023-04-29 17:23:21,849] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 7: [2023-04-29 17:23:21,849] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 7: [2023-04-29 17:23:21,850] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 7: [2023-04-29 17:23:21,866] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 7: [2023-04-29 17:23:21,866] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 7: [2023-04-29 17:23:21,866] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 7: [2023-04-29 17:23:21,866] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 7: [2023-04-29 17:23:21,866] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 7: [2023-04-29 17:23:21,870] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 7: [2023-04-29 17:23:21,871] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 7: [2023-04-29 17:23:21,873] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 27: [2023-04-29 17:23:21,879] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 19: [2023-04-29 17:23:21,879] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 13: [2023-04-29 17:23:21,879] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 13: [2023-04-29 17:23:21,879] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 13: [2023-04-29 17:23:21,880] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 25: [2023-04-29 17:23:21,880] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 13: [2023-04-29 17:23:21,881] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 13: [2023-04-29 17:23:21,881] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 25: [2023-04-29 17:23:21,883] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 27: [2023-04-29 17:23:21,883] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 27: [2023-04-29 17:23:21,883] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 27: [2023-04-29 17:23:21,883] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 4: [2023-04-29 17:23:21,884] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 4: [2023-04-29 17:23:21,884] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 25: [2023-04-29 17:23:21,884] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 9: [2023-04-29 17:23:21,886] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 27: [2023-04-29 17:23:21,888] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 4: [2023-04-29 17:23:21,890] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 19: [2023-04-29 17:23:21,890] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 24: [2023-04-29 17:23:21,890] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 29: [2023-04-29 17:23:21,891] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 4: [2023-04-29 17:23:21,892] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 7: [2023-04-29 17:23:21,892] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 25: [2023-04-29 17:23:21,892] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 25: [2023-04-29 17:23:21,892] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 19: [2023-04-29 17:23:21,893] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 19: [2023-04-29 17:23:21,893] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 19: [2023-04-29 17:23:21,893] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 19: [2023-04-29 17:23:21,893] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 7: [2023-04-29 17:23:21,893] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 7: [2023-04-29 17:23:21,894] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 19: [2023-04-29 17:23:21,894] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 4: [2023-04-29 17:23:21,894] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 4: [2023-04-29 17:23:21,894] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 10: [2023-04-29 17:23:21,871] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 10: [2023-04-29 17:23:21,871] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 10: [2023-04-29 17:23:21,871] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 10: [2023-04-29 17:23:21,871] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 10: [2023-04-29 17:23:21,876] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 10: [2023-04-29 17:23:21,876] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 10: [2023-04-29 17:23:21,876] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 10: [2023-04-29 17:23:21,876] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 19: [2023-04-29 17:23:21,895] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 25: [2023-04-29 17:23:21,895] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 25: [2023-04-29 17:23:21,895] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 25: [2023-04-29 17:23:21,895] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 7: [2023-04-29 17:23:21,895] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 7: [2023-04-29 17:23:21,895] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 10: [2023-04-29 17:23:21,895] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 9: [2023-04-29 17:23:21,896] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 10: [2023-04-29 17:23:21,897] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 9: [2023-04-29 17:23:21,898] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 9: [2023-04-29 17:23:21,898] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 10: [2023-04-29 17:23:21,898] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 10: [2023-04-29 17:23:21,898] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 9: [2023-04-29 17:23:21,900] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 9: [2023-04-29 17:23:21,900] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 9: [2023-04-29 17:23:21,901] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 25: [2023-04-29 17:23:21,902] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 9: [2023-04-29 17:23:21,903] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 10: [2023-04-29 17:23:21,904] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 19: [2023-04-29 17:23:21,906] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 10: [2023-04-29 17:23:21,907] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 10: [2023-04-29 17:23:21,907] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 10: [2023-04-29 17:23:21,908] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 18: [2023-04-29 17:23:21,908] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 18: [2023-04-29 17:23:21,908] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 18: [2023-04-29 17:23:21,908] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 18: [2023-04-29 17:23:21,909] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 18: [2023-04-29 17:23:21,909] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 18: [2023-04-29 17:23:21,909] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 18: [2023-04-29 17:23:21,909] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 18: [2023-04-29 17:23:21,909] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 30: [2023-04-29 17:23:21,909] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 30: [2023-04-29 17:23:21,909] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 30: [2023-04-29 17:23:21,909] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 30: [2023-04-29 17:23:21,909] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 30: [2023-04-29 17:23:21,909] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 30: [2023-04-29 17:23:21,909] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 30: [2023-04-29 17:23:21,909] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 30: [2023-04-29 17:23:21,910] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 29: [2023-04-29 17:23:21,910] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 24: [2023-04-29 17:23:21,912] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 5: [2023-04-29 17:23:21,912] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 5: [2023-04-29 17:23:21,912] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 21: [2023-04-29 17:23:21,916] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 21: [2023-04-29 17:23:21,916] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 21: [2023-04-29 17:23:21,916] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 21: [2023-04-29 17:23:21,916] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 21: [2023-04-29 17:23:21,916] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 21: [2023-04-29 17:23:21,916] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 21: [2023-04-29 17:23:21,916] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 21: [2023-04-29 17:23:21,916] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 19: [2023-04-29 17:23:21,918] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 19: [2023-04-29 17:23:21,920] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 30: [2023-04-29 17:23:21,920] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 21: [2023-04-29 17:23:21,920] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 21: [2023-04-29 17:23:21,921] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 19: [2023-04-29 17:23:21,921] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 30: [2023-04-29 17:23:21,921] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 21: [2023-04-29 17:23:21,921] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 30: [2023-04-29 17:23:21,921] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 18: [2023-04-29 17:23:21,921] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 30: [2023-04-29 17:23:21,921] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 30: [2023-04-29 17:23:21,921] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 21: [2023-04-29 17:23:21,922] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 18: [2023-04-29 17:23:21,922] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 30: [2023-04-29 17:23:21,922] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 25: [2023-04-29 17:23:21,922] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 30: [2023-04-29 17:23:21,922] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 21: [2023-04-29 17:23:21,922] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 18: [2023-04-29 17:23:21,922] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 21: [2023-04-29 17:23:21,923] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 18: [2023-04-29 17:23:21,923] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 21: [2023-04-29 17:23:21,923] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 30: [2023-04-29 17:23:21,923] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 21: [2023-04-29 17:23:21,923] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 25: [2023-04-29 17:23:21,924] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 18: [2023-04-29 17:23:21,924] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 18: [2023-04-29 17:23:21,924] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 29: [2023-04-29 17:23:21,924] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 29: [2023-04-29 17:23:21,924] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 18: [2023-04-29 17:23:21,924] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 18: [2023-04-29 17:23:21,925] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 25: [2023-04-29 17:23:21,925] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 24: [2023-04-29 17:23:21,926] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 24: [2023-04-29 17:23:21,926] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 24: [2023-04-29 17:23:21,926] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 24: [2023-04-29 17:23:21,926] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 24: [2023-04-29 17:23:21,926] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 24: [2023-04-29 17:23:21,926] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 24: [2023-04-29 17:23:21,926] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 25: [2023-04-29 17:23:21,927] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 25: [2023-04-29 17:23:21,927] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 13: [2023-04-29 17:23:21,930] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 13: [2023-04-29 17:23:21,930] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 13: [2023-04-29 17:23:21,931] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 5: [2023-04-29 17:23:21,933] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 5: [2023-04-29 17:23:21,933] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 29: [2023-04-29 17:23:21,932] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 29: [2023-04-29 17:23:21,932] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 29: [2023-04-29 17:23:21,932] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 29: [2023-04-29 17:23:21,932] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 29: [2023-04-29 17:23:21,932] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 5: [2023-04-29 17:23:21,941] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 5: [2023-04-29 17:23:21,941] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 5: [2023-04-29 17:23:21,941] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 5: [2023-04-29 17:23:21,941] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 15: [2023-04-29 17:23:21,940] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 15: [2023-04-29 17:23:21,940] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 15: [2023-04-29 17:23:21,940] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 15: [2023-04-29 17:23:21,940] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 15: [2023-04-29 17:23:21,941] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 15: [2023-04-29 17:23:21,941] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 15: [2023-04-29 17:23:21,941] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 15: [2023-04-29 17:23:21,941] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 5: [2023-04-29 17:23:21,942] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 5: [2023-04-29 17:23:21,942] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 29: [2023-04-29 17:23:21,950] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 29: [2023-04-29 17:23:21,953] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 13: [2023-04-29 17:23:21,953] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 15: [2023-04-29 17:23:21,953] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 13: [2023-04-29 17:23:21,954] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 15: [2023-04-29 17:23:21,954] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 13: [2023-04-29 17:23:21,954] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 13: [2023-04-29 17:23:21,954] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 13: [2023-04-29 17:23:21,954] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 13: [2023-04-29 17:23:21,954] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 13: [2023-04-29 17:23:21,954] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 13: [2023-04-29 17:23:21,954] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 15: [2023-04-29 17:23:21,955] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 15: [2023-04-29 17:23:21,955] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 15: [2023-04-29 17:23:21,956] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 15: [2023-04-29 17:23:21,956] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 15: [2023-04-29 17:23:21,957] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 15: [2023-04-29 17:23:21,957] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 24: [2023-04-29 17:23:21,964] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 29: [2023-04-29 17:23:21,967] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 29: [2023-04-29 17:23:21,967] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 29: [2023-04-29 17:23:21,967] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 28: [2023-04-29 17:23:21,968] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 28: [2023-04-29 17:23:21,968] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 28: [2023-04-29 17:23:21,968] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 28: [2023-04-29 17:23:21,968] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 28: [2023-04-29 17:23:21,968] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 28: [2023-04-29 17:23:21,968] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 28: [2023-04-29 17:23:21,968] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 28: [2023-04-29 17:23:21,969] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 29: [2023-04-29 17:23:21,969] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 29: [2023-04-29 17:23:21,969] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 24: [2023-04-29 17:23:21,970] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 24: [2023-04-29 17:23:21,970] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 5: [2023-04-29 17:23:21,971] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 24: [2023-04-29 17:23:21,973] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 5: [2023-04-29 17:23:21,973] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 24: [2023-04-29 17:23:21,973] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 24: [2023-04-29 17:23:21,975] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 24: [2023-04-29 17:23:21,975] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 5: [2023-04-29 17:23:21,975] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 21: [2023-04-29 17:23:21,975] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 21: [2023-04-29 17:23:21,975] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 21: [2023-04-29 17:23:21,975] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 5: [2023-04-29 17:23:21,976] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 5: [2023-04-29 17:23:21,976] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 5: [2023-04-29 17:23:21,978] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 13: [2023-04-29 17:23:21,982] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 28: [2023-04-29 17:23:21,981] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 28: [2023-04-29 17:23:21,982] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 28: [2023-04-29 17:23:21,983] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 13: [2023-04-29 17:23:21,983] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 28: [2023-04-29 17:23:21,984] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 28: [2023-04-29 17:23:21,984] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 28: [2023-04-29 17:23:21,985] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 28: [2023-04-29 17:23:21,985] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 28: [2023-04-29 17:23:21,985] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt... 13: [2023-04-29 17:23:21,985] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 13: [2023-04-29 17:23:21,988] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 13: [2023-04-29 17:23:21,988] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 21: [2023-04-29 17:23:21,989] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 21: [2023-04-29 17:23:21,989] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 21: [2023-04-29 17:23:21,989] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 21: [2023-04-29 17:23:21,989] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 21: [2023-04-29 17:23:21,989] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 30: [2023-04-29 17:23:21,992] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 18: [2023-04-29 17:23:21,998] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 18: [2023-04-29 17:23:22,000] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 18: [2023-04-29 17:23:22,000] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 18: [2023-04-29 17:23:22,000] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 21: [2023-04-29 17:23:22,004] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 21: [2023-04-29 17:23:22,004] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 21: [2023-04-29 17:23:22,004] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 30: [2023-04-29 17:23:22,013] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 30: [2023-04-29 17:23:22,013] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 30: [2023-04-29 17:23:22,013] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 30: [2023-04-29 17:23:22,013] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 30: [2023-04-29 17:23:22,013] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 30: [2023-04-29 17:23:22,013] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 30: [2023-04-29 17:23:22,013] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 30: [2023-04-29 17:23:22,016] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 18: [2023-04-29 17:23:22,017] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 18: [2023-04-29 17:23:22,017] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 18: [2023-04-29 17:23:22,017] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 18: [2023-04-29 17:23:22,017] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 21: [2023-04-29 17:23:22,018] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 21: [2023-04-29 17:23:22,018] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 21: [2023-04-29 17:23:22,021] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 21: [2023-04-29 17:23:22,022] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 21: [2023-04-29 17:23:22,024] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 18: [2023-04-29 17:23:22,028] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 18: [2023-04-29 17:23:22,028] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 18: [2023-04-29 17:23:22,032] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 18: [2023-04-29 17:23:22,032] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 15: [2023-04-29 17:23:22,033] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 15: [2023-04-29 17:23:22,033] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 15: [2023-04-29 17:23:22,033] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 15: [2023-04-29 17:23:22,033] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 15: [2023-04-29 17:23:22,037] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 15: [2023-04-29 17:23:22,037] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 15: [2023-04-29 17:23:22,037] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 15: [2023-04-29 17:23:22,038] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 14: [2023-04-29 17:23:22,042] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 14: [2023-04-29 17:23:22,042] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 14: [2023-04-29 17:23:22,042] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 14: [2023-04-29 17:23:22,042] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 14: [2023-04-29 17:23:22,042] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 14: [2023-04-29 17:23:22,042] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 14: [2023-04-29 17:23:22,042] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 14: [2023-04-29 17:23:22,042] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 17: [2023-04-29 17:23:22,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 2: [2023-04-29 17:23:22,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 2: [2023-04-29 17:23:22,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 2: [2023-04-29 17:23:22,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 12: [2023-04-29 17:23:22,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 12: [2023-04-29 17:23:22,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 12: [2023-04-29 17:23:22,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 12: [2023-04-29 17:23:22,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 12: [2023-04-29 17:23:22,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 17: [2023-04-29 17:23:22,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 17: [2023-04-29 17:23:22,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 17: [2023-04-29 17:23:22,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 12: [2023-04-29 17:23:22,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 12: [2023-04-29 17:23:22,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 17: [2023-04-29 17:23:22,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 17: [2023-04-29 17:23:22,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 2: [2023-04-29 17:23:22,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 2: [2023-04-29 17:23:22,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 2: [2023-04-29 17:23:22,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 2: [2023-04-29 17:23:22,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 12: [2023-04-29 17:23:22,046] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 17: [2023-04-29 17:23:22,046] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 31: [2023-04-29 17:23:22,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 31: [2023-04-29 17:23:22,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 31: [2023-04-29 17:23:22,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 31: [2023-04-29 17:23:22,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 31: [2023-04-29 17:23:22,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 2: [2023-04-29 17:23:22,046] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 31: [2023-04-29 17:23:22,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 31: [2023-04-29 17:23:22,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 14: [2023-04-29 17:23:22,046] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 17: [2023-04-29 17:23:22,046] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 31: [2023-04-29 17:23:22,046] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 30: [2023-04-29 17:23:22,046] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 30: [2023-04-29 17:23:22,046] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 30: [2023-04-29 17:23:22,047] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 3: [2023-04-29 17:23:22,048] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 3: [2023-04-29 17:23:22,048] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 30: [2023-04-29 17:23:22,048] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 3: [2023-04-29 17:23:22,049] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 3: [2023-04-29 17:23:22,049] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 3: [2023-04-29 17:23:22,049] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 3: [2023-04-29 17:23:22,049] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 3: [2023-04-29 17:23:22,049] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 3: [2023-04-29 17:23:22,049] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 17: [2023-04-29 17:23:22,050] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 2: [2023-04-29 17:23:22,049] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 2: [2023-04-29 17:23:22,050] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 2: [2023-04-29 17:23:22,050] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 31: [2023-04-29 17:23:22,050] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 31: [2023-04-29 17:23:22,050] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 12: [2023-04-29 17:23:22,050] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 18: [2023-04-29 17:23:22,050] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 30: [2023-04-29 17:23:22,050] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 31: [2023-04-29 17:23:22,050] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 12: [2023-04-29 17:23:22,051] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 31: [2023-04-29 17:23:22,051] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 18: [2023-04-29 17:23:22,051] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 31: [2023-04-29 17:23:22,051] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 18: [2023-04-29 17:23:22,051] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 18: [2023-04-29 17:23:22,052] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 31: [2023-04-29 17:23:22,052] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 3: [2023-04-29 17:23:22,052] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 31: [2023-04-29 17:23:22,052] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 12: [2023-04-29 17:23:22,052] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 17: [2023-04-29 17:23:22,051] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 31: [2023-04-29 17:23:22,052] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 30: [2023-04-29 17:23:22,053] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 3: [2023-04-29 17:23:22,052] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 30: [2023-04-29 17:23:22,053] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 14: [2023-04-29 17:23:22,054] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 14: [2023-04-29 17:23:22,054] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 2: [2023-04-29 17:23:22,054] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 14: [2023-04-29 17:23:22,054] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 12: [2023-04-29 17:23:22,054] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 14: [2023-04-29 17:23:22,054] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 12: [2023-04-29 17:23:22,055] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 2: [2023-04-29 17:23:22,055] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 14: [2023-04-29 17:23:22,055] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 14: [2023-04-29 17:23:22,055] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 12: [2023-04-29 17:23:22,055] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 2: [2023-04-29 17:23:22,055] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 3: [2023-04-29 17:23:22,055] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 12: [2023-04-29 17:23:22,055] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 12: [2023-04-29 17:23:22,056] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 3: [2023-04-29 17:23:22,056] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 17: [2023-04-29 17:23:22,055] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 14: [2023-04-29 17:23:22,056] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 3: [2023-04-29 17:23:22,056] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 3: [2023-04-29 17:23:22,056] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 2: [2023-04-29 17:23:22,056] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 2: [2023-04-29 17:23:22,056] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 17: [2023-04-29 17:23:22,056] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 3: [2023-04-29 17:23:22,056] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 17: [2023-04-29 17:23:22,057] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 17: [2023-04-29 17:23:22,057] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 3: [2023-04-29 17:23:22,057] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 17: [2023-04-29 17:23:22,057] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 17: [2023-04-29 17:23:22,058] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 28: [2023-04-29 17:23:22,059] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 28: [2023-04-29 17:23:22,059] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 28: [2023-04-29 17:23:22,059] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 6: [2023-04-29 17:23:22,073] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 6: [2023-04-29 17:23:22,073] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 6: [2023-04-29 17:23:22,073] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 6: [2023-04-29 17:23:22,073] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 6: [2023-04-29 17:23:22,073] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 6: [2023-04-29 17:23:22,073] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 6: [2023-04-29 17:23:22,073] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 6: [2023-04-29 17:23:22,073] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 28: [2023-04-29 17:23:22,074] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 28: [2023-04-29 17:23:22,074] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 28: [2023-04-29 17:23:22,074] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 28: [2023-04-29 17:23:22,074] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 28: [2023-04-29 17:23:22,075] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_12-model_00-model_states.pt. 16: [2023-04-29 17:23:22,076] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 16: [2023-04-29 17:23:22,076] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 16: [2023-04-29 17:23:22,076] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 8: [2023-04-29 17:23:22,076] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 8: [2023-04-29 17:23:22,077] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 16: [2023-04-29 17:23:22,077] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 16: [2023-04-29 17:23:22,077] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 16: [2023-04-29 17:23:22,077] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 8: [2023-04-29 17:23:22,077] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 8: [2023-04-29 17:23:22,077] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 8: [2023-04-29 17:23:22,077] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 8: [2023-04-29 17:23:22,077] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 8: [2023-04-29 17:23:22,077] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 16: [2023-04-29 17:23:22,077] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 8: [2023-04-29 17:23:22,077] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 16: [2023-04-29 17:23:22,077] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 0: [2023-04-29 17:23:22,077] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 0: [2023-04-29 17:23:22,077] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 0: [2023-04-29 17:23:22,077] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 0: [2023-04-29 17:23:22,077] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 0: [2023-04-29 17:23:22,077] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 0: [2023-04-29 17:23:22,077] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 0: [2023-04-29 17:23:22,077] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 0: [2023-04-29 17:23:22,077] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 6: [2023-04-29 17:23:22,077] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 6: [2023-04-29 17:23:22,077] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 16: [2023-04-29 17:23:22,082] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 16: [2023-04-29 17:23:22,082] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 16: [2023-04-29 17:23:22,083] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 15: [2023-04-29 17:23:22,061] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 15: [2023-04-29 17:23:22,067] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 15: [2023-04-29 17:23:22,068] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 15: [2023-04-29 17:23:22,068] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 15: [2023-04-29 17:23:22,071] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 15: [2023-04-29 17:23:22,074] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 15: [2023-04-29 17:23:22,075] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 15: [2023-04-29 17:23:22,076] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 6: [2023-04-29 17:23:22,082] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 6: [2023-04-29 17:23:22,083] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 16: [2023-04-29 17:23:22,083] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 16: [2023-04-29 17:23:22,083] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 6: [2023-04-29 17:23:22,083] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 16: [2023-04-29 17:23:22,083] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 6: [2023-04-29 17:23:22,083] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 8: [2023-04-29 17:23:22,083] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 8: [2023-04-29 17:23:22,083] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 16: [2023-04-29 17:23:22,083] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 16: [2023-04-29 17:23:22,084] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 6: [2023-04-29 17:23:22,084] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 6: [2023-04-29 17:23:22,084] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 8: [2023-04-29 17:23:22,084] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 8: [2023-04-29 17:23:22,085] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 8: [2023-04-29 17:23:22,085] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 8: [2023-04-29 17:23:22,085] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 8: [2023-04-29 17:23:22,086] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 28: [2023-04-29 17:23:22,086] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 8: [2023-04-29 17:23:22,087] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 28: [2023-04-29 17:23:22,087] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 28: [2023-04-29 17:23:22,087] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 1: [2023-04-29 17:23:22,088] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 1: [2023-04-29 17:23:22,088] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 1: [2023-04-29 17:23:22,088] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 1: [2023-04-29 17:23:22,088] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 1: [2023-04-29 17:23:22,088] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 1: [2023-04-29 17:23:22,088] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 1: [2023-04-29 17:23:22,089] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 1: [2023-04-29 17:23:22,089] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 0: [2023-04-29 17:23:22,091] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 0: [2023-04-29 17:23:22,091] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 0: [2023-04-29 17:23:22,092] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 0: [2023-04-29 17:23:22,092] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 0: [2023-04-29 17:23:22,093] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 0: [2023-04-29 17:23:22,093] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 1: [2023-04-29 17:23:22,094] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 1: [2023-04-29 17:23:22,094] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 0: [2023-04-29 17:23:22,094] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 0: [2023-04-29 17:23:22,094] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 1: [2023-04-29 17:23:22,094] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 1: [2023-04-29 17:23:22,094] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 1: [2023-04-29 17:23:22,095] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 12: [2023-04-29 17:23:22,095] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 1: [2023-04-29 17:23:22,096] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 1: [2023-04-29 17:23:22,096] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 1: [2023-04-29 17:23:22,097] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 14: [2023-04-29 17:23:22,097] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 17: [2023-04-29 17:23:22,102] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 2: [2023-04-29 17:23:22,102] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 2: [2023-04-29 17:23:22,102] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 2: [2023-04-29 17:23:22,102] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 31: [2023-04-29 17:23:22,102] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 31: [2023-04-29 17:23:22,102] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 31: [2023-04-29 17:23:22,102] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 3: [2023-04-29 17:23:22,103] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 3: [2023-04-29 17:23:22,103] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 17: [2023-04-29 17:23:22,105] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 12: [2023-04-29 17:23:22,108] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 12: [2023-04-29 17:23:22,109] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 28: [2023-04-29 17:23:22,109] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 28: [2023-04-29 17:23:22,112] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 28: [2023-04-29 17:23:22,112] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 28: [2023-04-29 17:23:22,113] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 28: [2023-04-29 17:23:22,113] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 12: [2023-04-29 17:23:22,115] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 14: [2023-04-29 17:23:22,117] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 31: [2023-04-29 17:23:22,117] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 31: [2023-04-29 17:23:22,117] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 31: [2023-04-29 17:23:22,117] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 31: [2023-04-29 17:23:22,117] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 31: [2023-04-29 17:23:22,117] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 12: [2023-04-29 17:23:22,118] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 2: [2023-04-29 17:23:22,119] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 2: [2023-04-29 17:23:22,119] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 2: [2023-04-29 17:23:22,119] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 3: [2023-04-29 17:23:22,121] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 2: [2023-04-29 17:23:22,121] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 2: [2023-04-29 17:23:22,121] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 12: [2023-04-29 17:23:22,122] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 12: [2023-04-29 17:23:22,122] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 12: [2023-04-29 17:23:22,122] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 12: [2023-04-29 17:23:22,122] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 3: [2023-04-29 17:23:22,123] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 31: [2023-04-29 17:23:22,123] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 2: [2023-04-29 17:23:22,123] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 17: [2023-04-29 17:23:22,124] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 2: [2023-04-29 17:23:22,124] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 3: [2023-04-29 17:23:22,124] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 31: [2023-04-29 17:23:22,124] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 31: [2023-04-29 17:23:22,124] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 2: [2023-04-29 17:23:22,125] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 17: [2023-04-29 17:23:22,125] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 16: [2023-04-29 17:23:22,128] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 14: [2023-04-29 17:23:22,128] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 6: [2023-04-29 17:23:22,129] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 6: [2023-04-29 17:23:22,129] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 17: [2023-04-29 17:23:22,129] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 3: [2023-04-29 17:23:22,130] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 3: [2023-04-29 17:23:22,130] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 3: [2023-04-29 17:23:22,130] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 3: [2023-04-29 17:23:22,130] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 3: [2023-04-29 17:23:22,130] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 17: [2023-04-29 17:23:22,130] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 17: [2023-04-29 17:23:22,130] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 17: [2023-04-29 17:23:22,131] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 14: [2023-04-29 17:23:22,132] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 17: [2023-04-29 17:23:22,132] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 17: [2023-04-29 17:23:22,132] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 14: [2023-04-29 17:23:22,133] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 14: [2023-04-29 17:23:22,133] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 14: [2023-04-29 17:23:22,133] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 14: [2023-04-29 17:23:22,133] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 14: [2023-04-29 17:23:22,133] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 12: [2023-04-29 17:23:22,135] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 12: [2023-04-29 17:23:22,136] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 8: [2023-04-29 17:23:22,136] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 8: [2023-04-29 17:23:22,136] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 8: [2023-04-29 17:23:22,140] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 16: [2023-04-29 17:23:22,140] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 16: [2023-04-29 17:23:22,140] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 31: [2023-04-29 17:23:22,143] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 26: [2023-04-29 17:23:22,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 26: [2023-04-29 17:23:22,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 26: [2023-04-29 17:23:22,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 26: [2023-04-29 17:23:22,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 26: [2023-04-29 17:23:22,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 26: [2023-04-29 17:23:22,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 26: [2023-04-29 17:23:22,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 3: [2023-04-29 17:23:22,144] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 26: [2023-04-29 17:23:22,144] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 16: [2023-04-29 17:23:22,145] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 27: [2023-04-29 17:23:22,145] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 31: [2023-04-29 17:23:22,146] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 27: [2023-04-29 17:23:22,146] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 27: [2023-04-29 17:23:22,146] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 27: [2023-04-29 17:23:22,146] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 27: [2023-04-29 17:23:22,146] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 27: [2023-04-29 17:23:22,146] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 27: [2023-04-29 17:23:22,146] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 27: [2023-04-29 17:23:22,146] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 12: [2023-04-29 17:23:22,146] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 8: [2023-04-29 17:23:22,147] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 8: [2023-04-29 17:23:22,147] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 8: [2023-04-29 17:23:22,147] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 8: [2023-04-29 17:23:22,147] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 8: [2023-04-29 17:23:22,147] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 31: [2023-04-29 17:23:22,148] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 31: [2023-04-29 17:23:22,148] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 31: [2023-04-29 17:23:22,148] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 6: [2023-04-29 17:23:22,149] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 17: [2023-04-29 17:23:22,149] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 6: [2023-04-29 17:23:22,149] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 16: [2023-04-29 17:23:22,150] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 26: [2023-04-29 17:23:22,150] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 27: [2023-04-29 17:23:22,150] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 26: [2023-04-29 17:23:22,150] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 2: [2023-04-29 17:23:22,150] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 2: [2023-04-29 17:23:22,150] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 2: [2023-04-29 17:23:22,150] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 2: [2023-04-29 17:23:22,150] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 2: [2023-04-29 17:23:22,150] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 1: [2023-04-29 17:23:22,150] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 1: [2023-04-29 17:23:22,150] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 1: [2023-04-29 17:23:22,150] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 1: [2023-04-29 17:23:22,150] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 26: [2023-04-29 17:23:22,151] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 26: [2023-04-29 17:23:22,151] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 26: [2023-04-29 17:23:22,151] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 12: [2023-04-29 17:23:22,151] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 26: [2023-04-29 17:23:22,152] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 26: [2023-04-29 17:23:22,153] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 6: [2023-04-29 17:23:22,152] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 26: [2023-04-29 17:23:22,153] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 12: [2023-04-29 17:23:22,153] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 12: [2023-04-29 17:23:22,154] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 12: [2023-04-29 17:23:22,154] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 16: [2023-04-29 17:23:22,155] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 16: [2023-04-29 17:23:22,155] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 16: [2023-04-29 17:23:22,155] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 16: [2023-04-29 17:23:22,155] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 1: [2023-04-29 17:23:22,155] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 1: [2023-04-29 17:23:22,155] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 1: [2023-04-29 17:23:22,155] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 1: [2023-04-29 17:23:22,155] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 3: [2023-04-29 17:23:22,158] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 6: [2023-04-29 17:23:22,157] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 6: [2023-04-29 17:23:22,157] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 6: [2023-04-29 17:23:22,157] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 6: [2023-04-29 17:23:22,157] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 6: [2023-04-29 17:23:22,157] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 3: [2023-04-29 17:23:22,158] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 27: [2023-04-29 17:23:22,158] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 27: [2023-04-29 17:23:22,158] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 27: [2023-04-29 17:23:22,159] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 3: [2023-04-29 17:23:22,159] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 8: [2023-04-29 17:23:22,160] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 8: [2023-04-29 17:23:22,160] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 17: [2023-04-29 17:23:22,160] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 27: [2023-04-29 17:23:22,160] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 27: [2023-04-29 17:23:22,161] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 27: [2023-04-29 17:23:22,161] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 27: [2023-04-29 17:23:22,161] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 3: [2023-04-29 17:23:22,162] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 3: [2023-04-29 17:23:22,162] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 14: [2023-04-29 17:23:22,162] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 17: [2023-04-29 17:23:22,162] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 17: [2023-04-29 17:23:22,164] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 16: [2023-04-29 17:23:22,164] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 17: [2023-04-29 17:23:22,165] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 8: [2023-04-29 17:23:22,165] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 17: [2023-04-29 17:23:22,165] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 16: [2023-04-29 17:23:22,167] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 16: [2023-04-29 17:23:22,168] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 14: [2023-04-29 17:23:22,169] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 0: [2023-04-29 17:23:22,172] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 0: [2023-04-29 17:23:22,172] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 13: [2023-04-29 17:23:22,173] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 14: [2023-04-29 17:23:22,173] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 13: [2023-04-29 17:23:22,173] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 14: [2023-04-29 17:23:22,173] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 13: [2023-04-29 17:23:22,174] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 13: [2023-04-29 17:23:22,174] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 13: [2023-04-29 17:23:22,174] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 13: [2023-04-29 17:23:22,174] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 13: [2023-04-29 17:23:22,174] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 14: [2023-04-29 17:23:22,174] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 0: [2023-04-29 17:23:22,174] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 13: [2023-04-29 17:23:22,174] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 1: [2023-04-29 17:23:22,175] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 1: [2023-04-29 17:23:22,176] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 14: [2023-04-29 17:23:22,176] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 8: [2023-04-29 17:23:22,176] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 14: [2023-04-29 17:23:22,177] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 6: [2023-04-29 17:23:22,177] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 13: [2023-04-29 17:23:22,178] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 1: [2023-04-29 17:23:22,179] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 1: [2023-04-29 17:23:22,179] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 8: [2023-04-29 17:23:22,177] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 8: [2023-04-29 17:23:22,178] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 8: [2023-04-29 17:23:22,179] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 8: [2023-04-29 17:23:22,179] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 13: [2023-04-29 17:23:22,180] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 0: [2023-04-29 17:23:22,180] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 0: [2023-04-29 17:23:22,180] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 0: [2023-04-29 17:23:22,181] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 0: [2023-04-29 17:23:22,181] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 0: [2023-04-29 17:23:22,181] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 16: [2023-04-29 17:23:22,182] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 16: [2023-04-29 17:23:22,182] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 16: [2023-04-29 17:23:22,182] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 16: [2023-04-29 17:23:22,183] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 1: [2023-04-29 17:23:22,183] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 13: [2023-04-29 17:23:22,184] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 1: [2023-04-29 17:23:22,184] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 1: [2023-04-29 17:23:22,184] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 1: [2023-04-29 17:23:22,184] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 13: [2023-04-29 17:23:22,184] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 7: [2023-04-29 17:23:22,184] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 13: [2023-04-29 17:23:22,185] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 7: [2023-04-29 17:23:22,184] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 7: [2023-04-29 17:23:22,185] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 7: [2023-04-29 17:23:22,185] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 7: [2023-04-29 17:23:22,185] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 7: [2023-04-29 17:23:22,185] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 7: [2023-04-29 17:23:22,185] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 7: [2023-04-29 17:23:22,185] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 13: [2023-04-29 17:23:22,185] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 13: [2023-04-29 17:23:22,186] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 13: [2023-04-29 17:23:22,187] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 7: [2023-04-29 17:23:22,189] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 7: [2023-04-29 17:23:22,189] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 7: [2023-04-29 17:23:22,189] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 6: [2023-04-29 17:23:22,190] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 7: [2023-04-29 17:23:22,191] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 7: [2023-04-29 17:23:22,191] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 7: [2023-04-29 17:23:22,191] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 7: [2023-04-29 17:23:22,192] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 7: [2023-04-29 17:23:22,192] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 6: [2023-04-29 17:23:22,193] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 6: [2023-04-29 17:23:22,194] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 6: [2023-04-29 17:23:22,194] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 6: [2023-04-29 17:23:22,194] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 27: [2023-04-29 17:23:22,199] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 0: [2023-04-29 17:23:22,202] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 0: [2023-04-29 17:23:22,202] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 26: [2023-04-29 17:23:22,204] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 26: [2023-04-29 17:23:22,204] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 0: [2023-04-29 17:23:22,205] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 22: [2023-04-29 17:23:22,206] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 22: [2023-04-29 17:23:22,206] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 22: [2023-04-29 17:23:22,206] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 22: [2023-04-29 17:23:22,206] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 22: [2023-04-29 17:23:22,207] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 22: [2023-04-29 17:23:22,207] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 22: [2023-04-29 17:23:22,207] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 22: [2023-04-29 17:23:22,207] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 26: [2023-04-29 17:23:22,207] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 11: [2023-04-29 17:23:22,209] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 11: [2023-04-29 17:23:22,209] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 11: [2023-04-29 17:23:22,210] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 23: [2023-04-29 17:23:22,209] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 23: [2023-04-29 17:23:22,209] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 23: [2023-04-29 17:23:22,209] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 23: [2023-04-29 17:23:22,209] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 23: [2023-04-29 17:23:22,209] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 23: [2023-04-29 17:23:22,209] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 23: [2023-04-29 17:23:22,209] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 20: [2023-04-29 17:23:22,209] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 20: [2023-04-29 17:23:22,209] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 20: [2023-04-29 17:23:22,209] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 20: [2023-04-29 17:23:22,210] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 20: [2023-04-29 17:23:22,210] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 20: [2023-04-29 17:23:22,210] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 20: [2023-04-29 17:23:22,210] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 23: [2023-04-29 17:23:22,210] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 10: [2023-04-29 17:23:22,209] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 10: [2023-04-29 17:23:22,209] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 10: [2023-04-29 17:23:22,209] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 10: [2023-04-29 17:23:22,209] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 10: [2023-04-29 17:23:22,209] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 20: [2023-04-29 17:23:22,210] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 10: [2023-04-29 17:23:22,210] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 10: [2023-04-29 17:23:22,210] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 11: [2023-04-29 17:23:22,210] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 11: [2023-04-29 17:23:22,210] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 10: [2023-04-29 17:23:22,210] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 11: [2023-04-29 17:23:22,210] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 11: [2023-04-29 17:23:22,210] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 22: [2023-04-29 17:23:22,210] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 11: [2023-04-29 17:23:22,210] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 22: [2023-04-29 17:23:22,211] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 26: [2023-04-29 17:23:22,212] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 20: [2023-04-29 17:23:22,214] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 11: [2023-04-29 17:23:22,214] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 11: [2023-04-29 17:23:22,215] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 11: [2023-04-29 17:23:22,215] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 10: [2023-04-29 17:23:22,215] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 26: [2023-04-29 17:23:22,215] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 26: [2023-04-29 17:23:22,215] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 26: [2023-04-29 17:23:22,215] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 26: [2023-04-29 17:23:22,215] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 10: [2023-04-29 17:23:22,215] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 23: [2023-04-29 17:23:22,215] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 20: [2023-04-29 17:23:22,215] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 10: [2023-04-29 17:23:22,215] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 23: [2023-04-29 17:23:22,216] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 10: [2023-04-29 17:23:22,216] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 0: [2023-04-29 17:23:22,216] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 20: [2023-04-29 17:23:22,216] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 0: [2023-04-29 17:23:22,217] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 10: [2023-04-29 17:23:22,217] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 10: [2023-04-29 17:23:22,217] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 0: [2023-04-29 17:23:22,217] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 22: [2023-04-29 17:23:22,217] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 22: [2023-04-29 17:23:22,217] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 22: [2023-04-29 17:23:22,218] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 20: [2023-04-29 17:23:22,218] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 10: [2023-04-29 17:23:22,218] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 20: [2023-04-29 17:23:22,219] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 22: [2023-04-29 17:23:22,218] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 0: [2023-04-29 17:23:22,219] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 10: [2023-04-29 17:23:22,219] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 22: [2023-04-29 17:23:22,219] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 0: [2023-04-29 17:23:22,219] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 22: [2023-04-29 17:23:22,219] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 20: [2023-04-29 17:23:22,220] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 11: [2023-04-29 17:23:22,219] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 23: [2023-04-29 17:23:22,219] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 23: [2023-04-29 17:23:22,219] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 11: [2023-04-29 17:23:22,220] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 20: [2023-04-29 17:23:22,220] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 23: [2023-04-29 17:23:22,220] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 20: [2023-04-29 17:23:22,220] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 23: [2023-04-29 17:23:22,220] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 9: [2023-04-29 17:23:22,220] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 9: [2023-04-29 17:23:22,220] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 23: [2023-04-29 17:23:22,221] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 9: [2023-04-29 17:23:22,220] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 9: [2023-04-29 17:23:22,221] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 9: [2023-04-29 17:23:22,221] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 9: [2023-04-29 17:23:22,221] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 11: [2023-04-29 17:23:22,221] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 9: [2023-04-29 17:23:22,221] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 11: [2023-04-29 17:23:22,221] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 23: [2023-04-29 17:23:22,221] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 9: [2023-04-29 17:23:22,221] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 11: [2023-04-29 17:23:22,221] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 27: [2023-04-29 17:23:22,222] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 19: [2023-04-29 17:23:22,222] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 19: [2023-04-29 17:23:22,222] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 19: [2023-04-29 17:23:22,223] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 19: [2023-04-29 17:23:22,223] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 19: [2023-04-29 17:23:22,223] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 19: [2023-04-29 17:23:22,223] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 19: [2023-04-29 17:23:22,223] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 19: [2023-04-29 17:23:22,223] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 9: [2023-04-29 17:23:22,226] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 9: [2023-04-29 17:23:22,226] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 9: [2023-04-29 17:23:22,226] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 9: [2023-04-29 17:23:22,226] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 9: [2023-04-29 17:23:22,226] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 9: [2023-04-29 17:23:22,226] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 9: [2023-04-29 17:23:22,226] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 9: [2023-04-29 17:23:22,227] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 19: [2023-04-29 17:23:22,227] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 19: [2023-04-29 17:23:22,227] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 19: [2023-04-29 17:23:22,228] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 26: [2023-04-29 17:23:22,229] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 26: [2023-04-29 17:23:22,229] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 19: [2023-04-29 17:23:22,229] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 13: [2023-04-29 17:23:22,232] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 19: [2023-04-29 17:23:22,232] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 19: [2023-04-29 17:23:22,232] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 19: [2023-04-29 17:23:22,232] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 13: [2023-04-29 17:23:22,233] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 19: [2023-04-29 17:23:22,233] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 27: [2023-04-29 17:23:22,234] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 27: [2023-04-29 17:23:22,234] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 26: [2023-04-29 17:23:22,235] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 26: [2023-04-29 17:23:22,237] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 27: [2023-04-29 17:23:22,236] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 27: [2023-04-29 17:23:22,236] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 27: [2023-04-29 17:23:22,237] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 27: [2023-04-29 17:23:22,237] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 27: [2023-04-29 17:23:22,237] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 4: [2023-04-29 17:23:22,239] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 4: [2023-04-29 17:23:22,239] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 25: [2023-04-29 17:23:22,239] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 25: [2023-04-29 17:23:22,239] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 4: [2023-04-29 17:23:22,240] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 4: [2023-04-29 17:23:22,240] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 4: [2023-04-29 17:23:22,240] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 4: [2023-04-29 17:23:22,240] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 4: [2023-04-29 17:23:22,240] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 4: [2023-04-29 17:23:22,240] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 26: [2023-04-29 17:23:22,241] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 25: [2023-04-29 17:23:22,241] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 29: [2023-04-29 17:23:22,241] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 25: [2023-04-29 17:23:22,241] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 25: [2023-04-29 17:23:22,241] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 25: [2023-04-29 17:23:22,241] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 25: [2023-04-29 17:23:22,241] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 25: [2023-04-29 17:23:22,241] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 29: [2023-04-29 17:23:22,242] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 29: [2023-04-29 17:23:22,242] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 26: [2023-04-29 17:23:22,242] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 7: [2023-04-29 17:23:22,241] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 7: [2023-04-29 17:23:22,241] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 7: [2023-04-29 17:23:22,241] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 29: [2023-04-29 17:23:22,242] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 29: [2023-04-29 17:23:22,242] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 29: [2023-04-29 17:23:22,242] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 29: [2023-04-29 17:23:22,242] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 29: [2023-04-29 17:23:22,242] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 26: [2023-04-29 17:23:22,243] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 25: [2023-04-29 17:23:22,244] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 25: [2023-04-29 17:23:22,244] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 4: [2023-04-29 17:23:22,244] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 4: [2023-04-29 17:23:22,244] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 26: [2023-04-29 17:23:22,245] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 29: [2023-04-29 17:23:22,245] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 13: [2023-04-29 17:23:22,246] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 29: [2023-04-29 17:23:22,250] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 25: [2023-04-29 17:23:22,251] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 4: [2023-04-29 17:23:22,251] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 25: [2023-04-29 17:23:22,252] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 4: [2023-04-29 17:23:22,252] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 4: [2023-04-29 17:23:22,252] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 25: [2023-04-29 17:23:22,252] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 4: [2023-04-29 17:23:22,252] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 25: [2023-04-29 17:23:22,252] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 4: [2023-04-29 17:23:22,253] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 25: [2023-04-29 17:23:22,253] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 13: [2023-04-29 17:23:22,253] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 25: [2023-04-29 17:23:22,253] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 4: [2023-04-29 17:23:22,254] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 22: [2023-04-29 17:23:22,254] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 29: [2023-04-29 17:23:22,254] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 29: [2023-04-29 17:23:22,254] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 29: [2023-04-29 17:23:22,254] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 29: [2023-04-29 17:23:22,255] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 29: [2023-04-29 17:23:22,255] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 29: [2023-04-29 17:23:22,256] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 13: [2023-04-29 17:23:22,256] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 13: [2023-04-29 17:23:22,257] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 13: [2023-04-29 17:23:22,257] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 13: [2023-04-29 17:23:22,257] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 7: [2023-04-29 17:23:22,257] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 7: [2023-04-29 17:23:22,257] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 7: [2023-04-29 17:23:22,257] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 7: [2023-04-29 17:23:22,257] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 7: [2023-04-29 17:23:22,258] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 13: [2023-04-29 17:23:22,259] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 13: [2023-04-29 17:23:22,259] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 20: [2023-04-29 17:23:22,260] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 7: [2023-04-29 17:23:22,263] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 7: [2023-04-29 17:23:22,263] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 22: [2023-04-29 17:23:22,263] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 7: [2023-04-29 17:23:22,264] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 30: [2023-04-29 17:23:22,264] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 30: [2023-04-29 17:23:22,265] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 30: [2023-04-29 17:23:22,265] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 30: [2023-04-29 17:23:22,265] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 30: [2023-04-29 17:23:22,265] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 30: [2023-04-29 17:23:22,265] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 30: [2023-04-29 17:23:22,265] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 30: [2023-04-29 17:23:22,265] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 11: [2023-04-29 17:23:22,268] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 11: [2023-04-29 17:23:22,268] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 11: [2023-04-29 17:23:22,268] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 23: [2023-04-29 17:23:22,268] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 13: [2023-04-29 17:23:22,269] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 23: [2023-04-29 17:23:22,269] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 10: [2023-04-29 17:23:22,270] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 10: [2023-04-29 17:23:22,270] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 10: [2023-04-29 17:23:22,270] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 10: [2023-04-29 17:23:22,270] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 20: [2023-04-29 17:23:22,272] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 20: [2023-04-29 17:23:22,274] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 27: [2023-04-29 17:23:22,275] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 22: [2023-04-29 17:23:22,275] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 27: [2023-04-29 17:23:22,275] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 30: [2023-04-29 17:23:22,275] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 30: [2023-04-29 17:23:22,275] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 30: [2023-04-29 17:23:22,276] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 30: [2023-04-29 17:23:22,276] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 27: [2023-04-29 17:23:22,276] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 30: [2023-04-29 17:23:22,276] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 30: [2023-04-29 17:23:22,276] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 10: [2023-04-29 17:23:22,277] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 10: [2023-04-29 17:23:22,277] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 10: [2023-04-29 17:23:22,277] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 10: [2023-04-29 17:23:22,277] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 30: [2023-04-29 17:23:22,278] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 30: [2023-04-29 17:23:22,278] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 27: [2023-04-29 17:23:22,279] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 27: [2023-04-29 17:23:22,279] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 27: [2023-04-29 17:23:22,279] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 19: [2023-04-29 17:23:22,279] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 19: [2023-04-29 17:23:22,279] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 19: [2023-04-29 17:23:22,279] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 27: [2023-04-29 17:23:22,280] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 11: [2023-04-29 17:23:22,282] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 11: [2023-04-29 17:23:22,282] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 20: [2023-04-29 17:23:22,283] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 13: [2023-04-29 17:23:22,283] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 9: [2023-04-29 17:23:22,284] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 9: [2023-04-29 17:23:22,284] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 9: [2023-04-29 17:23:22,284] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 9: [2023-04-29 17:23:22,284] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 20: [2023-04-29 17:23:22,284] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 20: [2023-04-29 17:23:22,284] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 20: [2023-04-29 17:23:22,284] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 22: [2023-04-29 17:23:22,284] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 20: [2023-04-29 17:23:22,286] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 20: [2023-04-29 17:23:22,286] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 11: [2023-04-29 17:23:22,286] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 9: [2023-04-29 17:23:22,286] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 9: [2023-04-29 17:23:22,286] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 9: [2023-04-29 17:23:22,286] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 9: [2023-04-29 17:23:22,286] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 11: [2023-04-29 17:23:22,287] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 11: [2023-04-29 17:23:22,287] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 22: [2023-04-29 17:23:22,287] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 13: [2023-04-29 17:23:22,287] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 7: [2023-04-29 17:23:22,287] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 7: [2023-04-29 17:23:22,287] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 22: [2023-04-29 17:23:22,287] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 22: [2023-04-29 17:23:22,287] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 7: [2023-04-29 17:23:22,287] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 13: [2023-04-29 17:23:22,288] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 22: [2023-04-29 17:23:22,288] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 22: [2023-04-29 17:23:22,288] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 22: [2023-04-29 17:23:22,288] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 13: [2023-04-29 17:23:22,289] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 23: [2023-04-29 17:23:22,290] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 23: [2023-04-29 17:23:22,290] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 23: [2023-04-29 17:23:22,290] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 7: [2023-04-29 17:23:22,290] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 7: [2023-04-29 17:23:22,290] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 13: [2023-04-29 17:23:22,290] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 11: [2023-04-29 17:23:22,291] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 11: [2023-04-29 17:23:22,291] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 11: [2023-04-29 17:23:22,292] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 23: [2023-04-29 17:23:22,293] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 23: [2023-04-29 17:23:22,293] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 23: [2023-04-29 17:23:22,293] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 23: [2023-04-29 17:23:22,293] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 24: [2023-04-29 17:23:22,293] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 23: [2023-04-29 17:23:22,294] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 24: [2023-04-29 17:23:22,294] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 24: [2023-04-29 17:23:22,294] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 24: [2023-04-29 17:23:22,294] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 24: [2023-04-29 17:23:22,294] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 24: [2023-04-29 17:23:22,294] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 24: [2023-04-29 17:23:22,294] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 24: [2023-04-29 17:23:22,294] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 29: [2023-04-29 17:23:22,295] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 10: [2023-04-29 17:23:22,295] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 4: [2023-04-29 17:23:22,295] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 4: [2023-04-29 17:23:22,295] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 25: [2023-04-29 17:23:22,296] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 25: [2023-04-29 17:23:22,296] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 24: [2023-04-29 17:23:22,296] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 19: [2023-04-29 17:23:22,297] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 19: [2023-04-29 17:23:22,297] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 20: [2023-04-29 17:23:22,298] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 19: [2023-04-29 17:23:22,300] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 10: [2023-04-29 17:23:22,300] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 19: [2023-04-29 17:23:22,300] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 10: [2023-04-29 17:23:22,300] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 10: [2023-04-29 17:23:22,300] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 19: [2023-04-29 17:23:22,300] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 19: [2023-04-29 17:23:22,300] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 19: [2023-04-29 17:23:22,302] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 20: [2023-04-29 17:23:22,302] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 19: [2023-04-29 17:23:22,302] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 15: [2023-04-29 17:23:22,305] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 15: [2023-04-29 17:23:22,305] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 15: [2023-04-29 17:23:22,305] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 15: [2023-04-29 17:23:22,305] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 15: [2023-04-29 17:23:22,305] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 15: [2023-04-29 17:23:22,305] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 15: [2023-04-29 17:23:22,305] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 15: [2023-04-29 17:23:22,305] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 24: [2023-04-29 17:23:22,306] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 24: [2023-04-29 17:23:22,306] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 24: [2023-04-29 17:23:22,306] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 24: [2023-04-29 17:23:22,307] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 24: [2023-04-29 17:23:22,307] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 24: [2023-04-29 17:23:22,308] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 24: [2023-04-29 17:23:22,308] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 9: [2023-04-29 17:23:22,309] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 10: [2023-04-29 17:23:22,309] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 10: [2023-04-29 17:23:22,309] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 9: [2023-04-29 17:23:22,309] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 11: [2023-04-29 17:23:22,309] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 11: [2023-04-29 17:23:22,311] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 10: [2023-04-29 17:23:22,311] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 10: [2023-04-29 17:23:22,311] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 29: [2023-04-29 17:23:22,312] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 29: [2023-04-29 17:23:22,313] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 9: [2023-04-29 17:23:22,313] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 21: [2023-04-29 17:23:22,313] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 21: [2023-04-29 17:23:22,313] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 21: [2023-04-29 17:23:22,313] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 21: [2023-04-29 17:23:22,314] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 21: [2023-04-29 17:23:22,314] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 21: [2023-04-29 17:23:22,314] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 21: [2023-04-29 17:23:22,314] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 9: [2023-04-29 17:23:22,314] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 9: [2023-04-29 17:23:22,314] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 9: [2023-04-29 17:23:22,314] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 20: [2023-04-29 17:23:22,314] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 21: [2023-04-29 17:23:22,314] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 20: [2023-04-29 17:23:22,314] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 20: [2023-04-29 17:23:22,314] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 22: [2023-04-29 17:23:22,315] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 11: [2023-04-29 17:23:22,315] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 11: [2023-04-29 17:23:22,315] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 9: [2023-04-29 17:23:22,315] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 20: [2023-04-29 17:23:22,315] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 11: [2023-04-29 17:23:22,316] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 9: [2023-04-29 17:23:22,316] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 25: [2023-04-29 17:23:22,316] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 4: [2023-04-29 17:23:22,316] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 25: [2023-04-29 17:23:22,317] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 20: [2023-04-29 17:23:22,317] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 4: [2023-04-29 17:23:22,318] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 15: [2023-04-29 17:23:22,318] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 15: [2023-04-29 17:23:22,318] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 21: [2023-04-29 17:23:22,318] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 21: [2023-04-29 17:23:22,318] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 21: [2023-04-29 17:23:22,319] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 15: [2023-04-29 17:23:22,319] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 15: [2023-04-29 17:23:22,319] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 21: [2023-04-29 17:23:22,320] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 22: [2023-04-29 17:23:22,319] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 15: [2023-04-29 17:23:22,320] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 22: [2023-04-29 17:23:22,320] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 15: [2023-04-29 17:23:22,320] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 22: [2023-04-29 17:23:22,320] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 21: [2023-04-29 17:23:22,320] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 23: [2023-04-29 17:23:22,320] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 21: [2023-04-29 17:23:22,320] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 25: [2023-04-29 17:23:22,320] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 25: [2023-04-29 17:23:22,320] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 21: [2023-04-29 17:23:22,321] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 15: [2023-04-29 17:23:22,321] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 21: [2023-04-29 17:23:22,321] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 15: [2023-04-29 17:23:22,321] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 4: [2023-04-29 17:23:22,321] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 4: [2023-04-29 17:23:22,321] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 22: [2023-04-29 17:23:22,322] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 25: [2023-04-29 17:23:22,323] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 25: [2023-04-29 17:23:22,323] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 25: [2023-04-29 17:23:22,323] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 25: [2023-04-29 17:23:22,323] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 23: [2023-04-29 17:23:22,323] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 23: [2023-04-29 17:23:22,324] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 23: [2023-04-29 17:23:22,325] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 4: [2023-04-29 17:23:22,324] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 4: [2023-04-29 17:23:22,324] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 4: [2023-04-29 17:23:22,324] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 4: [2023-04-29 17:23:22,324] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 23: [2023-04-29 17:23:22,325] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 22: [2023-04-29 17:23:22,325] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 5: [2023-04-29 17:23:22,328] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 5: [2023-04-29 17:23:22,328] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 19: [2023-04-29 17:23:22,330] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 23: [2023-04-29 17:23:22,330] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 5: [2023-04-29 17:23:22,330] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 5: [2023-04-29 17:23:22,330] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 5: [2023-04-29 17:23:22,330] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 5: [2023-04-29 17:23:22,330] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 5: [2023-04-29 17:23:22,331] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 5: [2023-04-29 17:23:22,331] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 5: [2023-04-29 17:23:22,332] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 19: [2023-04-29 17:23:22,332] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 5: [2023-04-29 17:23:22,333] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 19: [2023-04-29 17:23:22,333] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 19: [2023-04-29 17:23:22,333] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 19: [2023-04-29 17:23:22,334] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 29: [2023-04-29 17:23:22,334] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 24: [2023-04-29 17:23:22,338] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 29: [2023-04-29 17:23:22,338] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 29: [2023-04-29 17:23:22,340] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 29: [2023-04-29 17:23:22,340] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 29: [2023-04-29 17:23:22,340] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 29: [2023-04-29 17:23:22,340] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 29: [2023-04-29 17:23:22,340] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 5: [2023-04-29 17:23:22,340] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 5: [2023-04-29 17:23:22,341] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 18: [2023-04-29 17:23:22,340] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 18: [2023-04-29 17:23:22,340] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 18: [2023-04-29 17:23:22,340] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 18: [2023-04-29 17:23:22,341] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 18: [2023-04-29 17:23:22,341] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 18: [2023-04-29 17:23:22,341] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 18: [2023-04-29 17:23:22,341] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 5: [2023-04-29 17:23:22,341] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 18: [2023-04-29 17:23:22,341] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 5: [2023-04-29 17:23:22,341] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 5: [2023-04-29 17:23:22,342] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 5: [2023-04-29 17:23:22,343] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 30: [2023-04-29 17:23:22,347] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 25: [2023-04-29 17:23:22,349] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 25: [2023-04-29 17:23:22,352] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 25: [2023-04-29 17:23:22,353] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 25: [2023-04-29 17:23:22,353] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 18: [2023-04-29 17:23:22,354] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 18: [2023-04-29 17:23:22,354] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 4: [2023-04-29 17:23:22,354] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 4: [2023-04-29 17:23:22,354] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 25: [2023-04-29 17:23:22,355] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 18: [2023-04-29 17:23:22,355] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 18: [2023-04-29 17:23:22,356] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 18: [2023-04-29 17:23:22,356] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 18: [2023-04-29 17:23:22,356] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 18: [2023-04-29 17:23:22,356] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 18: [2023-04-29 17:23:22,357] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 25: [2023-04-29 17:23:22,357] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 4: [2023-04-29 17:23:22,357] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 4: [2023-04-29 17:23:22,357] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 12: [2023-04-29 17:23:22,358] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 12: [2023-04-29 17:23:22,358] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 12: [2023-04-29 17:23:22,358] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 12: [2023-04-29 17:23:22,359] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 12: [2023-04-29 17:23:22,359] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 12: [2023-04-29 17:23:22,359] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 12: [2023-04-29 17:23:22,359] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 12: [2023-04-29 17:23:22,359] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 24: [2023-04-29 17:23:22,360] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 4: [2023-04-29 17:23:22,362] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 4: [2023-04-29 17:23:22,362] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 12: [2023-04-29 17:23:22,364] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 12: [2023-04-29 17:23:22,365] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 12: [2023-04-29 17:23:22,366] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 12: [2023-04-29 17:23:22,366] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 12: [2023-04-29 17:23:22,366] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 12: [2023-04-29 17:23:22,366] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 12: [2023-04-29 17:23:22,367] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 29: [2023-04-29 17:23:22,367] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 12: [2023-04-29 17:23:22,368] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 30: [2023-04-29 17:23:22,368] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 30: [2023-04-29 17:23:22,368] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 30: [2023-04-29 17:23:22,368] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 30: [2023-04-29 17:23:22,368] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 30: [2023-04-29 17:23:22,368] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 30: [2023-04-29 17:23:22,368] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 30: [2023-04-29 17:23:22,368] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 29: [2023-04-29 17:23:22,370] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 21: [2023-04-29 17:23:22,372] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 21: [2023-04-29 17:23:22,372] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 21: [2023-04-29 17:23:22,372] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 30: [2023-04-29 17:23:22,372] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 29: [2023-04-29 17:23:22,373] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 29: [2023-04-29 17:23:22,374] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 29: [2023-04-29 17:23:22,375] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 29: [2023-04-29 17:23:22,375] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 24: [2023-04-29 17:23:22,380] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 24: [2023-04-29 17:23:22,380] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 24: [2023-04-29 17:23:22,380] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 5: [2023-04-29 17:23:22,382] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 5: [2023-04-29 17:23:22,382] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 24: [2023-04-29 17:23:22,384] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 24: [2023-04-29 17:23:22,384] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 24: [2023-04-29 17:23:22,384] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 24: [2023-04-29 17:23:22,384] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 21: [2023-04-29 17:23:22,386] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 21: [2023-04-29 17:23:22,386] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 21: [2023-04-29 17:23:22,386] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 21: [2023-04-29 17:23:22,386] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 21: [2023-04-29 17:23:22,386] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 28: [2023-04-29 17:23:22,395] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 28: [2023-04-29 17:23:22,395] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 28: [2023-04-29 17:23:22,395] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 28: [2023-04-29 17:23:22,395] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 28: [2023-04-29 17:23:22,395] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 28: [2023-04-29 17:23:22,395] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 28: [2023-04-29 17:23:22,395] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 28: [2023-04-29 17:23:22,396] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 15: [2023-04-29 17:23:22,399] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 15: [2023-04-29 17:23:22,399] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 15: [2023-04-29 17:23:22,399] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 15: [2023-04-29 17:23:22,399] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 15: [2023-04-29 17:23:22,401] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 15: [2023-04-29 17:23:22,401] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 15: [2023-04-29 17:23:22,401] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 15: [2023-04-29 17:23:22,401] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 30: [2023-04-29 17:23:22,402] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 21: [2023-04-29 17:23:22,402] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 21: [2023-04-29 17:23:22,402] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 21: [2023-04-29 17:23:22,402] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 5: [2023-04-29 17:23:22,402] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 5: [2023-04-29 17:23:22,402] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 30: [2023-04-29 17:23:22,404] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 30: [2023-04-29 17:23:22,405] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 28: [2023-04-29 17:23:22,407] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 28: [2023-04-29 17:23:22,408] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 30: [2023-04-29 17:23:22,409] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 30: [2023-04-29 17:23:22,409] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 30: [2023-04-29 17:23:22,409] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 30: [2023-04-29 17:23:22,409] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 28: [2023-04-29 17:23:22,409] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 5: [2023-04-29 17:23:22,410] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 5: [2023-04-29 17:23:22,410] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 5: [2023-04-29 17:23:22,410] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 5: [2023-04-29 17:23:22,410] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 28: [2023-04-29 17:23:22,410] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 28: [2023-04-29 17:23:22,411] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 28: [2023-04-29 17:23:22,411] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 5: [2023-04-29 17:23:22,411] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 5: [2023-04-29 17:23:22,411] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 28: [2023-04-29 17:23:22,411] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 28: [2023-04-29 17:23:22,412] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt... 24: [2023-04-29 17:23:22,413] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 21: [2023-04-29 17:23:22,414] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 21: [2023-04-29 17:23:22,414] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 24: [2023-04-29 17:23:22,414] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 24: [2023-04-29 17:23:22,415] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 21: [2023-04-29 17:23:22,416] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 24: [2023-04-29 17:23:22,419] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 24: [2023-04-29 17:23:22,419] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 21: [2023-04-29 17:23:22,419] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 21: [2023-04-29 17:23:22,419] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 12: [2023-04-29 17:23:22,419] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 12: [2023-04-29 17:23:22,419] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 24: [2023-04-29 17:23:22,420] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 12: [2023-04-29 17:23:22,420] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 24: [2023-04-29 17:23:22,422] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 12: [2023-04-29 17:23:22,432] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 18: [2023-04-29 17:23:22,432] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 18: [2023-04-29 17:23:22,432] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 12: [2023-04-29 17:23:22,432] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 12: [2023-04-29 17:23:22,432] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 12: [2023-04-29 17:23:22,432] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 12: [2023-04-29 17:23:22,432] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 18: [2023-04-29 17:23:22,435] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 15: [2023-04-29 17:23:22,436] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 14: [2023-04-29 17:23:22,436] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 14: [2023-04-29 17:23:22,436] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 14: [2023-04-29 17:23:22,436] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 15: [2023-04-29 17:23:22,437] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 14: [2023-04-29 17:23:22,437] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 14: [2023-04-29 17:23:22,437] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 14: [2023-04-29 17:23:22,437] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 14: [2023-04-29 17:23:22,437] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 14: [2023-04-29 17:23:22,437] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 15: [2023-04-29 17:23:22,438] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 16: [2023-04-29 17:23:22,438] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 16: [2023-04-29 17:23:22,438] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 16: [2023-04-29 17:23:22,439] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 16: [2023-04-29 17:23:22,439] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 16: [2023-04-29 17:23:22,439] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 16: [2023-04-29 17:23:22,439] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 16: [2023-04-29 17:23:22,439] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 16: [2023-04-29 17:23:22,439] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 14: [2023-04-29 17:23:22,440] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 15: [2023-04-29 17:23:22,441] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 12: [2023-04-29 17:23:22,441] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 15: [2023-04-29 17:23:22,442] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 15: [2023-04-29 17:23:22,443] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 15: [2023-04-29 17:23:22,443] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 12: [2023-04-29 17:23:22,443] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 5: [2023-04-29 17:23:22,443] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 5: [2023-04-29 17:23:22,443] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 14: [2023-04-29 17:23:22,443] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 15: [2023-04-29 17:23:22,445] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 16: [2023-04-29 17:23:22,445] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 16: [2023-04-29 17:23:22,445] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 16: [2023-04-29 17:23:22,446] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 5: [2023-04-29 17:23:22,446] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 16: [2023-04-29 17:23:22,446] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 16: [2023-04-29 17:23:22,446] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 16: [2023-04-29 17:23:22,446] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 16: [2023-04-29 17:23:22,447] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 12: [2023-04-29 17:23:22,447] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 16: [2023-04-29 17:23:22,447] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 18: [2023-04-29 17:23:22,447] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 18: [2023-04-29 17:23:22,447] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 18: [2023-04-29 17:23:22,447] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 18: [2023-04-29 17:23:22,447] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 18: [2023-04-29 17:23:22,447] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 5: [2023-04-29 17:23:22,447] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 14: [2023-04-29 17:23:22,447] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 14: [2023-04-29 17:23:22,447] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 14: [2023-04-29 17:23:22,447] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 14: [2023-04-29 17:23:22,448] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 5: [2023-04-29 17:23:22,448] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 5: [2023-04-29 17:23:22,448] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 14: [2023-04-29 17:23:22,449] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 14: [2023-04-29 17:23:22,449] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 18: [2023-04-29 17:23:22,459] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 18: [2023-04-29 17:23:22,460] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 18: [2023-04-29 17:23:22,461] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 12: [2023-04-29 17:23:22,462] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 12: [2023-04-29 17:23:22,463] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 12: [2023-04-29 17:23:22,463] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 12: [2023-04-29 17:23:22,464] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 12: [2023-04-29 17:23:22,465] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 6: [2023-04-29 17:23:22,469] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 6: [2023-04-29 17:23:22,469] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 6: [2023-04-29 17:23:22,469] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 6: [2023-04-29 17:23:22,470] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 6: [2023-04-29 17:23:22,470] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 6: [2023-04-29 17:23:22,470] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 6: [2023-04-29 17:23:22,470] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 6: [2023-04-29 17:23:22,470] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 6: [2023-04-29 17:23:22,473] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 6: [2023-04-29 17:23:22,474] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 6: [2023-04-29 17:23:22,479] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 6: [2023-04-29 17:23:22,479] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 6: [2023-04-29 17:23:22,479] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 6: [2023-04-29 17:23:22,480] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 18: [2023-04-29 17:23:22,480] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 6: [2023-04-29 17:23:22,480] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 6: [2023-04-29 17:23:22,481] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 18: [2023-04-29 17:23:22,481] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 18: [2023-04-29 17:23:22,482] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 18: [2023-04-29 17:23:22,483] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 18: [2023-04-29 17:23:22,483] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 1: [2023-04-29 17:23:22,483] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 1: [2023-04-29 17:23:22,483] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 1: [2023-04-29 17:23:22,484] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 1: [2023-04-29 17:23:22,484] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 1: [2023-04-29 17:23:22,484] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 1: [2023-04-29 17:23:22,484] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 1: [2023-04-29 17:23:22,484] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 1: [2023-04-29 17:23:22,485] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 28: [2023-04-29 17:23:22,485] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 28: [2023-04-29 17:23:22,485] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 28: [2023-04-29 17:23:22,485] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 1: [2023-04-29 17:23:22,489] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 1: [2023-04-29 17:23:22,490] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 1: [2023-04-29 17:23:22,490] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 1: [2023-04-29 17:23:22,490] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 1: [2023-04-29 17:23:22,490] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 1: [2023-04-29 17:23:22,490] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 1: [2023-04-29 17:23:22,490] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 1: [2023-04-29 17:23:22,492] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 14: [2023-04-29 17:23:22,493] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 16: [2023-04-29 17:23:22,498] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 16: [2023-04-29 17:23:22,498] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 14: [2023-04-29 17:23:22,503] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 28: [2023-04-29 17:23:22,504] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 28: [2023-04-29 17:23:22,504] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 28: [2023-04-29 17:23:22,504] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 28: [2023-04-29 17:23:22,504] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 28: [2023-04-29 17:23:22,504] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_13-model_00-model_states.pt. 16: [2023-04-29 17:23:22,507] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 28: [2023-04-29 17:23:22,512] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 14: [2023-04-29 17:23:22,512] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 28: [2023-04-29 17:23:22,512] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 28: [2023-04-29 17:23:22,513] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 16: [2023-04-29 17:23:22,513] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 16: [2023-04-29 17:23:22,513] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 16: [2023-04-29 17:23:22,513] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 16: [2023-04-29 17:23:22,513] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 16: [2023-04-29 17:23:22,513] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 3: [2023-04-29 17:23:22,519] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 3: [2023-04-29 17:23:22,519] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 3: [2023-04-29 17:23:22,521] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 3: [2023-04-29 17:23:22,521] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 3: [2023-04-29 17:23:22,521] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 3: [2023-04-29 17:23:22,521] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 3: [2023-04-29 17:23:22,521] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 3: [2023-04-29 17:23:22,521] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 16: [2023-04-29 17:23:22,521] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 3: [2023-04-29 17:23:22,522] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 3: [2023-04-29 17:23:22,523] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 16: [2023-04-29 17:23:22,524] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 14: [2023-04-29 17:23:22,524] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 6: [2023-04-29 17:23:22,525] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 6: [2023-04-29 17:23:22,525] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 14: [2023-04-29 17:23:22,528] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 3: [2023-04-29 17:23:22,528] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 3: [2023-04-29 17:23:22,528] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 3: [2023-04-29 17:23:22,528] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 3: [2023-04-29 17:23:22,529] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 3: [2023-04-29 17:23:22,529] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 3: [2023-04-29 17:23:22,529] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 16: [2023-04-29 17:23:22,533] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 26: [2023-04-29 17:23:22,534] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 26: [2023-04-29 17:23:22,534] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 26: [2023-04-29 17:23:22,535] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 26: [2023-04-29 17:23:22,535] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 26: [2023-04-29 17:23:22,535] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 26: [2023-04-29 17:23:22,535] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 26: [2023-04-29 17:23:22,535] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 26: [2023-04-29 17:23:22,536] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 2: [2023-04-29 17:23:22,536] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 2: [2023-04-29 17:23:22,536] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 14: [2023-04-29 17:23:22,537] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 14: [2023-04-29 17:23:22,537] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 14: [2023-04-29 17:23:22,537] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 14: [2023-04-29 17:23:22,537] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 14: [2023-04-29 17:23:22,537] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 7: [2023-04-29 17:23:22,537] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 7: [2023-04-29 17:23:22,537] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 7: [2023-04-29 17:23:22,537] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 7: [2023-04-29 17:23:22,538] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 7: [2023-04-29 17:23:22,538] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 7: [2023-04-29 17:23:22,538] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 7: [2023-04-29 17:23:22,538] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 7: [2023-04-29 17:23:22,538] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 28: [2023-04-29 17:23:22,539] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 28: [2023-04-29 17:23:22,539] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 28: [2023-04-29 17:23:22,539] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 17: [2023-04-29 17:23:22,539] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 17: [2023-04-29 17:23:22,540] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 2: [2023-04-29 17:23:22,540] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 2: [2023-04-29 17:23:22,540] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 2: [2023-04-29 17:23:22,541] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 16: [2023-04-29 17:23:22,541] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 16: [2023-04-29 17:23:22,541] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 26: [2023-04-29 17:23:22,540] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 2: [2023-04-29 17:23:22,541] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 2: [2023-04-29 17:23:22,541] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 2: [2023-04-29 17:23:22,541] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 2: [2023-04-29 17:23:22,541] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 2: [2023-04-29 17:23:22,541] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 16: [2023-04-29 17:23:22,541] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 26: [2023-04-29 17:23:22,542] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 28: [2023-04-29 17:23:22,542] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 16: [2023-04-29 17:23:22,542] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 26: [2023-04-29 17:23:22,542] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 7: [2023-04-29 17:23:22,542] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 7: [2023-04-29 17:23:22,542] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 7: [2023-04-29 17:23:22,542] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 26: [2023-04-29 17:23:22,543] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 26: [2023-04-29 17:23:22,543] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 28: [2023-04-29 17:23:22,543] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 31: [2023-04-29 17:23:22,543] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 31: [2023-04-29 17:23:22,543] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 31: [2023-04-29 17:23:22,543] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 26: [2023-04-29 17:23:22,543] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 17: [2023-04-29 17:23:22,542] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 17: [2023-04-29 17:23:22,542] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 17: [2023-04-29 17:23:22,543] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 17: [2023-04-29 17:23:22,543] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 17: [2023-04-29 17:23:22,543] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 31: [2023-04-29 17:23:22,543] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 31: [2023-04-29 17:23:22,543] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 31: [2023-04-29 17:23:22,543] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 31: [2023-04-29 17:23:22,543] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 17: [2023-04-29 17:23:22,543] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 26: [2023-04-29 17:23:22,543] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 16: [2023-04-29 17:23:22,543] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 31: [2023-04-29 17:23:22,543] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 26: [2023-04-29 17:23:22,544] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 7: [2023-04-29 17:23:22,544] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 17: [2023-04-29 17:23:22,544] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 7: [2023-04-29 17:23:22,544] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 7: [2023-04-29 17:23:22,544] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 7: [2023-04-29 17:23:22,544] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 7: [2023-04-29 17:23:22,545] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 2: [2023-04-29 17:23:22,545] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 19: [2023-04-29 17:23:22,545] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 19: [2023-04-29 17:23:22,545] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 6: [2023-04-29 17:23:22,546] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 6: [2023-04-29 17:23:22,546] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 6: [2023-04-29 17:23:22,546] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 1: [2023-04-29 17:23:22,547] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 1: [2023-04-29 17:23:22,547] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 1: [2023-04-29 17:23:22,547] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 1: [2023-04-29 17:23:22,547] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 31: [2023-04-29 17:23:22,547] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 31: [2023-04-29 17:23:22,547] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 31: [2023-04-29 17:23:22,548] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 17: [2023-04-29 17:23:22,548] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 17: [2023-04-29 17:23:22,549] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 31: [2023-04-29 17:23:22,549] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 31: [2023-04-29 17:23:22,549] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 19: [2023-04-29 17:23:22,549] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 19: [2023-04-29 17:23:22,549] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 19: [2023-04-29 17:23:22,549] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 19: [2023-04-29 17:23:22,549] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 19: [2023-04-29 17:23:22,549] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 31: [2023-04-29 17:23:22,550] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 14: [2023-04-29 17:23:22,550] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 19: [2023-04-29 17:23:22,550] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 31: [2023-04-29 17:23:22,550] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 2: [2023-04-29 17:23:22,550] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 31: [2023-04-29 17:23:22,550] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 19: [2023-04-29 17:23:22,550] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 2: [2023-04-29 17:23:22,550] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 19: [2023-04-29 17:23:22,550] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 2: [2023-04-29 17:23:22,551] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 17: [2023-04-29 17:23:22,551] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 1: [2023-04-29 17:23:22,551] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 2: [2023-04-29 17:23:22,552] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 1: [2023-04-29 17:23:22,552] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 1: [2023-04-29 17:23:22,552] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 1: [2023-04-29 17:23:22,552] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 2: [2023-04-29 17:23:22,552] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 17: [2023-04-29 17:23:22,552] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 13: [2023-04-29 17:23:22,553] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 13: [2023-04-29 17:23:22,553] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 17: [2023-04-29 17:23:22,553] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 19: [2023-04-29 17:23:22,553] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 19: [2023-04-29 17:23:22,554] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 13: [2023-04-29 17:23:22,554] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 13: [2023-04-29 17:23:22,554] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 13: [2023-04-29 17:23:22,554] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 13: [2023-04-29 17:23:22,554] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 17: [2023-04-29 17:23:22,554] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 13: [2023-04-29 17:23:22,554] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 13: [2023-04-29 17:23:22,554] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 17: [2023-04-29 17:23:22,554] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 6: [2023-04-29 17:23:22,555] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 6: [2023-04-29 17:23:22,555] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 6: [2023-04-29 17:23:22,555] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 6: [2023-04-29 17:23:22,555] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 6: [2023-04-29 17:23:22,555] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 22: [2023-04-29 17:23:22,556] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 22: [2023-04-29 17:23:22,556] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 22: [2023-04-29 17:23:22,557] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 19: [2023-04-29 17:23:22,557] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 22: [2023-04-29 17:23:22,557] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 22: [2023-04-29 17:23:22,557] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 22: [2023-04-29 17:23:22,557] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 22: [2023-04-29 17:23:22,557] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 22: [2023-04-29 17:23:22,557] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 19: [2023-04-29 17:23:22,558] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 19: [2023-04-29 17:23:22,558] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 19: [2023-04-29 17:23:22,558] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 13: [2023-04-29 17:23:22,558] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 13: [2023-04-29 17:23:22,560] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 22: [2023-04-29 17:23:22,560] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 22: [2023-04-29 17:23:22,560] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 13: [2023-04-29 17:23:22,561] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 13: [2023-04-29 17:23:22,564] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 13: [2023-04-29 17:23:22,564] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 13: [2023-04-29 17:23:22,565] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 13: [2023-04-29 17:23:22,566] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 13: [2023-04-29 17:23:22,566] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 14: [2023-04-29 17:23:22,567] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 22: [2023-04-29 17:23:22,567] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 22: [2023-04-29 17:23:22,567] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 22: [2023-04-29 17:23:22,567] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 22: [2023-04-29 17:23:22,568] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 22: [2023-04-29 17:23:22,568] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 14: [2023-04-29 17:23:22,568] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 22: [2023-04-29 17:23:22,569] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 14: [2023-04-29 17:23:22,570] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 6: [2023-04-29 17:23:22,570] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 14: [2023-04-29 17:23:22,571] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 14: [2023-04-29 17:23:22,571] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 3: [2023-04-29 17:23:22,572] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 3: [2023-04-29 17:23:22,572] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 1: [2023-04-29 17:23:22,572] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 1: [2023-04-29 17:23:22,572] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 1: [2023-04-29 17:23:22,575] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 1: [2023-04-29 17:23:22,575] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 1: [2023-04-29 17:23:22,578] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 1: [2023-04-29 17:23:22,581] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 1: [2023-04-29 17:23:22,581] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 1: [2023-04-29 17:23:22,581] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 27: [2023-04-29 17:23:22,581] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 27: [2023-04-29 17:23:22,581] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 27: [2023-04-29 17:23:22,581] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 27: [2023-04-29 17:23:22,582] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 27: [2023-04-29 17:23:22,581] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 27: [2023-04-29 17:23:22,582] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 27: [2023-04-29 17:23:22,582] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 27: [2023-04-29 17:23:22,582] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 27: [2023-04-29 17:23:22,585] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 6: [2023-04-29 17:23:22,586] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 2: [2023-04-29 17:23:22,586] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 6: [2023-04-29 17:23:22,587] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 6: [2023-04-29 17:23:22,589] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 6: [2023-04-29 17:23:22,589] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 6: [2023-04-29 17:23:22,590] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 3: [2023-04-29 17:23:22,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 3: [2023-04-29 17:23:22,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 27: [2023-04-29 17:23:22,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 27: [2023-04-29 17:23:22,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 27: [2023-04-29 17:23:22,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 27: [2023-04-29 17:23:22,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 27: [2023-04-29 17:23:22,595] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 7: [2023-04-29 17:23:22,594] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 7: [2023-04-29 17:23:22,594] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 7: [2023-04-29 17:23:22,594] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 27: [2023-04-29 17:23:22,595] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 27: [2023-04-29 17:23:22,595] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 2: [2023-04-29 17:23:22,597] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 17: [2023-04-29 17:23:22,598] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 26: [2023-04-29 17:23:22,599] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 26: [2023-04-29 17:23:22,599] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 26: [2023-04-29 17:23:22,599] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 3: [2023-04-29 17:23:22,599] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 3: [2023-04-29 17:23:22,599] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 3: [2023-04-29 17:23:22,599] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 3: [2023-04-29 17:23:22,599] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 3: [2023-04-29 17:23:22,599] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 3: [2023-04-29 17:23:22,599] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 31: [2023-04-29 17:23:22,600] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 31: [2023-04-29 17:23:22,600] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 31: [2023-04-29 17:23:22,600] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 17: [2023-04-29 17:23:22,601] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 26: [2023-04-29 17:23:22,604] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 26: [2023-04-29 17:23:22,605] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 26: [2023-04-29 17:23:22,605] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 26: [2023-04-29 17:23:22,605] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 26: [2023-04-29 17:23:22,605] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 19: [2023-04-29 17:23:22,605] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 19: [2023-04-29 17:23:22,605] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 19: [2023-04-29 17:23:22,605] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 2: [2023-04-29 17:23:22,606] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 2: [2023-04-29 17:23:22,606] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 7: [2023-04-29 17:23:22,610] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 7: [2023-04-29 17:23:22,610] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 7: [2023-04-29 17:23:22,610] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 7: [2023-04-29 17:23:22,610] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 7: [2023-04-29 17:23:22,610] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 13: [2023-04-29 17:23:22,611] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 22: [2023-04-29 17:23:22,613] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 22: [2023-04-29 17:23:22,613] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 7: [2023-04-29 17:23:22,614] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 31: [2023-04-29 17:23:22,615] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 31: [2023-04-29 17:23:22,615] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 31: [2023-04-29 17:23:22,615] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 31: [2023-04-29 17:23:22,615] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 31: [2023-04-29 17:23:22,616] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 7: [2023-04-29 17:23:22,616] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 13: [2023-04-29 17:23:22,616] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 7: [2023-04-29 17:23:22,616] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 2: [2023-04-29 17:23:22,617] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 2: [2023-04-29 17:23:22,617] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 2: [2023-04-29 17:23:22,617] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 2: [2023-04-29 17:23:22,617] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 2: [2023-04-29 17:23:22,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 19: [2023-04-29 17:23:22,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 17: [2023-04-29 17:23:22,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 2: [2023-04-29 17:23:22,620] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 31: [2023-04-29 17:23:22,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 17: [2023-04-29 17:23:22,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 17: [2023-04-29 17:23:22,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 31: [2023-04-29 17:23:22,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 17: [2023-04-29 17:23:22,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 31: [2023-04-29 17:23:22,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 17: [2023-04-29 17:23:22,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 26: [2023-04-29 17:23:22,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 26: [2023-04-29 17:23:22,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 17: [2023-04-29 17:23:22,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 17: [2023-04-29 17:23:22,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 2: [2023-04-29 17:23:22,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 3: [2023-04-29 17:23:22,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 3: [2023-04-29 17:23:22,627] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 19: [2023-04-29 17:23:22,628] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 19: [2023-04-29 17:23:22,628] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 19: [2023-04-29 17:23:22,628] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 19: [2023-04-29 17:23:22,628] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 3: [2023-04-29 17:23:22,628] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 26: [2023-04-29 17:23:22,629] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 13: [2023-04-29 17:23:22,631] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 13: [2023-04-29 17:23:22,632] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 26: [2023-04-29 17:23:22,632] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 3: [2023-04-29 17:23:22,632] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 3: [2023-04-29 17:23:22,632] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 19: [2023-04-29 17:23:22,632] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 19: [2023-04-29 17:23:22,632] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 19: [2023-04-29 17:23:22,632] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 22: [2023-04-29 17:23:22,633] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 3: [2023-04-29 17:23:22,633] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 26: [2023-04-29 17:23:22,633] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 26: [2023-04-29 17:23:22,634] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 13: [2023-04-29 17:23:22,634] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 13: [2023-04-29 17:23:22,634] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 22: [2023-04-29 17:23:22,634] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 21: [2023-04-29 17:23:22,634] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 21: [2023-04-29 17:23:22,634] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 21: [2023-04-29 17:23:22,634] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 21: [2023-04-29 17:23:22,634] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 21: [2023-04-29 17:23:22,634] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 21: [2023-04-29 17:23:22,634] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 21: [2023-04-29 17:23:22,634] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 27: [2023-04-29 17:23:22,634] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 26: [2023-04-29 17:23:22,635] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 21: [2023-04-29 17:23:22,635] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 13: [2023-04-29 17:23:22,635] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 13: [2023-04-29 17:23:22,635] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 13: [2023-04-29 17:23:22,636] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 17: [2023-04-29 17:23:22,636] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 26: [2023-04-29 17:23:22,636] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 22: [2023-04-29 17:23:22,637] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 22: [2023-04-29 17:23:22,637] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 22: [2023-04-29 17:23:22,637] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 7: [2023-04-29 17:23:22,638] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 7: [2023-04-29 17:23:22,638] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 7: [2023-04-29 17:23:22,638] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 13: [2023-04-29 17:23:22,638] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 22: [2023-04-29 17:23:22,638] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 22: [2023-04-29 17:23:22,638] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 22: [2023-04-29 17:23:22,638] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 21: [2023-04-29 17:23:22,639] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 21: [2023-04-29 17:23:22,639] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 7: [2023-04-29 17:23:22,640] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 21: [2023-04-29 17:23:22,640] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 21: [2023-04-29 17:23:22,640] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 21: [2023-04-29 17:23:22,641] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 21: [2023-04-29 17:23:22,641] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 21: [2023-04-29 17:23:22,641] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 21: [2023-04-29 17:23:22,642] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 7: [2023-04-29 17:23:22,642] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 31: [2023-04-29 17:23:22,642] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 10: [2023-04-29 17:23:22,643] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 10: [2023-04-29 17:23:22,643] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 10: [2023-04-29 17:23:22,643] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 10: [2023-04-29 17:23:22,643] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 10: [2023-04-29 17:23:22,644] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 10: [2023-04-29 17:23:22,644] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 10: [2023-04-29 17:23:22,644] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 10: [2023-04-29 17:23:22,644] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 31: [2023-04-29 17:23:22,644] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 19: [2023-04-29 17:23:22,645] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 31: [2023-04-29 17:23:22,645] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 31: [2023-04-29 17:23:22,646] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 31: [2023-04-29 17:23:22,647] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 2: [2023-04-29 17:23:22,647] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 2: [2023-04-29 17:23:22,648] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 10: [2023-04-29 17:23:22,648] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 10: [2023-04-29 17:23:22,648] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 10: [2023-04-29 17:23:22,649] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 10: [2023-04-29 17:23:22,649] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 2: [2023-04-29 17:23:22,650] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 2: [2023-04-29 17:23:22,650] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 2: [2023-04-29 17:23:22,651] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 10: [2023-04-29 17:23:22,651] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 10: [2023-04-29 17:23:22,652] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 10: [2023-04-29 17:23:22,653] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 10: [2023-04-29 17:23:22,654] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 27: [2023-04-29 17:23:22,654] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 17: [2023-04-29 17:23:22,655] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 19: [2023-04-29 17:23:22,655] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 19: [2023-04-29 17:23:22,656] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 19: [2023-04-29 17:23:22,656] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 12: [2023-04-29 17:23:22,657] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 12: [2023-04-29 17:23:22,657] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 13: [2023-04-29 17:23:22,658] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 17: [2023-04-29 17:23:22,658] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 12: [2023-04-29 17:23:22,658] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 12: [2023-04-29 17:23:22,658] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 19: [2023-04-29 17:23:22,658] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 12: [2023-04-29 17:23:22,658] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 12: [2023-04-29 17:23:22,658] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 12: [2023-04-29 17:23:22,658] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 12: [2023-04-29 17:23:22,659] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 17: [2023-04-29 17:23:22,659] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 20: [2023-04-29 17:23:22,660] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 20: [2023-04-29 17:23:22,660] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 20: [2023-04-29 17:23:22,660] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 17: [2023-04-29 17:23:22,661] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 20: [2023-04-29 17:23:22,661] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 20: [2023-04-29 17:23:22,661] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 20: [2023-04-29 17:23:22,661] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 20: [2023-04-29 17:23:22,661] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 20: [2023-04-29 17:23:22,662] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 12: [2023-04-29 17:23:22,662] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 17: [2023-04-29 17:23:22,662] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 12: [2023-04-29 17:23:22,663] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 12: [2023-04-29 17:23:22,664] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 13: [2023-04-29 17:23:22,665] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 12: [2023-04-29 17:23:22,665] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 12: [2023-04-29 17:23:22,666] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 20: [2023-04-29 17:23:22,666] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 12: [2023-04-29 17:23:22,666] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 20: [2023-04-29 17:23:22,666] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 17: [2023-04-29 17:23:22,666] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 8: [2023-04-29 17:23:22,666] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 8: [2023-04-29 17:23:22,666] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 8: [2023-04-29 17:23:22,666] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 8: [2023-04-29 17:23:22,666] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 8: [2023-04-29 17:23:22,666] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 9: [2023-04-29 17:23:22,666] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 9: [2023-04-29 17:23:22,666] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 9: [2023-04-29 17:23:22,666] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 9: [2023-04-29 17:23:22,666] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 9: [2023-04-29 17:23:22,666] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 8: [2023-04-29 17:23:22,666] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 8: [2023-04-29 17:23:22,666] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 9: [2023-04-29 17:23:22,666] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 9: [2023-04-29 17:23:22,666] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 13: [2023-04-29 17:23:22,667] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 12: [2023-04-29 17:23:22,667] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 8: [2023-04-29 17:23:22,667] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 9: [2023-04-29 17:23:22,667] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 27: [2023-04-29 17:23:22,667] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 13: [2023-04-29 17:23:22,667] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 27: [2023-04-29 17:23:22,667] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 20: [2023-04-29 17:23:22,667] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 13: [2023-04-29 17:23:22,667] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 22: [2023-04-29 17:23:22,667] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 12: [2023-04-29 17:23:22,668] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 22: [2023-04-29 17:23:22,668] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 13: [2023-04-29 17:23:22,670] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 27: [2023-04-29 17:23:22,669] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 20: [2023-04-29 17:23:22,670] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 27: [2023-04-29 17:23:22,671] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 27: [2023-04-29 17:23:22,671] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 27: [2023-04-29 17:23:22,671] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 9: [2023-04-29 17:23:22,671] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 20: [2023-04-29 17:23:22,671] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 27: [2023-04-29 17:23:22,671] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 9: [2023-04-29 17:23:22,671] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 9: [2023-04-29 17:23:22,672] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 9: [2023-04-29 17:23:22,672] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 9: [2023-04-29 17:23:22,672] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 20: [2023-04-29 17:23:22,672] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 9: [2023-04-29 17:23:22,672] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 9: [2023-04-29 17:23:22,672] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 20: [2023-04-29 17:23:22,672] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 4: [2023-04-29 17:23:22,672] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 4: [2023-04-29 17:23:22,672] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 9: [2023-04-29 17:23:22,672] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 22: [2023-04-29 17:23:22,672] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 20: [2023-04-29 17:23:22,673] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 4: [2023-04-29 17:23:22,673] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 4: [2023-04-29 17:23:22,673] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 4: [2023-04-29 17:23:22,673] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 4: [2023-04-29 17:23:22,673] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 4: [2023-04-29 17:23:22,673] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 22: [2023-04-29 17:23:22,673] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 22: [2023-04-29 17:23:22,673] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 4: [2023-04-29 17:23:22,673] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 8: [2023-04-29 17:23:22,673] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 8: [2023-04-29 17:23:22,674] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 8: [2023-04-29 17:23:22,675] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 8: [2023-04-29 17:23:22,675] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 8: [2023-04-29 17:23:22,675] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 8: [2023-04-29 17:23:22,675] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 22: [2023-04-29 17:23:22,676] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 8: [2023-04-29 17:23:22,676] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 8: [2023-04-29 17:23:22,676] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 4: [2023-04-29 17:23:22,677] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 4: [2023-04-29 17:23:22,677] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 4: [2023-04-29 17:23:22,684] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 4: [2023-04-29 17:23:22,685] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 4: [2023-04-29 17:23:22,685] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 4: [2023-04-29 17:23:22,686] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 4: [2023-04-29 17:23:22,686] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 4: [2023-04-29 17:23:22,687] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 30: [2023-04-29 17:23:22,692] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 30: [2023-04-29 17:23:22,693] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 30: [2023-04-29 17:23:22,693] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 30: [2023-04-29 17:23:22,693] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 30: [2023-04-29 17:23:22,693] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 30: [2023-04-29 17:23:22,693] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 30: [2023-04-29 17:23:22,693] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 30: [2023-04-29 17:23:22,693] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 21: [2023-04-29 17:23:22,693] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 21: [2023-04-29 17:23:22,693] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 21: [2023-04-29 17:23:22,693] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 27: [2023-04-29 17:23:22,695] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 10: [2023-04-29 17:23:22,699] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 10: [2023-04-29 17:23:22,699] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 27: [2023-04-29 17:23:22,703] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 30: [2023-04-29 17:23:22,702] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 30: [2023-04-29 17:23:22,703] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 30: [2023-04-29 17:23:22,704] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 30: [2023-04-29 17:23:22,704] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 30: [2023-04-29 17:23:22,704] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 30: [2023-04-29 17:23:22,704] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 30: [2023-04-29 17:23:22,705] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 27: [2023-04-29 17:23:22,705] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 30: [2023-04-29 17:23:22,705] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 27: [2023-04-29 17:23:22,707] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 21: [2023-04-29 17:23:22,707] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 21: [2023-04-29 17:23:22,707] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 21: [2023-04-29 17:23:22,707] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 21: [2023-04-29 17:23:22,707] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 21: [2023-04-29 17:23:22,707] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 12: [2023-04-29 17:23:22,708] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 27: [2023-04-29 17:23:22,710] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 27: [2023-04-29 17:23:22,710] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 27: [2023-04-29 17:23:22,710] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 10: [2023-04-29 17:23:22,712] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 10: [2023-04-29 17:23:22,712] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 5: [2023-04-29 17:23:22,715] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 10: [2023-04-29 17:23:22,715] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 10: [2023-04-29 17:23:22,715] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 10: [2023-04-29 17:23:22,715] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 10: [2023-04-29 17:23:22,715] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 5: [2023-04-29 17:23:22,716] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 21: [2023-04-29 17:23:22,717] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 21: [2023-04-29 17:23:22,718] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 21: [2023-04-29 17:23:22,718] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 5: [2023-04-29 17:23:22,719] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 5: [2023-04-29 17:23:22,719] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 5: [2023-04-29 17:23:22,719] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 5: [2023-04-29 17:23:22,719] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 5: [2023-04-29 17:23:22,719] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 5: [2023-04-29 17:23:22,720] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 12: [2023-04-29 17:23:22,720] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 5: [2023-04-29 17:23:22,720] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 20: [2023-04-29 17:23:22,720] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 20: [2023-04-29 17:23:22,720] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 10: [2023-04-29 17:23:22,720] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 20: [2023-04-29 17:23:22,723] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 5: [2023-04-29 17:23:22,723] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 5: [2023-04-29 17:23:22,723] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 0: [2023-04-29 17:23:22,724] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 0: [2023-04-29 17:23:22,724] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 0: [2023-04-29 17:23:22,724] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 10: [2023-04-29 17:23:22,724] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 0: [2023-04-29 17:23:22,724] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 0: [2023-04-29 17:23:22,724] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 0: [2023-04-29 17:23:22,724] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 0: [2023-04-29 17:23:22,724] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 12: [2023-04-29 17:23:22,724] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 0: [2023-04-29 17:23:22,725] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 12: [2023-04-29 17:23:22,725] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 11: [2023-04-29 17:23:22,725] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 11: [2023-04-29 17:23:22,725] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 9: [2023-04-29 17:23:22,724] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 11: [2023-04-29 17:23:22,725] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 11: [2023-04-29 17:23:22,726] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 11: [2023-04-29 17:23:22,726] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 11: [2023-04-29 17:23:22,726] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 11: [2023-04-29 17:23:22,726] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 11: [2023-04-29 17:23:22,726] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 5: [2023-04-29 17:23:22,726] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 18: [2023-04-29 17:23:22,727] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 18: [2023-04-29 17:23:22,727] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 18: [2023-04-29 17:23:22,727] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 18: [2023-04-29 17:23:22,727] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 18: [2023-04-29 17:23:22,727] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 18: [2023-04-29 17:23:22,727] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 18: [2023-04-29 17:23:22,727] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 4: [2023-04-29 17:23:22,727] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 14: [2023-04-29 17:23:22,727] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 14: [2023-04-29 17:23:22,727] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 14: [2023-04-29 17:23:22,727] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 18: [2023-04-29 17:23:22,728] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 14: [2023-04-29 17:23:22,728] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 14: [2023-04-29 17:23:22,728] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 14: [2023-04-29 17:23:22,728] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 14: [2023-04-29 17:23:22,728] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 5: [2023-04-29 17:23:22,728] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 14: [2023-04-29 17:23:22,728] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 8: [2023-04-29 17:23:22,728] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 8: [2023-04-29 17:23:22,728] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 4: [2023-04-29 17:23:22,728] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 5: [2023-04-29 17:23:22,729] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 23: [2023-04-29 17:23:22,729] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 23: [2023-04-29 17:23:22,729] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 23: [2023-04-29 17:23:22,729] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 23: [2023-04-29 17:23:22,729] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 23: [2023-04-29 17:23:22,729] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 12: [2023-04-29 17:23:22,729] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 5: [2023-04-29 17:23:22,730] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 23: [2023-04-29 17:23:22,729] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 23: [2023-04-29 17:23:22,729] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 9: [2023-04-29 17:23:22,729] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 9: [2023-04-29 17:23:22,729] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 9: [2023-04-29 17:23:22,729] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 9: [2023-04-29 17:23:22,729] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 8: [2023-04-29 17:23:22,730] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 11: [2023-04-29 17:23:22,729] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 5: [2023-04-29 17:23:22,730] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 11: [2023-04-29 17:23:22,730] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 23: [2023-04-29 17:23:22,730] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 11: [2023-04-29 17:23:22,730] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 24: [2023-04-29 17:23:22,730] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 24: [2023-04-29 17:23:22,731] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 24: [2023-04-29 17:23:22,731] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 24: [2023-04-29 17:23:22,731] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 24: [2023-04-29 17:23:22,731] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 24: [2023-04-29 17:23:22,731] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 24: [2023-04-29 17:23:22,731] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 14: [2023-04-29 17:23:22,731] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 24: [2023-04-29 17:23:22,731] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 0: [2023-04-29 17:23:22,733] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 20: [2023-04-29 17:23:22,734] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 20: [2023-04-29 17:23:22,734] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 24: [2023-04-29 17:23:22,734] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 23: [2023-04-29 17:23:22,734] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 21: [2023-04-29 17:23:22,735] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 12: [2023-04-29 17:23:22,735] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 21: [2023-04-29 17:23:22,735] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 9: [2023-04-29 17:23:22,735] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 23: [2023-04-29 17:23:22,735] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 9: [2023-04-29 17:23:22,735] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 9: [2023-04-29 17:23:22,736] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 11: [2023-04-29 17:23:22,735] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 11: [2023-04-29 17:23:22,736] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 21: [2023-04-29 17:23:22,736] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 10: [2023-04-29 17:23:22,736] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 11: [2023-04-29 17:23:22,736] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 20: [2023-04-29 17:23:22,736] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 20: [2023-04-29 17:23:22,736] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 20: [2023-04-29 17:23:22,736] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 12: [2023-04-29 17:23:22,736] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 12: [2023-04-29 17:23:22,736] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 12: [2023-04-29 17:23:22,736] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 11: [2023-04-29 17:23:22,737] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 8: [2023-04-29 17:23:22,737] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 8: [2023-04-29 17:23:22,737] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 8: [2023-04-29 17:23:22,737] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 8: [2023-04-29 17:23:22,737] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 8: [2023-04-29 17:23:22,737] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 21: [2023-04-29 17:23:22,737] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 21: [2023-04-29 17:23:22,737] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 11: [2023-04-29 17:23:22,737] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 0: [2023-04-29 17:23:22,738] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 0: [2023-04-29 17:23:22,738] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 14: [2023-04-29 17:23:22,739] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 14: [2023-04-29 17:23:22,739] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 0: [2023-04-29 17:23:22,739] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 0: [2023-04-29 17:23:22,739] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 14: [2023-04-29 17:23:22,739] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 0: [2023-04-29 17:23:22,739] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 14: [2023-04-29 17:23:22,740] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 23: [2023-04-29 17:23:22,739] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 23: [2023-04-29 17:23:22,740] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 18: [2023-04-29 17:23:22,740] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 18: [2023-04-29 17:23:22,740] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 14: [2023-04-29 17:23:22,740] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 0: [2023-04-29 17:23:22,740] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 23: [2023-04-29 17:23:22,740] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 18: [2023-04-29 17:23:22,741] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 23: [2023-04-29 17:23:22,741] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 18: [2023-04-29 17:23:22,741] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 0: [2023-04-29 17:23:22,741] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 14: [2023-04-29 17:23:22,741] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 10: [2023-04-29 17:23:22,741] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 14: [2023-04-29 17:23:22,741] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 23: [2023-04-29 17:23:22,741] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 18: [2023-04-29 17:23:22,741] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 23: [2023-04-29 17:23:22,742] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 18: [2023-04-29 17:23:22,742] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 18: [2023-04-29 17:23:22,742] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 12: [2023-04-29 17:23:22,743] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 18: [2023-04-29 17:23:22,743] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 20: [2023-04-29 17:23:22,743] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 10: [2023-04-29 17:23:22,744] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 24: [2023-04-29 17:23:22,743] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 24: [2023-04-29 17:23:22,743] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 24: [2023-04-29 17:23:22,744] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 24: [2023-04-29 17:23:22,744] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 24: [2023-04-29 17:23:22,744] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 20: [2023-04-29 17:23:22,745] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 24: [2023-04-29 17:23:22,745] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 24: [2023-04-29 17:23:22,746] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 9: [2023-04-29 17:23:22,747] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 10: [2023-04-29 17:23:22,747] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 15: [2023-04-29 17:23:22,747] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 15: [2023-04-29 17:23:22,747] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 15: [2023-04-29 17:23:22,747] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 15: [2023-04-29 17:23:22,747] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 15: [2023-04-29 17:23:22,747] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 15: [2023-04-29 17:23:22,747] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 15: [2023-04-29 17:23:22,747] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 16: [2023-04-29 17:23:22,747] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 16: [2023-04-29 17:23:22,747] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 16: [2023-04-29 17:23:22,747] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 15: [2023-04-29 17:23:22,748] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 16: [2023-04-29 17:23:22,748] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 16: [2023-04-29 17:23:22,748] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 16: [2023-04-29 17:23:22,748] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 10: [2023-04-29 17:23:22,749] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 10: [2023-04-29 17:23:22,749] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 4: [2023-04-29 17:23:22,749] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 12: [2023-04-29 17:23:22,751] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 8: [2023-04-29 17:23:22,751] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 8: [2023-04-29 17:23:22,751] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 12: [2023-04-29 17:23:22,752] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 20: [2023-04-29 17:23:22,752] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 4: [2023-04-29 17:23:22,753] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 4: [2023-04-29 17:23:22,755] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 4: [2023-04-29 17:23:22,755] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 9: [2023-04-29 17:23:22,755] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 8: [2023-04-29 17:23:22,756] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 25: [2023-04-29 17:23:22,756] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 25: [2023-04-29 17:23:22,756] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 9: [2023-04-29 17:23:22,756] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 9: [2023-04-29 17:23:22,757] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 9: [2023-04-29 17:23:22,757] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 4: [2023-04-29 17:23:22,757] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 4: [2023-04-29 17:23:22,757] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 4: [2023-04-29 17:23:22,757] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 4: [2023-04-29 17:23:22,757] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 29: [2023-04-29 17:23:22,759] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 29: [2023-04-29 17:23:22,759] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 29: [2023-04-29 17:23:22,760] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 29: [2023-04-29 17:23:22,760] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 29: [2023-04-29 17:23:22,760] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 29: [2023-04-29 17:23:22,760] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 29: [2023-04-29 17:23:22,760] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 29: [2023-04-29 17:23:22,760] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 15: [2023-04-29 17:23:22,761] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 25: [2023-04-29 17:23:22,760] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 25: [2023-04-29 17:23:22,760] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 25: [2023-04-29 17:23:22,760] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 25: [2023-04-29 17:23:22,760] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 25: [2023-04-29 17:23:22,760] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 25: [2023-04-29 17:23:22,761] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 9: [2023-04-29 17:23:22,761] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 9: [2023-04-29 17:23:22,761] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 25: [2023-04-29 17:23:22,761] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 25: [2023-04-29 17:23:22,761] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 15: [2023-04-29 17:23:22,761] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 15: [2023-04-29 17:23:22,762] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 15: [2023-04-29 17:23:22,762] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 20: [2023-04-29 17:23:22,762] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 15: [2023-04-29 17:23:22,763] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 29: [2023-04-29 17:23:22,763] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 12: [2023-04-29 17:23:22,763] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 9: [2023-04-29 17:23:22,763] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 15: [2023-04-29 17:23:22,763] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 15: [2023-04-29 17:23:22,764] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 15: [2023-04-29 17:23:22,764] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 12: [2023-04-29 17:23:22,764] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 12: [2023-04-29 17:23:22,765] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 12: [2023-04-29 17:23:22,766] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 20: [2023-04-29 17:23:22,766] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 8: [2023-04-29 17:23:22,768] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 8: [2023-04-29 17:23:22,768] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 8: [2023-04-29 17:23:22,768] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 20: [2023-04-29 17:23:22,769] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 20: [2023-04-29 17:23:22,769] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 8: [2023-04-29 17:23:22,770] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 20: [2023-04-29 17:23:22,770] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 8: [2023-04-29 17:23:22,770] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 25: [2023-04-29 17:23:22,770] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 25: [2023-04-29 17:23:22,770] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 25: [2023-04-29 17:23:22,771] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 25: [2023-04-29 17:23:22,771] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 29: [2023-04-29 17:23:22,771] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 29: [2023-04-29 17:23:22,771] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 25: [2023-04-29 17:23:22,772] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 25: [2023-04-29 17:23:22,772] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 29: [2023-04-29 17:23:22,772] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 29: [2023-04-29 17:23:22,773] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 5: [2023-04-29 17:23:22,772] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 5: [2023-04-29 17:23:22,772] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 29: [2023-04-29 17:23:22,773] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 29: [2023-04-29 17:23:22,773] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 29: [2023-04-29 17:23:22,773] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 30: [2023-04-29 17:23:22,775] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 1: [2023-04-29 17:23:22,781] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 1: [2023-04-29 17:23:22,781] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 1: [2023-04-29 17:23:22,783] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 1: [2023-04-29 17:23:22,783] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 1: [2023-04-29 17:23:22,783] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 1: [2023-04-29 17:23:22,783] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 1: [2023-04-29 17:23:22,783] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 11: [2023-04-29 17:23:22,783] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 11: [2023-04-29 17:23:22,783] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 11: [2023-04-29 17:23:22,783] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 14: [2023-04-29 17:23:22,783] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 1: [2023-04-29 17:23:22,783] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 24: [2023-04-29 17:23:22,784] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 30: [2023-04-29 17:23:22,786] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 1: [2023-04-29 17:23:22,787] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 1: [2023-04-29 17:23:22,787] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 1: [2023-04-29 17:23:22,788] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 1: [2023-04-29 17:23:22,788] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 4: [2023-04-29 17:23:22,789] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 4: [2023-04-29 17:23:22,789] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 1: [2023-04-29 17:23:22,789] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 23: [2023-04-29 17:23:22,789] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 5: [2023-04-29 17:23:22,790] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 1: [2023-04-29 17:23:22,790] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 11: [2023-04-29 17:23:22,789] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 1: [2023-04-29 17:23:22,790] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 23: [2023-04-29 17:23:22,791] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 16: [2023-04-29 17:23:22,748] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 16: [2023-04-29 17:23:22,748] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 16: [2023-04-29 17:23:22,753] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 16: [2023-04-29 17:23:22,753] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 1: [2023-04-29 17:23:22,791] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 16: [2023-04-29 17:23:22,754] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 16: [2023-04-29 17:23:22,754] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 16: [2023-04-29 17:23:22,754] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 16: [2023-04-29 17:23:22,754] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 16: [2023-04-29 17:23:22,755] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 16: [2023-04-29 17:23:22,755] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 4: [2023-04-29 17:23:22,791] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 4: [2023-04-29 17:23:22,792] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 5: [2023-04-29 17:23:22,797] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 4: [2023-04-29 17:23:22,797] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 4: [2023-04-29 17:23:22,797] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 5: [2023-04-29 17:23:22,797] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 30: [2023-04-29 17:23:22,798] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 30: [2023-04-29 17:23:22,799] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 30: [2023-04-29 17:23:22,799] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 30: [2023-04-29 17:23:22,799] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 30: [2023-04-29 17:23:22,799] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 30: [2023-04-29 17:23:22,799] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 30: [2023-04-29 17:23:22,799] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 11: [2023-04-29 17:23:22,800] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 11: [2023-04-29 17:23:22,800] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 5: [2023-04-29 17:23:22,800] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 6: [2023-04-29 17:23:22,800] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 6: [2023-04-29 17:23:22,800] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 0: [2023-04-29 17:23:22,801] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 6: [2023-04-29 17:23:22,801] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 6: [2023-04-29 17:23:22,801] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 6: [2023-04-29 17:23:22,801] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 6: [2023-04-29 17:23:22,801] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 6: [2023-04-29 17:23:22,801] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 6: [2023-04-29 17:23:22,801] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 5: [2023-04-29 17:23:22,802] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 5: [2023-04-29 17:23:22,802] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 14: [2023-04-29 17:23:22,802] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 24: [2023-04-29 17:23:22,805] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 6: [2023-04-29 17:23:22,805] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 6: [2023-04-29 17:23:22,805] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 11: [2023-04-29 17:23:22,806] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 11: [2023-04-29 17:23:22,806] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 11: [2023-04-29 17:23:22,806] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 11: [2023-04-29 17:23:22,807] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 11: [2023-04-29 17:23:22,808] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 6: [2023-04-29 17:23:22,810] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 23: [2023-04-29 17:23:22,810] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 23: [2023-04-29 17:23:22,810] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 23: [2023-04-29 17:23:22,810] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 6: [2023-04-29 17:23:22,811] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 5: [2023-04-29 17:23:22,811] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 6: [2023-04-29 17:23:22,811] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 14: [2023-04-29 17:23:22,811] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 6: [2023-04-29 17:23:22,811] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 23: [2023-04-29 17:23:22,812] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 5: [2023-04-29 17:23:22,812] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 14: [2023-04-29 17:23:22,811] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 6: [2023-04-29 17:23:22,812] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 5: [2023-04-29 17:23:22,812] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 25: [2023-04-29 17:23:22,811] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 25: [2023-04-29 17:23:22,811] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 6: [2023-04-29 17:23:22,812] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 29: [2023-04-29 17:23:22,812] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 23: [2023-04-29 17:23:22,814] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 23: [2023-04-29 17:23:22,814] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 11: [2023-04-29 17:23:22,814] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 23: [2023-04-29 17:23:22,815] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 30: [2023-04-29 17:23:22,816] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 23: [2023-04-29 17:23:22,817] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 18: [2023-04-29 17:23:22,817] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 18: [2023-04-29 17:23:22,817] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 18: [2023-04-29 17:23:22,818] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 18: [2023-04-29 17:23:22,818] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 24: [2023-04-29 17:23:22,820] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 24: [2023-04-29 17:23:22,820] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 24: [2023-04-29 17:23:22,820] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 24: [2023-04-29 17:23:22,822] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 24: [2023-04-29 17:23:22,822] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 24: [2023-04-29 17:23:22,822] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 24: [2023-04-29 17:23:22,823] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 14: [2023-04-29 17:23:22,823] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 14: [2023-04-29 17:23:22,823] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 14: [2023-04-29 17:23:22,823] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 14: [2023-04-29 17:23:22,823] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 14: [2023-04-29 17:23:22,823] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 0: [2023-04-29 17:23:22,824] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 0: [2023-04-29 17:23:22,824] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 11: [2023-04-29 17:23:22,824] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 11: [2023-04-29 17:23:22,825] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 0: [2023-04-29 17:23:22,826] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 5: [2023-04-29 17:23:22,830] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 29: [2023-04-29 17:23:22,830] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 30: [2023-04-29 17:23:22,831] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 25: [2023-04-29 17:23:22,831] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 25: [2023-04-29 17:23:22,833] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 14: [2023-04-29 17:23:22,835] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 14: [2023-04-29 17:23:22,835] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 30: [2023-04-29 17:23:22,836] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 0: [2023-04-29 17:23:22,836] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 0: [2023-04-29 17:23:22,836] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 0: [2023-04-29 17:23:22,836] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 0: [2023-04-29 17:23:22,836] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 16: [2023-04-29 17:23:22,800] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 11: [2023-04-29 17:23:22,836] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 11: [2023-04-29 17:23:22,836] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 16: [2023-04-29 17:23:22,811] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 16: [2023-04-29 17:23:22,811] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 16: [2023-04-29 17:23:22,815] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 16: [2023-04-29 17:23:22,821] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 16: [2023-04-29 17:23:22,826] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 16: [2023-04-29 17:23:22,826] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 16: [2023-04-29 17:23:22,826] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 16: [2023-04-29 17:23:22,826] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 30: [2023-04-29 17:23:22,836] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 5: [2023-04-29 17:23:22,837] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 18: [2023-04-29 17:23:22,836] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 18: [2023-04-29 17:23:22,836] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 18: [2023-04-29 17:23:22,836] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 30: [2023-04-29 17:23:22,837] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 16: [2023-04-29 17:23:22,837] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 0: [2023-04-29 17:23:22,837] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 16: [2023-04-29 17:23:22,837] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 30: [2023-04-29 17:23:22,837] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 16: [2023-04-29 17:23:22,838] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 18: [2023-04-29 17:23:22,839] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 30: [2023-04-29 17:23:22,839] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 5: [2023-04-29 17:23:22,840] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 25: [2023-04-29 17:23:22,839] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 25: [2023-04-29 17:23:22,839] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 25: [2023-04-29 17:23:22,840] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 25: [2023-04-29 17:23:22,840] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 15: [2023-04-29 17:23:22,841] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 15: [2023-04-29 17:23:22,841] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 15: [2023-04-29 17:23:22,841] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 15: [2023-04-29 17:23:22,841] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 5: [2023-04-29 17:23:22,842] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 25: [2023-04-29 17:23:22,841] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 5: [2023-04-29 17:23:22,842] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 23: [2023-04-29 17:23:22,842] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 23: [2023-04-29 17:23:22,842] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 25: [2023-04-29 17:23:22,843] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 23: [2023-04-29 17:23:22,843] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 23: [2023-04-29 17:23:22,843] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 23: [2023-04-29 17:23:22,844] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 18: [2023-04-29 17:23:22,844] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 15: [2023-04-29 17:23:22,844] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 15: [2023-04-29 17:23:22,844] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 15: [2023-04-29 17:23:22,844] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 15: [2023-04-29 17:23:22,844] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 18: [2023-04-29 17:23:22,845] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 1: [2023-04-29 17:23:22,844] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 1: [2023-04-29 17:23:22,844] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 1: [2023-04-29 17:23:22,844] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 1: [2023-04-29 17:23:22,844] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 17: [2023-04-29 17:23:22,845] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 17: [2023-04-29 17:23:22,845] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 17: [2023-04-29 17:23:22,845] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 17: [2023-04-29 17:23:22,845] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 17: [2023-04-29 17:23:22,846] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 17: [2023-04-29 17:23:22,846] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 17: [2023-04-29 17:23:22,846] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 29: [2023-04-29 17:23:22,846] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 29: [2023-04-29 17:23:22,846] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 17: [2023-04-29 17:23:22,846] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 0: [2023-04-29 17:23:22,848] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 18: [2023-04-29 17:23:22,850] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 23: [2023-04-29 17:23:22,850] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 24: [2023-04-29 17:23:22,850] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 29: [2023-04-29 17:23:22,851] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 29: [2023-04-29 17:23:22,851] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 29: [2023-04-29 17:23:22,851] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 29: [2023-04-29 17:23:22,851] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 29: [2023-04-29 17:23:22,851] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 0: [2023-04-29 17:23:22,851] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 3: [2023-04-29 17:23:22,851] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 3: [2023-04-29 17:23:22,851] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 17: [2023-04-29 17:23:22,851] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 17: [2023-04-29 17:23:22,852] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 3: [2023-04-29 17:23:22,852] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 3: [2023-04-29 17:23:22,852] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 3: [2023-04-29 17:23:22,852] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 3: [2023-04-29 17:23:22,852] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 3: [2023-04-29 17:23:22,852] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 18: [2023-04-29 17:23:22,852] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 3: [2023-04-29 17:23:22,852] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 16: [2023-04-29 17:23:22,853] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 16: [2023-04-29 17:23:22,854] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 16: [2023-04-29 17:23:22,855] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 3: [2023-04-29 17:23:22,855] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 3: [2023-04-29 17:23:22,855] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 16: [2023-04-29 17:23:22,855] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 6: [2023-04-29 17:23:22,855] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 6: [2023-04-29 17:23:22,855] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 14: [2023-04-29 17:23:22,856] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 14: [2023-04-29 17:23:22,856] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 24: [2023-04-29 17:23:22,856] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 17: [2023-04-29 17:23:22,856] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 26: [2023-04-29 17:23:22,856] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 26: [2023-04-29 17:23:22,856] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 26: [2023-04-29 17:23:22,857] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 17: [2023-04-29 17:23:22,857] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 26: [2023-04-29 17:23:22,857] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 26: [2023-04-29 17:23:22,857] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 26: [2023-04-29 17:23:22,857] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 26: [2023-04-29 17:23:22,857] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 17: [2023-04-29 17:23:22,857] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 24: [2023-04-29 17:23:22,857] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 17: [2023-04-29 17:23:22,857] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 26: [2023-04-29 17:23:22,857] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 17: [2023-04-29 17:23:22,858] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 17: [2023-04-29 17:23:22,859] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 14: [2023-04-29 17:23:22,859] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 3: [2023-04-29 17:23:22,858] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 3: [2023-04-29 17:23:22,859] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 3: [2023-04-29 17:23:22,859] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 14: [2023-04-29 17:23:22,860] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 3: [2023-04-29 17:23:22,860] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 3: [2023-04-29 17:23:22,860] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 24: [2023-04-29 17:23:22,860] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 24: [2023-04-29 17:23:22,860] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 3: [2023-04-29 17:23:22,860] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 24: [2023-04-29 17:23:22,860] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 14: [2023-04-29 17:23:22,860] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 24: [2023-04-29 17:23:22,860] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 28: [2023-04-29 17:23:22,861] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 28: [2023-04-29 17:23:22,861] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 28: [2023-04-29 17:23:22,861] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 28: [2023-04-29 17:23:22,861] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 28: [2023-04-29 17:23:22,861] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 28: [2023-04-29 17:23:22,861] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 28: [2023-04-29 17:23:22,861] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 28: [2023-04-29 17:23:22,861] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 26: [2023-04-29 17:23:22,863] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 26: [2023-04-29 17:23:22,865] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 26: [2023-04-29 17:23:22,865] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 26: [2023-04-29 17:23:22,865] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 26: [2023-04-29 17:23:22,865] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 26: [2023-04-29 17:23:22,865] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 26: [2023-04-29 17:23:22,866] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 26: [2023-04-29 17:23:22,866] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 0: [2023-04-29 17:23:22,868] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 25: [2023-04-29 17:23:22,868] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 18: [2023-04-29 17:23:22,869] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 25: [2023-04-29 17:23:22,870] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 18: [2023-04-29 17:23:22,870] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 18: [2023-04-29 17:23:22,871] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 18: [2023-04-29 17:23:22,871] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 0: [2023-04-29 17:23:22,872] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 0: [2023-04-29 17:23:22,873] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 29: [2023-04-29 17:23:22,873] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 28: [2023-04-29 17:23:22,874] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 25: [2023-04-29 17:23:22,875] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 28: [2023-04-29 17:23:22,875] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 0: [2023-04-29 17:23:22,875] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 0: [2023-04-29 17:23:22,875] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 6: [2023-04-29 17:23:22,875] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 25: [2023-04-29 17:23:22,876] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 25: [2023-04-29 17:23:22,876] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 28: [2023-04-29 17:23:22,876] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 6: [2023-04-29 17:23:22,876] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 2: [2023-04-29 17:23:22,876] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 2: [2023-04-29 17:23:22,876] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 25: [2023-04-29 17:23:22,876] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 28: [2023-04-29 17:23:22,876] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 28: [2023-04-29 17:23:22,876] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 15: [2023-04-29 17:23:22,876] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 28: [2023-04-29 17:23:22,876] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 28: [2023-04-29 17:23:22,877] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 6: [2023-04-29 17:23:22,877] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 29: [2023-04-29 17:23:22,877] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 2: [2023-04-29 17:23:22,878] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 15: [2023-04-29 17:23:22,878] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 28: [2023-04-29 17:23:22,878] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt... 2: [2023-04-29 17:23:22,878] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 2: [2023-04-29 17:23:22,878] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 2: [2023-04-29 17:23:22,878] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 2: [2023-04-29 17:23:22,878] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 2: [2023-04-29 17:23:22,879] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 15: [2023-04-29 17:23:22,879] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 2: [2023-04-29 17:23:22,881] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 2: [2023-04-29 17:23:22,881] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 2: [2023-04-29 17:23:22,882] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 29: [2023-04-29 17:23:22,882] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 6: [2023-04-29 17:23:22,884] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 6: [2023-04-29 17:23:22,884] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 6: [2023-04-29 17:23:22,884] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 6: [2023-04-29 17:23:22,884] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 29: [2023-04-29 17:23:22,885] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 15: [2023-04-29 17:23:22,880] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 15: [2023-04-29 17:23:22,881] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 15: [2023-04-29 17:23:22,882] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 15: [2023-04-29 17:23:22,884] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 15: [2023-04-29 17:23:22,884] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 2: [2023-04-29 17:23:22,887] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 2: [2023-04-29 17:23:22,887] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 2: [2023-04-29 17:23:22,888] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 2: [2023-04-29 17:23:22,889] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 2: [2023-04-29 17:23:22,889] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 6: [2023-04-29 17:23:22,887] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 29: [2023-04-29 17:23:22,887] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 1: [2023-04-29 17:23:22,849] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 1: [2023-04-29 17:23:22,850] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 1: [2023-04-29 17:23:22,850] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 1: [2023-04-29 17:23:22,850] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 1: [2023-04-29 17:23:22,867] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 1: [2023-04-29 17:23:22,867] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 1: [2023-04-29 17:23:22,870] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 1: [2023-04-29 17:23:22,870] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 29: [2023-04-29 17:23:22,888] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 1: [2023-04-29 17:23:22,876] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 29: [2023-04-29 17:23:22,888] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 1: [2023-04-29 17:23:22,879] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 1: [2023-04-29 17:23:22,880] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 1: [2023-04-29 17:23:22,880] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 6: [2023-04-29 17:23:22,901] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 22: [2023-04-29 17:23:22,900] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 22: [2023-04-29 17:23:22,900] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 22: [2023-04-29 17:23:22,900] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 22: [2023-04-29 17:23:22,900] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 22: [2023-04-29 17:23:22,901] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 22: [2023-04-29 17:23:22,901] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 22: [2023-04-29 17:23:22,901] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 22: [2023-04-29 17:23:22,901] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 17: [2023-04-29 17:23:22,903] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 22: [2023-04-29 17:23:22,903] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 17: [2023-04-29 17:23:22,904] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 22: [2023-04-29 17:23:22,905] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 3: [2023-04-29 17:23:22,906] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 3: [2023-04-29 17:23:22,906] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 22: [2023-04-29 17:23:22,908] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 22: [2023-04-29 17:23:22,911] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 22: [2023-04-29 17:23:22,911] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 22: [2023-04-29 17:23:22,912] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 22: [2023-04-29 17:23:22,912] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 22: [2023-04-29 17:23:22,912] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 6: [2023-04-29 17:23:22,915] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 6: [2023-04-29 17:23:22,916] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 6: [2023-04-29 17:23:22,917] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 6: [2023-04-29 17:23:22,917] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 27: [2023-04-29 17:23:22,918] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 6: [2023-04-29 17:23:22,918] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 27: [2023-04-29 17:23:22,918] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 27: [2023-04-29 17:23:22,918] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 27: [2023-04-29 17:23:22,918] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 27: [2023-04-29 17:23:22,918] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 27: [2023-04-29 17:23:22,918] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 27: [2023-04-29 17:23:22,918] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 27: [2023-04-29 17:23:22,919] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 26: [2023-04-29 17:23:22,919] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 26: [2023-04-29 17:23:22,920] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 26: [2023-04-29 17:23:22,920] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 27: [2023-04-29 17:23:22,922] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 17: [2023-04-29 17:23:22,924] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 3: [2023-04-29 17:23:22,926] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 26: [2023-04-29 17:23:22,926] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 17: [2023-04-29 17:23:22,926] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 17: [2023-04-29 17:23:22,927] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 17: [2023-04-29 17:23:22,927] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 3: [2023-04-29 17:23:22,927] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 26: [2023-04-29 17:23:22,929] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 26: [2023-04-29 17:23:22,929] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 26: [2023-04-29 17:23:22,929] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 26: [2023-04-29 17:23:22,929] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 17: [2023-04-29 17:23:22,929] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 17: [2023-04-29 17:23:22,929] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 17: [2023-04-29 17:23:22,930] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 17: [2023-04-29 17:23:22,930] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 20: [2023-04-29 17:23:22,930] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 20: [2023-04-29 17:23:22,930] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 20: [2023-04-29 17:23:22,930] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 20: [2023-04-29 17:23:22,930] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 20: [2023-04-29 17:23:22,930] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 20: [2023-04-29 17:23:22,930] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 20: [2023-04-29 17:23:22,930] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 20: [2023-04-29 17:23:22,930] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 3: [2023-04-29 17:23:22,931] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 3: [2023-04-29 17:23:22,931] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 3: [2023-04-29 17:23:22,931] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 3: [2023-04-29 17:23:22,931] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 3: [2023-04-29 17:23:22,931] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 3: [2023-04-29 17:23:22,931] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 27: [2023-04-29 17:23:22,930] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 27: [2023-04-29 17:23:22,930] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 27: [2023-04-29 17:23:22,930] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 27: [2023-04-29 17:23:22,931] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 27: [2023-04-29 17:23:22,931] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 27: [2023-04-29 17:23:22,932] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 27: [2023-04-29 17:23:22,932] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 2: [2023-04-29 17:23:22,933] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 2: [2023-04-29 17:23:22,933] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 2: [2023-04-29 17:23:22,933] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 20: [2023-04-29 17:23:22,934] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 20: [2023-04-29 17:23:22,936] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 20: [2023-04-29 17:23:22,936] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 20: [2023-04-29 17:23:22,937] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 20: [2023-04-29 17:23:22,938] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 20: [2023-04-29 17:23:22,938] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 20: [2023-04-29 17:23:22,939] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 20: [2023-04-29 17:23:22,940] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 26: [2023-04-29 17:23:22,942] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 31: [2023-04-29 17:23:22,945] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 31: [2023-04-29 17:23:22,945] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 31: [2023-04-29 17:23:22,945] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 31: [2023-04-29 17:23:22,945] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 31: [2023-04-29 17:23:22,945] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 31: [2023-04-29 17:23:22,945] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 31: [2023-04-29 17:23:22,945] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 31: [2023-04-29 17:23:22,946] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 26: [2023-04-29 17:23:22,948] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 22: [2023-04-29 17:23:22,948] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 26: [2023-04-29 17:23:22,948] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 31: [2023-04-29 17:23:22,950] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 31: [2023-04-29 17:23:22,950] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 31: [2023-04-29 17:23:22,951] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 2: [2023-04-29 17:23:22,951] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 2: [2023-04-29 17:23:22,951] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 2: [2023-04-29 17:23:22,951] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 26: [2023-04-29 17:23:22,951] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 31: [2023-04-29 17:23:22,951] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 28: [2023-04-29 17:23:22,951] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 31: [2023-04-29 17:23:22,952] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 28: [2023-04-29 17:23:22,951] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 28: [2023-04-29 17:23:22,951] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 31: [2023-04-29 17:23:22,952] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 31: [2023-04-29 17:23:22,952] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 31: [2023-04-29 17:23:22,952] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 2: [2023-04-29 17:23:22,954] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 2: [2023-04-29 17:23:22,954] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 2: [2023-04-29 17:23:22,954] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 26: [2023-04-29 17:23:22,955] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 26: [2023-04-29 17:23:22,956] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 2: [2023-04-29 17:23:22,956] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 26: [2023-04-29 17:23:22,957] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 2: [2023-04-29 17:23:22,957] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 17: [2023-04-29 17:23:22,958] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 26: [2023-04-29 17:23:22,959] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 17: [2023-04-29 17:23:22,960] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 22: [2023-04-29 17:23:22,961] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 3: [2023-04-29 17:23:22,961] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 3: [2023-04-29 17:23:22,962] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 17: [2023-04-29 17:23:22,964] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 17: [2023-04-29 17:23:22,965] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 17: [2023-04-29 17:23:22,965] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 17: [2023-04-29 17:23:22,965] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 8: [2023-04-29 17:23:22,964] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 8: [2023-04-29 17:23:22,964] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 3: [2023-04-29 17:23:22,966] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 8: [2023-04-29 17:23:22,966] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 8: [2023-04-29 17:23:22,966] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 3: [2023-04-29 17:23:22,966] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 28: [2023-04-29 17:23:22,966] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 28: [2023-04-29 17:23:22,966] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 28: [2023-04-29 17:23:22,966] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 28: [2023-04-29 17:23:22,966] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 8: [2023-04-29 17:23:22,966] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 8: [2023-04-29 17:23:22,966] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 8: [2023-04-29 17:23:22,966] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 3: [2023-04-29 17:23:22,966] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 8: [2023-04-29 17:23:22,967] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 28: [2023-04-29 17:23:22,967] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_14-model_00-model_states.pt. 22: [2023-04-29 17:23:22,967] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 3: [2023-04-29 17:23:22,968] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 22: [2023-04-29 17:23:22,968] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 8: [2023-04-29 17:23:22,971] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 8: [2023-04-29 17:23:22,972] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 8: [2023-04-29 17:23:22,973] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 8: [2023-04-29 17:23:22,973] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 8: [2023-04-29 17:23:22,974] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 8: [2023-04-29 17:23:22,974] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 8: [2023-04-29 17:23:22,975] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 8: [2023-04-29 17:23:22,976] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 27: [2023-04-29 17:23:22,975] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 28: [2023-04-29 17:23:22,978] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 28: [2023-04-29 17:23:22,979] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 28: [2023-04-29 17:23:22,980] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 2: [2023-04-29 17:23:22,981] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 2: [2023-04-29 17:23:22,981] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 2: [2023-04-29 17:23:22,981] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 20: [2023-04-29 17:23:22,981] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 2: [2023-04-29 17:23:22,982] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 2: [2023-04-29 17:23:22,982] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 22: [2023-04-29 17:23:22,983] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 22: [2023-04-29 17:23:22,986] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 22: [2023-04-29 17:23:22,986] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 22: [2023-04-29 17:23:22,986] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 22: [2023-04-29 17:23:22,986] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 22: [2023-04-29 17:23:22,986] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 22: [2023-04-29 17:23:22,990] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 20: [2023-04-29 17:23:22,992] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 20: [2023-04-29 17:23:22,994] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 27: [2023-04-29 17:23:22,995] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 20: [2023-04-29 17:23:22,996] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 28: [2023-04-29 17:23:22,999] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 27: [2023-04-29 17:23:22,999] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 28: [2023-04-29 17:23:22,999] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 31: [2023-04-29 17:23:22,999] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 28: [2023-04-29 17:23:22,999] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 9: [2023-04-29 17:23:23,001] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 9: [2023-04-29 17:23:23,001] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 9: [2023-04-29 17:23:23,001] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 9: [2023-04-29 17:23:23,001] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 9: [2023-04-29 17:23:23,001] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 9: [2023-04-29 17:23:23,001] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 9: [2023-04-29 17:23:23,001] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 9: [2023-04-29 17:23:23,002] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 28: [2023-04-29 17:23:23,002] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 31: [2023-04-29 17:23:23,004] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 31: [2023-04-29 17:23:23,004] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 28: [2023-04-29 17:23:23,005] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 9: [2023-04-29 17:23:23,006] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 9: [2023-04-29 17:23:23,006] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 9: [2023-04-29 17:23:23,007] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 9: [2023-04-29 17:23:23,007] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 9: [2023-04-29 17:23:23,007] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 9: [2023-04-29 17:23:23,007] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 9: [2023-04-29 17:23:23,007] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 9: [2023-04-29 17:23:23,007] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 20: [2023-04-29 17:23:23,007] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 20: [2023-04-29 17:23:23,007] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 20: [2023-04-29 17:23:23,007] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 20: [2023-04-29 17:23:23,007] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 20: [2023-04-29 17:23:23,009] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 27: [2023-04-29 17:23:23,010] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 27: [2023-04-29 17:23:23,010] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 27: [2023-04-29 17:23:23,010] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 27: [2023-04-29 17:23:23,010] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 27: [2023-04-29 17:23:23,010] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 27: [2023-04-29 17:23:23,011] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 10: [2023-04-29 17:23:23,012] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 10: [2023-04-29 17:23:23,012] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 10: [2023-04-29 17:23:23,013] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 10: [2023-04-29 17:23:23,013] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 10: [2023-04-29 17:23:23,013] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 10: [2023-04-29 17:23:23,013] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 10: [2023-04-29 17:23:23,013] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 10: [2023-04-29 17:23:23,013] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 31: [2023-04-29 17:23:23,014] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 22: [2023-04-29 17:23:23,017] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 10: [2023-04-29 17:23:23,018] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 10: [2023-04-29 17:23:23,018] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 10: [2023-04-29 17:23:23,019] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 10: [2023-04-29 17:23:23,019] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 10: [2023-04-29 17:23:23,019] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 22: [2023-04-29 17:23:23,019] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 31: [2023-04-29 17:23:23,020] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 31: [2023-04-29 17:23:23,020] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 20: [2023-04-29 17:23:23,020] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 31: [2023-04-29 17:23:23,020] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 31: [2023-04-29 17:23:23,020] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 22: [2023-04-29 17:23:23,020] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 10: [2023-04-29 17:23:23,020] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 22: [2023-04-29 17:23:23,020] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 31: [2023-04-29 17:23:23,021] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 22: [2023-04-29 17:23:23,021] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 27: [2023-04-29 17:23:23,021] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 10: [2023-04-29 17:23:23,022] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 10: [2023-04-29 17:23:23,022] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 20: [2023-04-29 17:23:23,027] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 31: [2023-04-29 17:23:23,027] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 20: [2023-04-29 17:23:23,027] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 31: [2023-04-29 17:23:23,027] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 8: [2023-04-29 17:23:23,028] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 8: [2023-04-29 17:23:23,028] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 8: [2023-04-29 17:23:23,028] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 8: [2023-04-29 17:23:23,033] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 8: [2023-04-29 17:23:23,033] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 8: [2023-04-29 17:23:23,033] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 20: [2023-04-29 17:23:23,034] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 8: [2023-04-29 17:23:23,034] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 8: [2023-04-29 17:23:23,034] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 20: [2023-04-29 17:23:23,036] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 20: [2023-04-29 17:23:23,037] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 20: [2023-04-29 17:23:23,038] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 31: [2023-04-29 17:23:23,040] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 30: [2023-04-29 17:23:23,039] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 30: [2023-04-29 17:23:23,040] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 30: [2023-04-29 17:23:23,040] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 30: [2023-04-29 17:23:23,040] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 30: [2023-04-29 17:23:23,040] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 30: [2023-04-29 17:23:23,040] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 30: [2023-04-29 17:23:23,040] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 30: [2023-04-29 17:23:23,040] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 27: [2023-04-29 17:23:23,042] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 31: [2023-04-29 17:23:23,044] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 27: [2023-04-29 17:23:23,044] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 27: [2023-04-29 17:23:23,045] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 31: [2023-04-29 17:23:23,046] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 31: [2023-04-29 17:23:23,046] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 31: [2023-04-29 17:23:23,046] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 27: [2023-04-29 17:23:23,046] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 27: [2023-04-29 17:23:23,047] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 27: [2023-04-29 17:23:23,050] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 4: [2023-04-29 17:23:23,052] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 30: [2023-04-29 17:23:23,051] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 30: [2023-04-29 17:23:23,052] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 30: [2023-04-29 17:23:23,052] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 30: [2023-04-29 17:23:23,052] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 30: [2023-04-29 17:23:23,052] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 30: [2023-04-29 17:23:23,053] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 4: [2023-04-29 17:23:23,053] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 30: [2023-04-29 17:23:23,053] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 30: [2023-04-29 17:23:23,054] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 8: [2023-04-29 17:23:23,057] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 8: [2023-04-29 17:23:23,057] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 4: [2023-04-29 17:23:23,057] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 4: [2023-04-29 17:23:23,058] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 4: [2023-04-29 17:23:23,058] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 4: [2023-04-29 17:23:23,058] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 4: [2023-04-29 17:23:23,058] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 4: [2023-04-29 17:23:23,058] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 4: [2023-04-29 17:23:23,058] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 8: [2023-04-29 17:23:23,059] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 4: [2023-04-29 17:23:23,059] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 8: [2023-04-29 17:23:23,060] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 9: [2023-04-29 17:23:23,061] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 23: [2023-04-29 17:23:23,061] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 23: [2023-04-29 17:23:23,061] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 23: [2023-04-29 17:23:23,061] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 23: [2023-04-29 17:23:23,062] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 23: [2023-04-29 17:23:23,062] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 23: [2023-04-29 17:23:23,062] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 23: [2023-04-29 17:23:23,062] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 23: [2023-04-29 17:23:23,062] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 4: [2023-04-29 17:23:23,062] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 8: [2023-04-29 17:23:23,063] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 9: [2023-04-29 17:23:23,064] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 9: [2023-04-29 17:23:23,064] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 9: [2023-04-29 17:23:23,064] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 8: [2023-04-29 17:23:23,066] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 8: [2023-04-29 17:23:23,066] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 23: [2023-04-29 17:23:23,066] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 10: [2023-04-29 17:23:23,066] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 23: [2023-04-29 17:23:23,067] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 9: [2023-04-29 17:23:23,068] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 4: [2023-04-29 17:23:23,068] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 4: [2023-04-29 17:23:23,069] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 4: [2023-04-29 17:23:23,069] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 4: [2023-04-29 17:23:23,069] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 9: [2023-04-29 17:23:23,070] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 9: [2023-04-29 17:23:23,070] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 9: [2023-04-29 17:23:23,070] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 4: [2023-04-29 17:23:23,070] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 8: [2023-04-29 17:23:23,070] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 23: [2023-04-29 17:23:23,071] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 23: [2023-04-29 17:23:23,072] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 23: [2023-04-29 17:23:23,072] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 23: [2023-04-29 17:23:23,073] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 23: [2023-04-29 17:23:23,073] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 23: [2023-04-29 17:23:23,073] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 5: [2023-04-29 17:23:23,075] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 5: [2023-04-29 17:23:23,075] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 5: [2023-04-29 17:23:23,075] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 5: [2023-04-29 17:23:23,075] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 5: [2023-04-29 17:23:23,075] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 5: [2023-04-29 17:23:23,075] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 5: [2023-04-29 17:23:23,075] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 5: [2023-04-29 17:23:23,076] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 5: [2023-04-29 17:23:23,079] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 5: [2023-04-29 17:23:23,079] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 11: [2023-04-29 17:23:23,079] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 11: [2023-04-29 17:23:23,079] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 10: [2023-04-29 17:23:23,078] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 10: [2023-04-29 17:23:23,078] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 10: [2023-04-29 17:23:23,078] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 10: [2023-04-29 17:23:23,078] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 11: [2023-04-29 17:23:23,082] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 11: [2023-04-29 17:23:23,082] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 11: [2023-04-29 17:23:23,082] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 11: [2023-04-29 17:23:23,082] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 11: [2023-04-29 17:23:23,082] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 11: [2023-04-29 17:23:23,083] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 11: [2023-04-29 17:23:23,083] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 11: [2023-04-29 17:23:23,084] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 9: [2023-04-29 17:23:23,084] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 5: [2023-04-29 17:23:23,085] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 5: [2023-04-29 17:23:23,085] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 5: [2023-04-29 17:23:23,086] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 10: [2023-04-29 17:23:23,086] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 5: [2023-04-29 17:23:23,086] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 5: [2023-04-29 17:23:23,087] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 11: [2023-04-29 17:23:23,086] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 10: [2023-04-29 17:23:23,086] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 10: [2023-04-29 17:23:23,087] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 10: [2023-04-29 17:23:23,087] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 5: [2023-04-29 17:23:23,087] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 12: [2023-04-29 17:23:23,087] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 12: [2023-04-29 17:23:23,087] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 12: [2023-04-29 17:23:23,087] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 12: [2023-04-29 17:23:23,087] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 12: [2023-04-29 17:23:23,087] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 12: [2023-04-29 17:23:23,087] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 12: [2023-04-29 17:23:23,087] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 12: [2023-04-29 17:23:23,088] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 9: [2023-04-29 17:23:23,089] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 9: [2023-04-29 17:23:23,091] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 9: [2023-04-29 17:23:23,091] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 11: [2023-04-29 17:23:23,092] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 11: [2023-04-29 17:23:23,092] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 11: [2023-04-29 17:23:23,092] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 11: [2023-04-29 17:23:23,093] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 12: [2023-04-29 17:23:23,093] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 9: [2023-04-29 17:23:23,093] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 9: [2023-04-29 17:23:23,093] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 11: [2023-04-29 17:23:23,094] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 9: [2023-04-29 17:23:23,094] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 12: [2023-04-29 17:23:23,094] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 12: [2023-04-29 17:23:23,095] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 12: [2023-04-29 17:23:23,095] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 12: [2023-04-29 17:23:23,096] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 12: [2023-04-29 17:23:23,096] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 9: [2023-04-29 17:23:23,096] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 12: [2023-04-29 17:23:23,096] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 12: [2023-04-29 17:23:23,097] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 0: [2023-04-29 17:23:23,102] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 0: [2023-04-29 17:23:23,102] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 0: [2023-04-29 17:23:23,102] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 0: [2023-04-29 17:23:23,103] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 0: [2023-04-29 17:23:23,103] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 0: [2023-04-29 17:23:23,103] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 0: [2023-04-29 17:23:23,103] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 10: [2023-04-29 17:23:23,103] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 0: [2023-04-29 17:23:23,103] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 10: [2023-04-29 17:23:23,104] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 10: [2023-04-29 17:23:23,105] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 10: [2023-04-29 17:23:23,105] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 24: [2023-04-29 17:23:23,105] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 24: [2023-04-29 17:23:23,106] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 24: [2023-04-29 17:23:23,106] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 24: [2023-04-29 17:23:23,106] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 24: [2023-04-29 17:23:23,106] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 24: [2023-04-29 17:23:23,106] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 24: [2023-04-29 17:23:23,106] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 24: [2023-04-29 17:23:23,107] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 4: [2023-04-29 17:23:23,108] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 24: [2023-04-29 17:23:23,110] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 10: [2023-04-29 17:23:23,111] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 4: [2023-04-29 17:23:23,113] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 18: [2023-04-29 17:23:23,113] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 18: [2023-04-29 17:23:23,113] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 18: [2023-04-29 17:23:23,113] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 18: [2023-04-29 17:23:23,113] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 18: [2023-04-29 17:23:23,113] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 29: [2023-04-29 17:23:23,114] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 29: [2023-04-29 17:23:23,114] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 18: [2023-04-29 17:23:23,113] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 18: [2023-04-29 17:23:23,113] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 18: [2023-04-29 17:23:23,114] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 10: [2023-04-29 17:23:23,115] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 10: [2023-04-29 17:23:23,115] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 29: [2023-04-29 17:23:23,115] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 0: [2023-04-29 17:23:23,115] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 29: [2023-04-29 17:23:23,115] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 29: [2023-04-29 17:23:23,115] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 29: [2023-04-29 17:23:23,115] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 29: [2023-04-29 17:23:23,115] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 0: [2023-04-29 17:23:23,116] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 29: [2023-04-29 17:23:23,116] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 0: [2023-04-29 17:23:23,116] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 0: [2023-04-29 17:23:23,117] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 29: [2023-04-29 17:23:23,118] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 0: [2023-04-29 17:23:23,118] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 0: [2023-04-29 17:23:23,118] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 23: [2023-04-29 17:23:23,118] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 24: [2023-04-29 17:23:23,118] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 24: [2023-04-29 17:23:23,118] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 24: [2023-04-29 17:23:23,118] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 0: [2023-04-29 17:23:23,119] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 24: [2023-04-29 17:23:23,119] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 24: [2023-04-29 17:23:23,119] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 24: [2023-04-29 17:23:23,120] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 0: [2023-04-29 17:23:23,120] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 24: [2023-04-29 17:23:23,120] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 29: [2023-04-29 17:23:23,121] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 29: [2023-04-29 17:23:23,123] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 23: [2023-04-29 17:23:23,123] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 21: [2023-04-29 17:23:23,124] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 21: [2023-04-29 17:23:23,124] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 21: [2023-04-29 17:23:23,125] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 21: [2023-04-29 17:23:23,125] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 21: [2023-04-29 17:23:23,125] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 21: [2023-04-29 17:23:23,125] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 21: [2023-04-29 17:23:23,125] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 21: [2023-04-29 17:23:23,125] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 30: [2023-04-29 17:23:23,125] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 29: [2023-04-29 17:23:23,126] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 18: [2023-04-29 17:23:23,126] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 29: [2023-04-29 17:23:23,126] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 18: [2023-04-29 17:23:23,127] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 29: [2023-04-29 17:23:23,127] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 18: [2023-04-29 17:23:23,127] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 29: [2023-04-29 17:23:23,127] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 29: [2023-04-29 17:23:23,128] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 18: [2023-04-29 17:23:23,128] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 18: [2023-04-29 17:23:23,128] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 18: [2023-04-29 17:23:23,128] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 18: [2023-04-29 17:23:23,129] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 18: [2023-04-29 17:23:23,130] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 5: [2023-04-29 17:23:23,130] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 5: [2023-04-29 17:23:23,130] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 25: [2023-04-29 17:23:23,129] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 25: [2023-04-29 17:23:23,129] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 21: [2023-04-29 17:23:23,130] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 21: [2023-04-29 17:23:23,130] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 21: [2023-04-29 17:23:23,130] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 21: [2023-04-29 17:23:23,130] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 21: [2023-04-29 17:23:23,130] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 21: [2023-04-29 17:23:23,131] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 21: [2023-04-29 17:23:23,131] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 4: [2023-04-29 17:23:23,132] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 21: [2023-04-29 17:23:23,132] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 4: [2023-04-29 17:23:23,132] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 25: [2023-04-29 17:23:23,132] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 25: [2023-04-29 17:23:23,132] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 25: [2023-04-29 17:23:23,132] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 25: [2023-04-29 17:23:23,132] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 25: [2023-04-29 17:23:23,132] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 25: [2023-04-29 17:23:23,133] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 25: [2023-04-29 17:23:23,134] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 25: [2023-04-29 17:23:23,134] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 4: [2023-04-29 17:23:23,136] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 11: [2023-04-29 17:23:23,136] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 11: [2023-04-29 17:23:23,136] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 11: [2023-04-29 17:23:23,136] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 4: [2023-04-29 17:23:23,140] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 23: [2023-04-29 17:23:23,140] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 15: [2023-04-29 17:23:23,140] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 15: [2023-04-29 17:23:23,140] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 15: [2023-04-29 17:23:23,140] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 15: [2023-04-29 17:23:23,140] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 15: [2023-04-29 17:23:23,140] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 15: [2023-04-29 17:23:23,140] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 15: [2023-04-29 17:23:23,140] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 15: [2023-04-29 17:23:23,140] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 25: [2023-04-29 17:23:23,140] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 25: [2023-04-29 17:23:23,142] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 23: [2023-04-29 17:23:23,142] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 23: [2023-04-29 17:23:23,142] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 25: [2023-04-29 17:23:23,144] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 25: [2023-04-29 17:23:23,144] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 25: [2023-04-29 17:23:23,144] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 30: [2023-04-29 17:23:23,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 30: [2023-04-29 17:23:23,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 30: [2023-04-29 17:23:23,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 30: [2023-04-29 17:23:23,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 30: [2023-04-29 17:23:23,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 25: [2023-04-29 17:23:23,144] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 30: [2023-04-29 17:23:23,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 30: [2023-04-29 17:23:23,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 4: [2023-04-29 17:23:23,145] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 4: [2023-04-29 17:23:23,145] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 4: [2023-04-29 17:23:23,145] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 23: [2023-04-29 17:23:23,145] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 23: [2023-04-29 17:23:23,145] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 4: [2023-04-29 17:23:23,145] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 23: [2023-04-29 17:23:23,146] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 23: [2023-04-29 17:23:23,146] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 17: [2023-04-29 17:23:23,147] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 17: [2023-04-29 17:23:23,147] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 17: [2023-04-29 17:23:23,147] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 17: [2023-04-29 17:23:23,147] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 12: [2023-04-29 17:23:23,147] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 17: [2023-04-29 17:23:23,148] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 17: [2023-04-29 17:23:23,148] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 17: [2023-04-29 17:23:23,148] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 17: [2023-04-29 17:23:23,148] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 23: [2023-04-29 17:23:23,148] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 5: [2023-04-29 17:23:23,150] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 12: [2023-04-29 17:23:23,149] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 12: [2023-04-29 17:23:23,149] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 5: [2023-04-29 17:23:23,150] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 30: [2023-04-29 17:23:23,151] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 17: [2023-04-29 17:23:23,152] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 15: [2023-04-29 17:23:23,153] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 17: [2023-04-29 17:23:23,153] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 15: [2023-04-29 17:23:23,153] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 17: [2023-04-29 17:23:23,154] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 15: [2023-04-29 17:23:23,154] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 11: [2023-04-29 17:23:23,155] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 11: [2023-04-29 17:23:23,155] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 15: [2023-04-29 17:23:23,155] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 15: [2023-04-29 17:23:23,155] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 15: [2023-04-29 17:23:23,155] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 5: [2023-04-29 17:23:23,156] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 5: [2023-04-29 17:23:23,156] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 5: [2023-04-29 17:23:23,156] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 15: [2023-04-29 17:23:23,156] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 15: [2023-04-29 17:23:23,157] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 5: [2023-04-29 17:23:23,157] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 5: [2023-04-29 17:23:23,157] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 5: [2023-04-29 17:23:23,157] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 11: [2023-04-29 17:23:23,157] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 4: [2023-04-29 17:23:23,158] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 11: [2023-04-29 17:23:23,158] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 11: [2023-04-29 17:23:23,158] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 17: [2023-04-29 17:23:23,157] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 17: [2023-04-29 17:23:23,158] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 17: [2023-04-29 17:23:23,159] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 17: [2023-04-29 17:23:23,159] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 17: [2023-04-29 17:23:23,159] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 12: [2023-04-29 17:23:23,160] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 24: [2023-04-29 17:23:23,160] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 29: [2023-04-29 17:23:23,161] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 11: [2023-04-29 17:23:23,161] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 12: [2023-04-29 17:23:23,163] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 12: [2023-04-29 17:23:23,163] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 12: [2023-04-29 17:23:23,163] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 11: [2023-04-29 17:23:23,163] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 12: [2023-04-29 17:23:23,163] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 11: [2023-04-29 17:23:23,163] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 6: [2023-04-29 17:23:23,165] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 6: [2023-04-29 17:23:23,165] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 6: [2023-04-29 17:23:23,165] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 6: [2023-04-29 17:23:23,165] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 6: [2023-04-29 17:23:23,165] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 6: [2023-04-29 17:23:23,165] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 6: [2023-04-29 17:23:23,165] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 6: [2023-04-29 17:23:23,166] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 6: [2023-04-29 17:23:23,169] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 6: [2023-04-29 17:23:23,170] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 12: [2023-04-29 17:23:23,171] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 12: [2023-04-29 17:23:23,172] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 4: [2023-04-29 17:23:23,172] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 6: [2023-04-29 17:23:23,174] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 23: [2023-04-29 17:23:23,174] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 23: [2023-04-29 17:23:23,175] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 23: [2023-04-29 17:23:23,175] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 6: [2023-04-29 17:23:23,175] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 6: [2023-04-29 17:23:23,175] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 12: [2023-04-29 17:23:23,175] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 6: [2023-04-29 17:23:23,176] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 30: [2023-04-29 17:23:23,176] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 6: [2023-04-29 17:23:23,176] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 23: [2023-04-29 17:23:23,176] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 4: [2023-04-29 17:23:23,177] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 6: [2023-04-29 17:23:23,177] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 4: [2023-04-29 17:23:23,177] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 4: [2023-04-29 17:23:23,179] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 30: [2023-04-29 17:23:23,179] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 4: [2023-04-29 17:23:23,179] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 29: [2023-04-29 17:23:23,180] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 23: [2023-04-29 17:23:23,180] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 30: [2023-04-29 17:23:23,181] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 29: [2023-04-29 17:23:23,181] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 30: [2023-04-29 17:23:23,182] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 23: [2023-04-29 17:23:23,182] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 24: [2023-04-29 17:23:23,183] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 30: [2023-04-29 17:23:23,184] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 30: [2023-04-29 17:23:23,184] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 25: [2023-04-29 17:23:23,184] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 25: [2023-04-29 17:23:23,184] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 21: [2023-04-29 17:23:23,185] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 21: [2023-04-29 17:23:23,185] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 21: [2023-04-29 17:23:23,185] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 12: [2023-04-29 17:23:23,186] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 30: [2023-04-29 17:23:23,186] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 11: [2023-04-29 17:23:23,186] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 11: [2023-04-29 17:23:23,187] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 29: [2023-04-29 17:23:23,187] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 5: [2023-04-29 17:23:23,188] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 5: [2023-04-29 17:23:23,188] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 12: [2023-04-29 17:23:23,189] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 12: [2023-04-29 17:23:23,191] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 5: [2023-04-29 17:23:23,191] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 5: [2023-04-29 17:23:23,191] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 11: [2023-04-29 17:23:23,192] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 0: [2023-04-29 17:23:23,192] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 11: [2023-04-29 17:23:23,192] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 12: [2023-04-29 17:23:23,192] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 11: [2023-04-29 17:23:23,192] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 12: [2023-04-29 17:23:23,193] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 21: [2023-04-29 17:23:23,193] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 24: [2023-04-29 17:23:23,193] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 24: [2023-04-29 17:23:23,193] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 24: [2023-04-29 17:23:23,193] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 5: [2023-04-29 17:23:23,194] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 5: [2023-04-29 17:23:23,194] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 28: [2023-04-29 17:23:23,195] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 28: [2023-04-29 17:23:23,195] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 28: [2023-04-29 17:23:23,195] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 28: [2023-04-29 17:23:23,195] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 28: [2023-04-29 17:23:23,195] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 28: [2023-04-29 17:23:23,195] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 28: [2023-04-29 17:23:23,195] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 0: [2023-04-29 17:23:23,196] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 28: [2023-04-29 17:23:23,196] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 24: [2023-04-29 17:23:23,196] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 24: [2023-04-29 17:23:23,196] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 24: [2023-04-29 17:23:23,196] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 24: [2023-04-29 17:23:23,197] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 25: [2023-04-29 17:23:23,197] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 0: [2023-04-29 17:23:23,198] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 0: [2023-04-29 17:23:23,198] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 21: [2023-04-29 17:23:23,198] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 21: [2023-04-29 17:23:23,198] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 21: [2023-04-29 17:23:23,198] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 21: [2023-04-29 17:23:23,198] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 29: [2023-04-29 17:23:23,204] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 25: [2023-04-29 17:23:23,205] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 18: [2023-04-29 17:23:23,205] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 18: [2023-04-29 17:23:23,205] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 18: [2023-04-29 17:23:23,205] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 17: [2023-04-29 17:23:23,205] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 25: [2023-04-29 17:23:23,206] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 29: [2023-04-29 17:23:23,206] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 29: [2023-04-29 17:23:23,206] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 17: [2023-04-29 17:23:23,206] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 29: [2023-04-29 17:23:23,208] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 29: [2023-04-29 17:23:23,208] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 29: [2023-04-29 17:23:23,208] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 28: [2023-04-29 17:23:23,208] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 28: [2023-04-29 17:23:23,209] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 21: [2023-04-29 17:23:23,209] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 21: [2023-04-29 17:23:23,209] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 21: [2023-04-29 17:23:23,209] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 28: [2023-04-29 17:23:23,210] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 28: [2023-04-29 17:23:23,210] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 28: [2023-04-29 17:23:23,210] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 28: [2023-04-29 17:23:23,211] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 28: [2023-04-29 17:23:23,211] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 28: [2023-04-29 17:23:23,212] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt... 25: [2023-04-29 17:23:23,213] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 29: [2023-04-29 17:23:23,213] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 17: [2023-04-29 17:23:23,213] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 25: [2023-04-29 17:23:23,214] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 18: [2023-04-29 17:23:23,217] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 18: [2023-04-29 17:23:23,217] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 18: [2023-04-29 17:23:23,217] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 18: [2023-04-29 17:23:23,217] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 18: [2023-04-29 17:23:23,217] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 0: [2023-04-29 17:23:23,218] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 0: [2023-04-29 17:23:23,218] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 25: [2023-04-29 17:23:23,219] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 0: [2023-04-29 17:23:23,221] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 25: [2023-04-29 17:23:23,221] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 25: [2023-04-29 17:23:23,221] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 25: [2023-04-29 17:23:23,221] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 0: [2023-04-29 17:23:23,221] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 6: [2023-04-29 17:23:23,221] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 21: [2023-04-29 17:23:23,222] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 6: [2023-04-29 17:23:23,223] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 21: [2023-04-29 17:23:23,224] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 24: [2023-04-29 17:23:23,225] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 21: [2023-04-29 17:23:23,226] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 17: [2023-04-29 17:23:23,226] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 21: [2023-04-29 17:23:23,226] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 0: [2023-04-29 17:23:23,227] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 21: [2023-04-29 17:23:23,227] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 0: [2023-04-29 17:23:23,227] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 0: [2023-04-29 17:23:23,227] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 24: [2023-04-29 17:23:23,229] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 17: [2023-04-29 17:23:23,229] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 0: [2023-04-29 17:23:23,229] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 17: [2023-04-29 17:23:23,229] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 7: [2023-04-29 17:23:23,229] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 7: [2023-04-29 17:23:23,229] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 17: [2023-04-29 17:23:23,230] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 7: [2023-04-29 17:23:23,230] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 7: [2023-04-29 17:23:23,230] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 7: [2023-04-29 17:23:23,230] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 7: [2023-04-29 17:23:23,230] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 7: [2023-04-29 17:23:23,230] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 7: [2023-04-29 17:23:23,231] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 18: [2023-04-29 17:23:23,231] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 24: [2023-04-29 17:23:23,231] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 24: [2023-04-29 17:23:23,231] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 24: [2023-04-29 17:23:23,231] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 18: [2023-04-29 17:23:23,232] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 15: [2023-04-29 17:23:23,233] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 15: [2023-04-29 17:23:23,233] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 15: [2023-04-29 17:23:23,233] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 15: [2023-04-29 17:23:23,233] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 24: [2023-04-29 17:23:23,234] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 24: [2023-04-29 17:23:23,234] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 7: [2023-04-29 17:23:23,234] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 7: [2023-04-29 17:23:23,234] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 7: [2023-04-29 17:23:23,234] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 18: [2023-04-29 17:23:23,235] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 15: [2023-04-29 17:23:23,236] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 15: [2023-04-29 17:23:23,236] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 17: [2023-04-29 17:23:23,236] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 17: [2023-04-29 17:23:23,236] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 17: [2023-04-29 17:23:23,236] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 15: [2023-04-29 17:23:23,237] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 15: [2023-04-29 17:23:23,237] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 7: [2023-04-29 17:23:23,237] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 7: [2023-04-29 17:23:23,237] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 7: [2023-04-29 17:23:23,237] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 7: [2023-04-29 17:23:23,237] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 7: [2023-04-29 17:23:23,237] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 29: [2023-04-29 17:23:23,238] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 17: [2023-04-29 17:23:23,239] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 29: [2023-04-29 17:23:23,240] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 25: [2023-04-29 17:23:23,240] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 29: [2023-04-29 17:23:23,240] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 6: [2023-04-29 17:23:23,241] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 29: [2023-04-29 17:23:23,241] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 29: [2023-04-29 17:23:23,242] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 25: [2023-04-29 17:23:23,242] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 6: [2023-04-29 17:23:23,242] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 6: [2023-04-29 17:23:23,242] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 6: [2023-04-29 17:23:23,243] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 25: [2023-04-29 17:23:23,247] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 18: [2023-04-29 17:23:23,248] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 25: [2023-04-29 17:23:23,249] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 25: [2023-04-29 17:23:23,250] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 18: [2023-04-29 17:23:23,252] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 18: [2023-04-29 17:23:23,254] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 18: [2023-04-29 17:23:23,254] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 18: [2023-04-29 17:23:23,255] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 6: [2023-04-29 17:23:23,255] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 6: [2023-04-29 17:23:23,255] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 6: [2023-04-29 17:23:23,255] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 6: [2023-04-29 17:23:23,255] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 0: [2023-04-29 17:23:23,256] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 0: [2023-04-29 17:23:23,256] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 0: [2023-04-29 17:23:23,256] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 0: [2023-04-29 17:23:23,258] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 17: [2023-04-29 17:23:23,259] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 17: [2023-04-29 17:23:23,262] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 17: [2023-04-29 17:23:23,264] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 6: [2023-04-29 17:23:23,266] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 17: [2023-04-29 17:23:23,266] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 17: [2023-04-29 17:23:23,267] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 15: [2023-04-29 17:23:23,268] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 15: [2023-04-29 17:23:23,270] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 6: [2023-04-29 17:23:23,271] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 15: [2023-04-29 17:23:23,271] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 15: [2023-04-29 17:23:23,273] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 15: [2023-04-29 17:23:23,273] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 15: [2023-04-29 17:23:23,275] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 16: [2023-04-29 17:23:23,277] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 16: [2023-04-29 17:23:23,277] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 16: [2023-04-29 17:23:23,277] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 16: [2023-04-29 17:23:23,278] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 16: [2023-04-29 17:23:23,278] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 16: [2023-04-29 17:23:23,278] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 16: [2023-04-29 17:23:23,278] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 16: [2023-04-29 17:23:23,278] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 15: [2023-04-29 17:23:23,280] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 15: [2023-04-29 17:23:23,280] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 16: [2023-04-29 17:23:23,283] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 16: [2023-04-29 17:23:23,283] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 16: [2023-04-29 17:23:23,284] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 16: [2023-04-29 17:23:23,284] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 16: [2023-04-29 17:23:23,284] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 16: [2023-04-29 17:23:23,284] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 16: [2023-04-29 17:23:23,285] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 16: [2023-04-29 17:23:23,285] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 6: [2023-04-29 17:23:23,285] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 6: [2023-04-29 17:23:23,285] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 6: [2023-04-29 17:23:23,286] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 7: [2023-04-29 17:23:23,286] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 7: [2023-04-29 17:23:23,286] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 7: [2023-04-29 17:23:23,287] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 6: [2023-04-29 17:23:23,287] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 28: [2023-04-29 17:23:23,288] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 28: [2023-04-29 17:23:23,288] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 28: [2023-04-29 17:23:23,288] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 28: [2023-04-29 17:23:23,288] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 28: [2023-04-29 17:23:23,303] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 28: [2023-04-29 17:23:23,303] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 28: [2023-04-29 17:23:23,303] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 28: [2023-04-29 17:23:23,303] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_15-model_00-model_states.pt. 7: [2023-04-29 17:23:23,303] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 7: [2023-04-29 17:23:23,303] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 7: [2023-04-29 17:23:23,303] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 7: [2023-04-29 17:23:23,303] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 7: [2023-04-29 17:23:23,303] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 7: [2023-04-29 17:23:23,307] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 7: [2023-04-29 17:23:23,309] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 7: [2023-04-29 17:23:23,309] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 19: [2023-04-29 17:23:23,316] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 19: [2023-04-29 17:23:23,316] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 19: [2023-04-29 17:23:23,316] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 19: [2023-04-29 17:23:23,316] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 19: [2023-04-29 17:23:23,316] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 19: [2023-04-29 17:23:23,316] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 19: [2023-04-29 17:23:23,316] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 19: [2023-04-29 17:23:23,317] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 19: [2023-04-29 17:23:23,321] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 19: [2023-04-29 17:23:23,321] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 19: [2023-04-29 17:23:23,321] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 13: [2023-04-29 17:23:23,324] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 13: [2023-04-29 17:23:23,324] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 19: [2023-04-29 17:23:23,324] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 13: [2023-04-29 17:23:23,324] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 13: [2023-04-29 17:23:23,324] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 13: [2023-04-29 17:23:23,324] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 13: [2023-04-29 17:23:23,324] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 13: [2023-04-29 17:23:23,324] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 19: [2023-04-29 17:23:23,325] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 13: [2023-04-29 17:23:23,325] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 19: [2023-04-29 17:23:23,325] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 19: [2023-04-29 17:23:23,325] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 19: [2023-04-29 17:23:23,327] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 3: [2023-04-29 17:23:23,329] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 3: [2023-04-29 17:23:23,329] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 3: [2023-04-29 17:23:23,329] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 3: [2023-04-29 17:23:23,329] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 3: [2023-04-29 17:23:23,329] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 3: [2023-04-29 17:23:23,329] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 3: [2023-04-29 17:23:23,329] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 13: [2023-04-29 17:23:23,329] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 3: [2023-04-29 17:23:23,329] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 13: [2023-04-29 17:23:23,331] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 7: [2023-04-29 17:23:23,331] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 7: [2023-04-29 17:23:23,331] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 7: [2023-04-29 17:23:23,332] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 3: [2023-04-29 17:23:23,333] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 7: [2023-04-29 17:23:23,333] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 3: [2023-04-29 17:23:23,333] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 22: [2023-04-29 17:23:23,333] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 22: [2023-04-29 17:23:23,333] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 22: [2023-04-29 17:23:23,333] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 22: [2023-04-29 17:23:23,333] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 22: [2023-04-29 17:23:23,333] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 22: [2023-04-29 17:23:23,333] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 22: [2023-04-29 17:23:23,333] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 7: [2023-04-29 17:23:23,334] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 22: [2023-04-29 17:23:23,334] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 13: [2023-04-29 17:23:23,334] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 13: [2023-04-29 17:23:23,335] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 13: [2023-04-29 17:23:23,336] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 3: [2023-04-29 17:23:23,336] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 13: [2023-04-29 17:23:23,336] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 3: [2023-04-29 17:23:23,336] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 13: [2023-04-29 17:23:23,337] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 3: [2023-04-29 17:23:23,337] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 13: [2023-04-29 17:23:23,337] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 3: [2023-04-29 17:23:23,337] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 22: [2023-04-29 17:23:23,337] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 3: [2023-04-29 17:23:23,338] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 22: [2023-04-29 17:23:23,338] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 3: [2023-04-29 17:23:23,338] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 16: [2023-04-29 17:23:23,339] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 16: [2023-04-29 17:23:23,339] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 16: [2023-04-29 17:23:23,342] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 22: [2023-04-29 17:23:23,342] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 22: [2023-04-29 17:23:23,343] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 22: [2023-04-29 17:23:23,343] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 16: [2023-04-29 17:23:23,344] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 22: [2023-04-29 17:23:23,344] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 22: [2023-04-29 17:23:23,344] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 22: [2023-04-29 17:23:23,345] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 28: [2023-04-29 17:23:23,317] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 28: [2023-04-29 17:23:23,321] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 28: [2023-04-29 17:23:23,323] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 28: [2023-04-29 17:23:23,323] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 28: [2023-04-29 17:23:23,338] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 28: [2023-04-29 17:23:23,339] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 28: [2023-04-29 17:23:23,342] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 28: [2023-04-29 17:23:23,342] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 16: [2023-04-29 17:23:23,355] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 16: [2023-04-29 17:23:23,355] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 16: [2023-04-29 17:23:23,355] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 16: [2023-04-29 17:23:23,355] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 16: [2023-04-29 17:23:23,364] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 16: [2023-04-29 17:23:23,365] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 16: [2023-04-29 17:23:23,366] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 16: [2023-04-29 17:23:23,368] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 14: [2023-04-29 17:23:23,368] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 14: [2023-04-29 17:23:23,368] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 14: [2023-04-29 17:23:23,368] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 14: [2023-04-29 17:23:23,368] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 14: [2023-04-29 17:23:23,368] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 14: [2023-04-29 17:23:23,368] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 14: [2023-04-29 17:23:23,368] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 14: [2023-04-29 17:23:23,369] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 14: [2023-04-29 17:23:23,372] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 19: [2023-04-29 17:23:23,375] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 19: [2023-04-29 17:23:23,375] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 19: [2023-04-29 17:23:23,375] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 16: [2023-04-29 17:23:23,379] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 14: [2023-04-29 17:23:23,379] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 16: [2023-04-29 17:23:23,379] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 14: [2023-04-29 17:23:23,380] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 14: [2023-04-29 17:23:23,380] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 14: [2023-04-29 17:23:23,381] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 14: [2023-04-29 17:23:23,381] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 13: [2023-04-29 17:23:23,381] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 14: [2023-04-29 17:23:23,382] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 14: [2023-04-29 17:23:23,382] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 13: [2023-04-29 17:23:23,382] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 16: [2023-04-29 17:23:23,383] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 16: [2023-04-29 17:23:23,383] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 3: [2023-04-29 17:23:23,383] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 3: [2023-04-29 17:23:23,385] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 22: [2023-04-29 17:23:23,389] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 22: [2023-04-29 17:23:23,389] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 19: [2023-04-29 17:23:23,392] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 19: [2023-04-29 17:23:23,392] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 19: [2023-04-29 17:23:23,392] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 19: [2023-04-29 17:23:23,392] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 19: [2023-04-29 17:23:23,393] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 1: [2023-04-29 17:23:23,393] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 1: [2023-04-29 17:23:23,393] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 1: [2023-04-29 17:23:23,393] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 1: [2023-04-29 17:23:23,393] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 1: [2023-04-29 17:23:23,393] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 1: [2023-04-29 17:23:23,393] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 1: [2023-04-29 17:23:23,393] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 1: [2023-04-29 17:23:23,394] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 19: [2023-04-29 17:23:23,395] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 19: [2023-04-29 17:23:23,397] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 19: [2023-04-29 17:23:23,398] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 1: [2023-04-29 17:23:23,398] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 1: [2023-04-29 17:23:23,398] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 1: [2023-04-29 17:23:23,399] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 1: [2023-04-29 17:23:23,399] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 1: [2023-04-29 17:23:23,400] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 1: [2023-04-29 17:23:23,401] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 1: [2023-04-29 17:23:23,401] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 1: [2023-04-29 17:23:23,402] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 13: [2023-04-29 17:23:23,402] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 13: [2023-04-29 17:23:23,405] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 13: [2023-04-29 17:23:23,405] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 13: [2023-04-29 17:23:23,405] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 13: [2023-04-29 17:23:23,406] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 13: [2023-04-29 17:23:23,406] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 13: [2023-04-29 17:23:23,406] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 13: [2023-04-29 17:23:23,406] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 3: [2023-04-29 17:23:23,408] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 3: [2023-04-29 17:23:23,408] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 3: [2023-04-29 17:23:23,408] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 3: [2023-04-29 17:23:23,408] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 3: [2023-04-29 17:23:23,408] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 22: [2023-04-29 17:23:23,408] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 3: [2023-04-29 17:23:23,408] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 22: [2023-04-29 17:23:23,410] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 3: [2023-04-29 17:23:23,411] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 3: [2023-04-29 17:23:23,411] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 22: [2023-04-29 17:23:23,413] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 22: [2023-04-29 17:23:23,413] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 22: [2023-04-29 17:23:23,413] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 22: [2023-04-29 17:23:23,413] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 31: [2023-04-29 17:23:23,415] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 31: [2023-04-29 17:23:23,415] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 31: [2023-04-29 17:23:23,415] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 31: [2023-04-29 17:23:23,415] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 31: [2023-04-29 17:23:23,415] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 31: [2023-04-29 17:23:23,415] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 31: [2023-04-29 17:23:23,415] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 31: [2023-04-29 17:23:23,416] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 22: [2023-04-29 17:23:23,416] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 22: [2023-04-29 17:23:23,416] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 19: [2023-04-29 17:23:23,419] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 31: [2023-04-29 17:23:23,420] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 31: [2023-04-29 17:23:23,420] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 31: [2023-04-29 17:23:23,420] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 19: [2023-04-29 17:23:23,420] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 31: [2023-04-29 17:23:23,422] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 31: [2023-04-29 17:23:23,422] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 31: [2023-04-29 17:23:23,422] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 19: [2023-04-29 17:23:23,422] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 31: [2023-04-29 17:23:23,422] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 14: [2023-04-29 17:23:23,422] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 31: [2023-04-29 17:23:23,422] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 8: [2023-04-29 17:23:23,424] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 8: [2023-04-29 17:23:23,424] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 8: [2023-04-29 17:23:23,424] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 8: [2023-04-29 17:23:23,424] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 8: [2023-04-29 17:23:23,424] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 8: [2023-04-29 17:23:23,424] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 8: [2023-04-29 17:23:23,424] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 8: [2023-04-29 17:23:23,424] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 19: [2023-04-29 17:23:23,425] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 27: [2023-04-29 17:23:23,424] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 27: [2023-04-29 17:23:23,425] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 27: [2023-04-29 17:23:23,425] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 27: [2023-04-29 17:23:23,425] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 27: [2023-04-29 17:23:23,425] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 27: [2023-04-29 17:23:23,425] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 27: [2023-04-29 17:23:23,425] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 27: [2023-04-29 17:23:23,425] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 19: [2023-04-29 17:23:23,428] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 27: [2023-04-29 17:23:23,429] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 8: [2023-04-29 17:23:23,430] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 8: [2023-04-29 17:23:23,431] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 8: [2023-04-29 17:23:23,431] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 8: [2023-04-29 17:23:23,432] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 8: [2023-04-29 17:23:23,432] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 8: [2023-04-29 17:23:23,433] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 8: [2023-04-29 17:23:23,434] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 8: [2023-04-29 17:23:23,434] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 27: [2023-04-29 17:23:23,435] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 3: [2023-04-29 17:23:23,436] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 27: [2023-04-29 17:23:23,437] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 3: [2023-04-29 17:23:23,437] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 27: [2023-04-29 17:23:23,437] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 27: [2023-04-29 17:23:23,438] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 27: [2023-04-29 17:23:23,438] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 27: [2023-04-29 17:23:23,438] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 12: [2023-04-29 17:23:23,438] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 12: [2023-04-29 17:23:23,438] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 12: [2023-04-29 17:23:23,438] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 12: [2023-04-29 17:23:23,438] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 12: [2023-04-29 17:23:23,438] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 12: [2023-04-29 17:23:23,438] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 12: [2023-04-29 17:23:23,438] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 12: [2023-04-29 17:23:23,439] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 3: [2023-04-29 17:23:23,439] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 26: [2023-04-29 17:23:23,438] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 26: [2023-04-29 17:23:23,438] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 26: [2023-04-29 17:23:23,439] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 26: [2023-04-29 17:23:23,439] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 26: [2023-04-29 17:23:23,439] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 27: [2023-04-29 17:23:23,439] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 26: [2023-04-29 17:23:23,440] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 26: [2023-04-29 17:23:23,440] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 22: [2023-04-29 17:23:23,440] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 13: [2023-04-29 17:23:23,440] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 26: [2023-04-29 17:23:23,440] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 3: [2023-04-29 17:23:23,441] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 3: [2023-04-29 17:23:23,441] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 3: [2023-04-29 17:23:23,441] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 14: [2023-04-29 17:23:23,442] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 12: [2023-04-29 17:23:23,442] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 13: [2023-04-29 17:23:23,443] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 12: [2023-04-29 17:23:23,445] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 13: [2023-04-29 17:23:23,445] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 17: [2023-04-29 17:23:23,445] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 12: [2023-04-29 17:23:23,446] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 12: [2023-04-29 17:23:23,446] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 17: [2023-04-29 17:23:23,445] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 17: [2023-04-29 17:23:23,446] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 26: [2023-04-29 17:23:23,446] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 26: [2023-04-29 17:23:23,446] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 12: [2023-04-29 17:23:23,446] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 13: [2023-04-29 17:23:23,446] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 13: [2023-04-29 17:23:23,446] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 13: [2023-04-29 17:23:23,446] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 26: [2023-04-29 17:23:23,446] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 17: [2023-04-29 17:23:23,446] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 12: [2023-04-29 17:23:23,447] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 17: [2023-04-29 17:23:23,447] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 17: [2023-04-29 17:23:23,447] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 17: [2023-04-29 17:23:23,447] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 26: [2023-04-29 17:23:23,447] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 26: [2023-04-29 17:23:23,447] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 17: [2023-04-29 17:23:23,447] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 12: [2023-04-29 17:23:23,447] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 22: [2023-04-29 17:23:23,447] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 22: [2023-04-29 17:23:23,447] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 26: [2023-04-29 17:23:23,447] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 26: [2023-04-29 17:23:23,448] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 26: [2023-04-29 17:23:23,448] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 12: [2023-04-29 17:23:23,448] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 22: [2023-04-29 17:23:23,449] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 22: [2023-04-29 17:23:23,449] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 22: [2023-04-29 17:23:23,449] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 17: [2023-04-29 17:23:23,451] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 17: [2023-04-29 17:23:23,453] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 14: [2023-04-29 17:23:23,453] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 14: [2023-04-29 17:23:23,453] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 1: [2023-04-29 17:23:23,454] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 1: [2023-04-29 17:23:23,454] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 1: [2023-04-29 17:23:23,454] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 1: [2023-04-29 17:23:23,454] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 17: [2023-04-29 17:23:23,455] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 17: [2023-04-29 17:23:23,455] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 17: [2023-04-29 17:23:23,456] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 17: [2023-04-29 17:23:23,457] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 17: [2023-04-29 17:23:23,457] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 17: [2023-04-29 17:23:23,458] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 1: [2023-04-29 17:23:23,459] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 1: [2023-04-29 17:23:23,460] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 1: [2023-04-29 17:23:23,460] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 1: [2023-04-29 17:23:23,460] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 14: [2023-04-29 17:23:23,460] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 14: [2023-04-29 17:23:23,460] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 14: [2023-04-29 17:23:23,460] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 14: [2023-04-29 17:23:23,460] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 14: [2023-04-29 17:23:23,460] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 9: [2023-04-29 17:23:23,466] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 9: [2023-04-29 17:23:23,466] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 9: [2023-04-29 17:23:23,466] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 9: [2023-04-29 17:23:23,466] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 9: [2023-04-29 17:23:23,466] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 9: [2023-04-29 17:23:23,466] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 9: [2023-04-29 17:23:23,466] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 9: [2023-04-29 17:23:23,467] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 9: [2023-04-29 17:23:23,470] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 10: [2023-04-29 17:23:23,470] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 10: [2023-04-29 17:23:23,470] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 9: [2023-04-29 17:23:23,471] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 10: [2023-04-29 17:23:23,471] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 10: [2023-04-29 17:23:23,471] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 9: [2023-04-29 17:23:23,472] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 9: [2023-04-29 17:23:23,472] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 31: [2023-04-29 17:23:23,472] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 31: [2023-04-29 17:23:23,472] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 31: [2023-04-29 17:23:23,472] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 9: [2023-04-29 17:23:23,472] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 10: [2023-04-29 17:23:23,472] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 10: [2023-04-29 17:23:23,472] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 10: [2023-04-29 17:23:23,472] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 10: [2023-04-29 17:23:23,472] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 9: [2023-04-29 17:23:23,472] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 9: [2023-04-29 17:23:23,472] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 9: [2023-04-29 17:23:23,473] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 2: [2023-04-29 17:23:23,474] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 2: [2023-04-29 17:23:23,474] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 2: [2023-04-29 17:23:23,475] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 10: [2023-04-29 17:23:23,476] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 10: [2023-04-29 17:23:23,476] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 2: [2023-04-29 17:23:23,476] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 2: [2023-04-29 17:23:23,476] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 2: [2023-04-29 17:23:23,476] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 2: [2023-04-29 17:23:23,476] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 10: [2023-04-29 17:23:23,477] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 2: [2023-04-29 17:23:23,477] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 1: [2023-04-29 17:23:23,477] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 10: [2023-04-29 17:23:23,477] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 1: [2023-04-29 17:23:23,477] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 2: [2023-04-29 17:23:23,478] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 27: [2023-04-29 17:23:23,479] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 21: [2023-04-29 17:23:23,479] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 21: [2023-04-29 17:23:23,479] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 2: [2023-04-29 17:23:23,479] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 21: [2023-04-29 17:23:23,480] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 21: [2023-04-29 17:23:23,480] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 21: [2023-04-29 17:23:23,480] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 21: [2023-04-29 17:23:23,480] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 21: [2023-04-29 17:23:23,480] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 2: [2023-04-29 17:23:23,480] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 1: [2023-04-29 17:23:23,480] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 10: [2023-04-29 17:23:23,480] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 1: [2023-04-29 17:23:23,480] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 21: [2023-04-29 17:23:23,480] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 14: [2023-04-29 17:23:23,481] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 14: [2023-04-29 17:23:23,481] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 10: [2023-04-29 17:23:23,481] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 10: [2023-04-29 17:23:23,482] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 10: [2023-04-29 17:23:23,482] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 8: [2023-04-29 17:23:23,484] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 8: [2023-04-29 17:23:23,484] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 21: [2023-04-29 17:23:23,485] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 21: [2023-04-29 17:23:23,485] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 21: [2023-04-29 17:23:23,485] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 2: [2023-04-29 17:23:23,485] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 2: [2023-04-29 17:23:23,485] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 21: [2023-04-29 17:23:23,485] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 21: [2023-04-29 17:23:23,485] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 2: [2023-04-29 17:23:23,486] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 21: [2023-04-29 17:23:23,486] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 8: [2023-04-29 17:23:23,486] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 21: [2023-04-29 17:23:23,486] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 2: [2023-04-29 17:23:23,486] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 21: [2023-04-29 17:23:23,486] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 1: [2023-04-29 17:23:23,487] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 2: [2023-04-29 17:23:23,487] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 31: [2023-04-29 17:23:23,488] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 31: [2023-04-29 17:23:23,488] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 31: [2023-04-29 17:23:23,488] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 31: [2023-04-29 17:23:23,488] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 31: [2023-04-29 17:23:23,488] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 12: [2023-04-29 17:23:23,488] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 1: [2023-04-29 17:23:23,489] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 1: [2023-04-29 17:23:23,489] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 1: [2023-04-29 17:23:23,489] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 30: [2023-04-29 17:23:23,489] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 30: [2023-04-29 17:23:23,490] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 30: [2023-04-29 17:23:23,490] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 30: [2023-04-29 17:23:23,490] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 30: [2023-04-29 17:23:23,490] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 30: [2023-04-29 17:23:23,490] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 30: [2023-04-29 17:23:23,490] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 30: [2023-04-29 17:23:23,490] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 8: [2023-04-29 17:23:23,492] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 8: [2023-04-29 17:23:23,493] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 31: [2023-04-29 17:23:23,493] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 31: [2023-04-29 17:23:23,494] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 14: [2023-04-29 17:23:23,494] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 31: [2023-04-29 17:23:23,494] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 8: [2023-04-29 17:23:23,495] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 8: [2023-04-29 17:23:23,495] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 8: [2023-04-29 17:23:23,495] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 14: [2023-04-29 17:23:23,496] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 14: [2023-04-29 17:23:23,497] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 27: [2023-04-29 17:23:23,498] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 14: [2023-04-29 17:23:23,500] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 26: [2023-04-29 17:23:23,500] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 14: [2023-04-29 17:23:23,501] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 30: [2023-04-29 17:23:23,502] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 30: [2023-04-29 17:23:23,502] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 30: [2023-04-29 17:23:23,502] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 27: [2023-04-29 17:23:23,502] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 30: [2023-04-29 17:23:23,502] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 26: [2023-04-29 17:23:23,502] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 30: [2023-04-29 17:23:23,503] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 30: [2023-04-29 17:23:23,503] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 17: [2023-04-29 17:23:23,504] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 30: [2023-04-29 17:23:23,504] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 30: [2023-04-29 17:23:23,505] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 12: [2023-04-29 17:23:23,505] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 12: [2023-04-29 17:23:23,505] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 26: [2023-04-29 17:23:23,505] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 12: [2023-04-29 17:23:23,506] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 8: [2023-04-29 17:23:23,508] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 17: [2023-04-29 17:23:23,508] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 12: [2023-04-29 17:23:23,510] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 8: [2023-04-29 17:23:23,511] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 31: [2023-04-29 17:23:23,513] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 27: [2023-04-29 17:23:23,513] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 27: [2023-04-29 17:23:23,513] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 27: [2023-04-29 17:23:23,513] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 26: [2023-04-29 17:23:23,513] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 8: [2023-04-29 17:23:23,514] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 26: [2023-04-29 17:23:23,514] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 26: [2023-04-29 17:23:23,514] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 26: [2023-04-29 17:23:23,514] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 26: [2023-04-29 17:23:23,514] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 27: [2023-04-29 17:23:23,516] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 12: [2023-04-29 17:23:23,517] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 31: [2023-04-29 17:23:23,517] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 31: [2023-04-29 17:23:23,517] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 31: [2023-04-29 17:23:23,517] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 12: [2023-04-29 17:23:23,517] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 12: [2023-04-29 17:23:23,517] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 12: [2023-04-29 17:23:23,517] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 31: [2023-04-29 17:23:23,518] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 8: [2023-04-29 17:23:23,522] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 9: [2023-04-29 17:23:23,521] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 8: [2023-04-29 17:23:23,523] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 8: [2023-04-29 17:23:23,523] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 6: [2023-04-29 17:23:23,524] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 6: [2023-04-29 17:23:23,524] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 6: [2023-04-29 17:23:23,524] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 26: [2023-04-29 17:23:23,524] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 6: [2023-04-29 17:23:23,524] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 6: [2023-04-29 17:23:23,524] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 6: [2023-04-29 17:23:23,524] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 6: [2023-04-29 17:23:23,524] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 6: [2023-04-29 17:23:23,524] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 17: [2023-04-29 17:23:23,524] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 9: [2023-04-29 17:23:23,524] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 2: [2023-04-29 17:23:23,524] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 8: [2023-04-29 17:23:23,525] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 8: [2023-04-29 17:23:23,525] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 20: [2023-04-29 17:23:23,527] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 20: [2023-04-29 17:23:23,527] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 27: [2023-04-29 17:23:23,527] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 6: [2023-04-29 17:23:23,527] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 12: [2023-04-29 17:23:23,527] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 6: [2023-04-29 17:23:23,528] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 17: [2023-04-29 17:23:23,528] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 17: [2023-04-29 17:23:23,529] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 17: [2023-04-29 17:23:23,529] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 17: [2023-04-29 17:23:23,529] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 17: [2023-04-29 17:23:23,529] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 27: [2023-04-29 17:23:23,530] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 17: [2023-04-29 17:23:23,530] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 12: [2023-04-29 17:23:23,530] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 17: [2023-04-29 17:23:23,530] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 26: [2023-04-29 17:23:23,531] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 20: [2023-04-29 17:23:23,532] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 20: [2023-04-29 17:23:23,532] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 20: [2023-04-29 17:23:23,532] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 20: [2023-04-29 17:23:23,532] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 20: [2023-04-29 17:23:23,532] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 12: [2023-04-29 17:23:23,532] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 20: [2023-04-29 17:23:23,532] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 20: [2023-04-29 17:23:23,532] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 20: [2023-04-29 17:23:23,532] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 26: [2023-04-29 17:23:23,533] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 6: [2023-04-29 17:23:23,533] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 6: [2023-04-29 17:23:23,533] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 6: [2023-04-29 17:23:23,534] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 9: [2023-04-29 17:23:23,533] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 9: [2023-04-29 17:23:23,533] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 9: [2023-04-29 17:23:23,534] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 6: [2023-04-29 17:23:23,534] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 6: [2023-04-29 17:23:23,534] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 10: [2023-04-29 17:23:23,534] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 10: [2023-04-29 17:23:23,534] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 10: [2023-04-29 17:23:23,534] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 10: [2023-04-29 17:23:23,534] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 27: [2023-04-29 17:23:23,534] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 6: [2023-04-29 17:23:23,535] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 2: [2023-04-29 17:23:23,536] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 2: [2023-04-29 17:23:23,536] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 20: [2023-04-29 17:23:23,537] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 9: [2023-04-29 17:23:23,537] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 9: [2023-04-29 17:23:23,537] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 9: [2023-04-29 17:23:23,537] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 20: [2023-04-29 17:23:23,539] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 27: [2023-04-29 17:23:23,538] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 10: [2023-04-29 17:23:23,538] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 10: [2023-04-29 17:23:23,538] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 10: [2023-04-29 17:23:23,538] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 10: [2023-04-29 17:23:23,538] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 21: [2023-04-29 17:23:23,539] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 21: [2023-04-29 17:23:23,539] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 21: [2023-04-29 17:23:23,539] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 20: [2023-04-29 17:23:23,541] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 20: [2023-04-29 17:23:23,542] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 27: [2023-04-29 17:23:23,542] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 27: [2023-04-29 17:23:23,542] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 20: [2023-04-29 17:23:23,542] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 9: [2023-04-29 17:23:23,542] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 20: [2023-04-29 17:23:23,542] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 26: [2023-04-29 17:23:23,543] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 24: [2023-04-29 17:23:23,543] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 26: [2023-04-29 17:23:23,544] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 24: [2023-04-29 17:23:23,544] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 24: [2023-04-29 17:23:23,544] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 24: [2023-04-29 17:23:23,544] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 2: [2023-04-29 17:23:23,545] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 24: [2023-04-29 17:23:23,545] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 24: [2023-04-29 17:23:23,545] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 24: [2023-04-29 17:23:23,545] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 24: [2023-04-29 17:23:23,545] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 12: [2023-04-29 17:23:23,546] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 18: [2023-04-29 17:23:23,546] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 18: [2023-04-29 17:23:23,546] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 18: [2023-04-29 17:23:23,546] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 12: [2023-04-29 17:23:23,546] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 18: [2023-04-29 17:23:23,546] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 18: [2023-04-29 17:23:23,546] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 18: [2023-04-29 17:23:23,546] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 18: [2023-04-29 17:23:23,546] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 18: [2023-04-29 17:23:23,547] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 9: [2023-04-29 17:23:23,548] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 12: [2023-04-29 17:23:23,548] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 12: [2023-04-29 17:23:23,548] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 15: [2023-04-29 17:23:23,547] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 15: [2023-04-29 17:23:23,547] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 15: [2023-04-29 17:23:23,547] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 15: [2023-04-29 17:23:23,547] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 15: [2023-04-29 17:23:23,548] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 15: [2023-04-29 17:23:23,548] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 15: [2023-04-29 17:23:23,548] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 24: [2023-04-29 17:23:23,548] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 15: [2023-04-29 17:23:23,548] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 26: [2023-04-29 17:23:23,548] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 27: [2023-04-29 17:23:23,550] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 26: [2023-04-29 17:23:23,550] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 26: [2023-04-29 17:23:23,551] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 2: [2023-04-29 17:23:23,551] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 2: [2023-04-29 17:23:23,551] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 2: [2023-04-29 17:23:23,551] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 2: [2023-04-29 17:23:23,553] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 21: [2023-04-29 17:23:23,553] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 21: [2023-04-29 17:23:23,553] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 21: [2023-04-29 17:23:23,553] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 21: [2023-04-29 17:23:23,553] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 21: [2023-04-29 17:23:23,553] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 7: [2023-04-29 17:23:23,554] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 7: [2023-04-29 17:23:23,554] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 7: [2023-04-29 17:23:23,554] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 7: [2023-04-29 17:23:23,554] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 7: [2023-04-29 17:23:23,554] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 7: [2023-04-29 17:23:23,554] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 7: [2023-04-29 17:23:23,554] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 7: [2023-04-29 17:23:23,554] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 24: [2023-04-29 17:23:23,554] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 2: [2023-04-29 17:23:23,555] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 24: [2023-04-29 17:23:23,556] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 24: [2023-04-29 17:23:23,556] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 9: [2023-04-29 17:23:23,557] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 24: [2023-04-29 17:23:23,557] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 24: [2023-04-29 17:23:23,557] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 2: [2023-04-29 17:23:23,558] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 24: [2023-04-29 17:23:23,558] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 24: [2023-04-29 17:23:23,558] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 2: [2023-04-29 17:23:23,558] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 7: [2023-04-29 17:23:23,558] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 7: [2023-04-29 17:23:23,558] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 17: [2023-04-29 17:23:23,559] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 7: [2023-04-29 17:23:23,559] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 18: [2023-04-29 17:23:23,559] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 18: [2023-04-29 17:23:23,559] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 7: [2023-04-29 17:23:23,560] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 23: [2023-04-29 17:23:23,560] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 27: [2023-04-29 17:23:23,560] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 10: [2023-04-29 17:23:23,560] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 7: [2023-04-29 17:23:23,560] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 10: [2023-04-29 17:23:23,560] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 18: [2023-04-29 17:23:23,560] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 9: [2023-04-29 17:23:23,560] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 7: [2023-04-29 17:23:23,560] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 27: [2023-04-29 17:23:23,560] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 23: [2023-04-29 17:23:23,561] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 7: [2023-04-29 17:23:23,561] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 5: [2023-04-29 17:23:23,561] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 5: [2023-04-29 17:23:23,561] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 23: [2023-04-29 17:23:23,561] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 23: [2023-04-29 17:23:23,561] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 23: [2023-04-29 17:23:23,561] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 23: [2023-04-29 17:23:23,561] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 23: [2023-04-29 17:23:23,561] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 7: [2023-04-29 17:23:23,561] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 15: [2023-04-29 17:23:23,560] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 15: [2023-04-29 17:23:23,561] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 15: [2023-04-29 17:23:23,561] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 18: [2023-04-29 17:23:23,561] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 9: [2023-04-29 17:23:23,561] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 23: [2023-04-29 17:23:23,561] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 18: [2023-04-29 17:23:23,561] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 15: [2023-04-29 17:23:23,561] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 15: [2023-04-29 17:23:23,562] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 18: [2023-04-29 17:23:23,562] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 9: [2023-04-29 17:23:23,562] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 15: [2023-04-29 17:23:23,562] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 18: [2023-04-29 17:23:23,562] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 18: [2023-04-29 17:23:23,562] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 21: [2023-04-29 17:23:23,563] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 21: [2023-04-29 17:23:23,563] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 15: [2023-04-29 17:23:23,563] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 15: [2023-04-29 17:23:23,563] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 9: [2023-04-29 17:23:23,563] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 21: [2023-04-29 17:23:23,563] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 10: [2023-04-29 17:23:23,564] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 9: [2023-04-29 17:23:23,564] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 10: [2023-04-29 17:23:23,564] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 17: [2023-04-29 17:23:23,564] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 5: [2023-04-29 17:23:23,564] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 5: [2023-04-29 17:23:23,564] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 5: [2023-04-29 17:23:23,564] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 5: [2023-04-29 17:23:23,564] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 5: [2023-04-29 17:23:23,564] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 5: [2023-04-29 17:23:23,565] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 17: [2023-04-29 17:23:23,565] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 23: [2023-04-29 17:23:23,565] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 5: [2023-04-29 17:23:23,565] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 17: [2023-04-29 17:23:23,565] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 5: [2023-04-29 17:23:23,566] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 17: [2023-04-29 17:23:23,566] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 23: [2023-04-29 17:23:23,566] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 17: [2023-04-29 17:23:23,566] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 10: [2023-04-29 17:23:23,569] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 23: [2023-04-29 17:23:23,569] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 23: [2023-04-29 17:23:23,570] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 5: [2023-04-29 17:23:23,570] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 6: [2023-04-29 17:23:23,570] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 23: [2023-04-29 17:23:23,571] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 23: [2023-04-29 17:23:23,571] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 23: [2023-04-29 17:23:23,572] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 23: [2023-04-29 17:23:23,572] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 10: [2023-04-29 17:23:23,572] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 10: [2023-04-29 17:23:23,572] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 10: [2023-04-29 17:23:23,572] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 5: [2023-04-29 17:23:23,574] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 5: [2023-04-29 17:23:23,574] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 5: [2023-04-29 17:23:23,575] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 5: [2023-04-29 17:23:23,575] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 30: [2023-04-29 17:23:23,576] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 5: [2023-04-29 17:23:23,576] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 2: [2023-04-29 17:23:23,579] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 21: [2023-04-29 17:23:23,579] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 21: [2023-04-29 17:23:23,580] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 6: [2023-04-29 17:23:23,580] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 21: [2023-04-29 17:23:23,581] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 2: [2023-04-29 17:23:23,582] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 2: [2023-04-29 17:23:23,582] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 21: [2023-04-29 17:23:23,583] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 21: [2023-04-29 17:23:23,583] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 2: [2023-04-29 17:23:23,585] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 2: [2023-04-29 17:23:23,585] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 20: [2023-04-29 17:23:23,586] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 20: [2023-04-29 17:23:23,586] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 29: [2023-04-29 17:23:23,586] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 29: [2023-04-29 17:23:23,586] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 29: [2023-04-29 17:23:23,587] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 29: [2023-04-29 17:23:23,587] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 29: [2023-04-29 17:23:23,587] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 29: [2023-04-29 17:23:23,587] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 29: [2023-04-29 17:23:23,587] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 29: [2023-04-29 17:23:23,587] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 29: [2023-04-29 17:23:23,590] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 29: [2023-04-29 17:23:23,590] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 6: [2023-04-29 17:23:23,590] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 4: [2023-04-29 17:23:23,591] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 4: [2023-04-29 17:23:23,591] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 20: [2023-04-29 17:23:23,593] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 30: [2023-04-29 17:23:23,594] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 30: [2023-04-29 17:23:23,594] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 30: [2023-04-29 17:23:23,594] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 30: [2023-04-29 17:23:23,594] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 30: [2023-04-29 17:23:23,594] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 30: [2023-04-29 17:23:23,594] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 30: [2023-04-29 17:23:23,594] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 25: [2023-04-29 17:23:23,595] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 25: [2023-04-29 17:23:23,595] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 4: [2023-04-29 17:23:23,595] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 4: [2023-04-29 17:23:23,595] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 4: [2023-04-29 17:23:23,595] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 4: [2023-04-29 17:23:23,595] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 4: [2023-04-29 17:23:23,595] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 4: [2023-04-29 17:23:23,595] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 4: [2023-04-29 17:23:23,595] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 4: [2023-04-29 17:23:23,596] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 29: [2023-04-29 17:23:23,596] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 29: [2023-04-29 17:23:23,596] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 0: [2023-04-29 17:23:23,597] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 0: [2023-04-29 17:23:23,597] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 0: [2023-04-29 17:23:23,597] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 0: [2023-04-29 17:23:23,597] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 0: [2023-04-29 17:23:23,597] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 0: [2023-04-29 17:23:23,597] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 0: [2023-04-29 17:23:23,597] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 29: [2023-04-29 17:23:23,597] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 0: [2023-04-29 17:23:23,598] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 24: [2023-04-29 17:23:23,597] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 29: [2023-04-29 17:23:23,598] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 29: [2023-04-29 17:23:23,598] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 11: [2023-04-29 17:23:23,598] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 11: [2023-04-29 17:23:23,598] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 29: [2023-04-29 17:23:23,598] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 30: [2023-04-29 17:23:23,599] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 25: [2023-04-29 17:23:23,599] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 25: [2023-04-29 17:23:23,599] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 25: [2023-04-29 17:23:23,599] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 25: [2023-04-29 17:23:23,599] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 25: [2023-04-29 17:23:23,599] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 25: [2023-04-29 17:23:23,599] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 25: [2023-04-29 17:23:23,599] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 25: [2023-04-29 17:23:23,599] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 20: [2023-04-29 17:23:23,602] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 20: [2023-04-29 17:23:23,602] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 11: [2023-04-29 17:23:23,602] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 11: [2023-04-29 17:23:23,603] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 11: [2023-04-29 17:23:23,603] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 11: [2023-04-29 17:23:23,603] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 11: [2023-04-29 17:23:23,603] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 11: [2023-04-29 17:23:23,603] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 6: [2023-04-29 17:23:23,603] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 6: [2023-04-29 17:23:23,603] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 11: [2023-04-29 17:23:23,603] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 11: [2023-04-29 17:23:23,603] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 4: [2023-04-29 17:23:23,605] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 4: [2023-04-29 17:23:23,606] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 0: [2023-04-29 17:23:23,606] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 4: [2023-04-29 17:23:23,606] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 28: [2023-04-29 17:23:23,606] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 28: [2023-04-29 17:23:23,606] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 28: [2023-04-29 17:23:23,606] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 28: [2023-04-29 17:23:23,606] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 28: [2023-04-29 17:23:23,606] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 28: [2023-04-29 17:23:23,606] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 28: [2023-04-29 17:23:23,606] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 4: [2023-04-29 17:23:23,607] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 28: [2023-04-29 17:23:23,607] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 20: [2023-04-29 17:23:23,607] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 4: [2023-04-29 17:23:23,608] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 11: [2023-04-29 17:23:23,607] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 4: [2023-04-29 17:23:23,608] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 20: [2023-04-29 17:23:23,608] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 6: [2023-04-29 17:23:23,608] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 6: [2023-04-29 17:23:23,608] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 6: [2023-04-29 17:23:23,608] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 6: [2023-04-29 17:23:23,608] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 20: [2023-04-29 17:23:23,608] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 20: [2023-04-29 17:23:23,608] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 6: [2023-04-29 17:23:23,608] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 25: [2023-04-29 17:23:23,608] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 20: [2023-04-29 17:23:23,608] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 25: [2023-04-29 17:23:23,609] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 25: [2023-04-29 17:23:23,609] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 25: [2023-04-29 17:23:23,609] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 0: [2023-04-29 17:23:23,610] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 23: [2023-04-29 17:23:23,610] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 11: [2023-04-29 17:23:23,610] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 25: [2023-04-29 17:23:23,611] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 25: [2023-04-29 17:23:23,611] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 0: [2023-04-29 17:23:23,611] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 0: [2023-04-29 17:23:23,611] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 7: [2023-04-29 17:23:23,611] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 7: [2023-04-29 17:23:23,611] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 7: [2023-04-29 17:23:23,611] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 0: [2023-04-29 17:23:23,612] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 0: [2023-04-29 17:23:23,612] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 11: [2023-04-29 17:23:23,612] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 0: [2023-04-29 17:23:23,613] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 11: [2023-04-29 17:23:23,613] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 11: [2023-04-29 17:23:23,614] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 0: [2023-04-29 17:23:23,614] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 11: [2023-04-29 17:23:23,614] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 5: [2023-04-29 17:23:23,617] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 5: [2023-04-29 17:23:23,617] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 28: [2023-04-29 17:23:23,618] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 28: [2023-04-29 17:23:23,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 24: [2023-04-29 17:23:23,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 28: [2023-04-29 17:23:23,620] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 28: [2023-04-29 17:23:23,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 28: [2023-04-29 17:23:23,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 28: [2023-04-29 17:23:23,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 20: [2023-04-29 17:23:23,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 28: [2023-04-29 17:23:23,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 28: [2023-04-29 17:23:23,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt... 23: [2023-04-29 17:23:23,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 20: [2023-04-29 17:23:23,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 7: [2023-04-29 17:23:23,627] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 7: [2023-04-29 17:23:23,627] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 7: [2023-04-29 17:23:23,627] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 7: [2023-04-29 17:23:23,627] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 7: [2023-04-29 17:23:23,627] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 5: [2023-04-29 17:23:23,628] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 24: [2023-04-29 17:23:23,628] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 20: [2023-04-29 17:23:23,629] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 30: [2023-04-29 17:23:23,629] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 30: [2023-04-29 17:23:23,629] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 23: [2023-04-29 17:23:23,630] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 7: [2023-04-29 17:23:23,631] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 30: [2023-04-29 17:23:23,631] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 30: [2023-04-29 17:23:23,632] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 24: [2023-04-29 17:23:23,632] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 24: [2023-04-29 17:23:23,632] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 30: [2023-04-29 17:23:23,632] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 24: [2023-04-29 17:23:23,633] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 7: [2023-04-29 17:23:23,633] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 20: [2023-04-29 17:23:23,633] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 7: [2023-04-29 17:23:23,634] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 23: [2023-04-29 17:23:23,634] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 23: [2023-04-29 17:23:23,634] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 30: [2023-04-29 17:23:23,634] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 30: [2023-04-29 17:23:23,635] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 20: [2023-04-29 17:23:23,635] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 20: [2023-04-29 17:23:23,636] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 24: [2023-04-29 17:23:23,636] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 5: [2023-04-29 17:23:23,637] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 18: [2023-04-29 17:23:23,637] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 18: [2023-04-29 17:23:23,637] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 5: [2023-04-29 17:23:23,637] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 18: [2023-04-29 17:23:23,637] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 6: [2023-04-29 17:23:23,638] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 24: [2023-04-29 17:23:23,638] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 29: [2023-04-29 17:23:23,639] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 6: [2023-04-29 17:23:23,640] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 15: [2023-04-29 17:23:23,641] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 15: [2023-04-29 17:23:23,641] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 15: [2023-04-29 17:23:23,641] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 15: [2023-04-29 17:23:23,641] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 29: [2023-04-29 17:23:23,643] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 15: [2023-04-29 17:23:23,643] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 15: [2023-04-29 17:23:23,643] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 15: [2023-04-29 17:23:23,643] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 15: [2023-04-29 17:23:23,643] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 6: [2023-04-29 17:23:23,644] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 24: [2023-04-29 17:23:23,647] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 23: [2023-04-29 17:23:23,647] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 4: [2023-04-29 17:23:23,646] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 4: [2023-04-29 17:23:23,646] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 23: [2023-04-29 17:23:23,647] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 23: [2023-04-29 17:23:23,647] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 6: [2023-04-29 17:23:23,648] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 6: [2023-04-29 17:23:23,648] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 6: [2023-04-29 17:23:23,648] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 5: [2023-04-29 17:23:23,650] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 25: [2023-04-29 17:23:23,650] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 25: [2023-04-29 17:23:23,650] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 5: [2023-04-29 17:23:23,650] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 5: [2023-04-29 17:23:23,651] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 5: [2023-04-29 17:23:23,651] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 5: [2023-04-29 17:23:23,651] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 23: [2023-04-29 17:23:23,651] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 23: [2023-04-29 17:23:23,651] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 5: [2023-04-29 17:23:23,651] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 18: [2023-04-29 17:23:23,652] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 18: [2023-04-29 17:23:23,652] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 18: [2023-04-29 17:23:23,652] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 18: [2023-04-29 17:23:23,653] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 24: [2023-04-29 17:23:23,654] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 7: [2023-04-29 17:23:23,654] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 7: [2023-04-29 17:23:23,655] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 7: [2023-04-29 17:23:23,656] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 29: [2023-04-29 17:23:23,657] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 11: [2023-04-29 17:23:23,657] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 11: [2023-04-29 17:23:23,657] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 7: [2023-04-29 17:23:23,658] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 7: [2023-04-29 17:23:23,658] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 11: [2023-04-29 17:23:23,658] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 24: [2023-04-29 17:23:23,661] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 23: [2023-04-29 17:23:23,662] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 23: [2023-04-29 17:23:23,662] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 29: [2023-04-29 17:23:23,663] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 18: [2023-04-29 17:23:23,664] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 18: [2023-04-29 17:23:23,664] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 22: [2023-04-29 17:23:23,664] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 22: [2023-04-29 17:23:23,664] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 18: [2023-04-29 17:23:23,664] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 22: [2023-04-29 17:23:23,665] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 22: [2023-04-29 17:23:23,665] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 22: [2023-04-29 17:23:23,665] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 22: [2023-04-29 17:23:23,665] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 22: [2023-04-29 17:23:23,665] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 22: [2023-04-29 17:23:23,665] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 18: [2023-04-29 17:23:23,666] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 24: [2023-04-29 17:23:23,667] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 24: [2023-04-29 17:23:23,667] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 4: [2023-04-29 17:23:23,668] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 4: [2023-04-29 17:23:23,668] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 22: [2023-04-29 17:23:23,667] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 22: [2023-04-29 17:23:23,669] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 29: [2023-04-29 17:23:23,668] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 29: [2023-04-29 17:23:23,668] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 25: [2023-04-29 17:23:23,670] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 24: [2023-04-29 17:23:23,670] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 24: [2023-04-29 17:23:23,671] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 25: [2023-04-29 17:23:23,671] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 29: [2023-04-29 17:23:23,672] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 29: [2023-04-29 17:23:23,672] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 29: [2023-04-29 17:23:23,672] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 29: [2023-04-29 17:23:23,672] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 24: [2023-04-29 17:23:23,673] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 22: [2023-04-29 17:23:23,673] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 22: [2023-04-29 17:23:23,673] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 22: [2023-04-29 17:23:23,674] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 0: [2023-04-29 17:23:23,675] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 16: [2023-04-29 17:23:23,675] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 16: [2023-04-29 17:23:23,675] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 22: [2023-04-29 17:23:23,675] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 16: [2023-04-29 17:23:23,675] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 4: [2023-04-29 17:23:23,674] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 4: [2023-04-29 17:23:23,674] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 16: [2023-04-29 17:23:23,675] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 16: [2023-04-29 17:23:23,675] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 16: [2023-04-29 17:23:23,675] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 16: [2023-04-29 17:23:23,675] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 22: [2023-04-29 17:23:23,675] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 22: [2023-04-29 17:23:23,676] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 16: [2023-04-29 17:23:23,676] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 11: [2023-04-29 17:23:23,676] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 11: [2023-04-29 17:23:23,677] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 11: [2023-04-29 17:23:23,677] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 23: [2023-04-29 17:23:23,677] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 25: [2023-04-29 17:23:23,677] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 25: [2023-04-29 17:23:23,677] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 25: [2023-04-29 17:23:23,677] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 23: [2023-04-29 17:23:23,678] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 4: [2023-04-29 17:23:23,678] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 4: [2023-04-29 17:23:23,678] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 4: [2023-04-29 17:23:23,678] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 4: [2023-04-29 17:23:23,678] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 25: [2023-04-29 17:23:23,678] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 11: [2023-04-29 17:23:23,679] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 11: [2023-04-29 17:23:23,679] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 5: [2023-04-29 17:23:23,680] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 25: [2023-04-29 17:23:23,680] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 16: [2023-04-29 17:23:23,680] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 23: [2023-04-29 17:23:23,681] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 5: [2023-04-29 17:23:23,681] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 16: [2023-04-29 17:23:23,681] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 16: [2023-04-29 17:23:23,681] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 11: [2023-04-29 17:23:23,681] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 11: [2023-04-29 17:23:23,681] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 16: [2023-04-29 17:23:23,681] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 16: [2023-04-29 17:23:23,681] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 5: [2023-04-29 17:23:23,682] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 23: [2023-04-29 17:23:23,682] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 16: [2023-04-29 17:23:23,682] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 16: [2023-04-29 17:23:23,682] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 16: [2023-04-29 17:23:23,682] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 15: [2023-04-29 17:23:23,683] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 15: [2023-04-29 17:23:23,683] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 15: [2023-04-29 17:23:23,683] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 11: [2023-04-29 17:23:23,683] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 5: [2023-04-29 17:23:23,683] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 25: [2023-04-29 17:23:23,683] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 5: [2023-04-29 17:23:23,684] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 15: [2023-04-29 17:23:23,685] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 18: [2023-04-29 17:23:23,687] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 15: [2023-04-29 17:23:23,688] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 15: [2023-04-29 17:23:23,689] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 18: [2023-04-29 17:23:23,689] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 15: [2023-04-29 17:23:23,690] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 15: [2023-04-29 17:23:23,690] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 14: [2023-04-29 17:23:23,690] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 14: [2023-04-29 17:23:23,690] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 14: [2023-04-29 17:23:23,690] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 14: [2023-04-29 17:23:23,690] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 14: [2023-04-29 17:23:23,690] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 14: [2023-04-29 17:23:23,690] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 14: [2023-04-29 17:23:23,690] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 18: [2023-04-29 17:23:23,690] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 14: [2023-04-29 17:23:23,690] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 18: [2023-04-29 17:23:23,691] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 18: [2023-04-29 17:23:23,694] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 14: [2023-04-29 17:23:23,694] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 0: [2023-04-29 17:23:23,696] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 0: [2023-04-29 17:23:23,696] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 28: [2023-04-29 17:23:23,696] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 28: [2023-04-29 17:23:23,696] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 28: [2023-04-29 17:23:23,698] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 29: [2023-04-29 17:23:23,699] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 14: [2023-04-29 17:23:23,700] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 14: [2023-04-29 17:23:23,701] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 14: [2023-04-29 17:23:23,701] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 0: [2023-04-29 17:23:23,701] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 14: [2023-04-29 17:23:23,701] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 14: [2023-04-29 17:23:23,702] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 14: [2023-04-29 17:23:23,703] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 14: [2023-04-29 17:23:23,703] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 11: [2023-04-29 17:23:23,704] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 25: [2023-04-29 17:23:23,704] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 29: [2023-04-29 17:23:23,705] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 4: [2023-04-29 17:23:23,706] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 25: [2023-04-29 17:23:23,706] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 4: [2023-04-29 17:23:23,707] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 11: [2023-04-29 17:23:23,707] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 0: [2023-04-29 17:23:23,707] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 0: [2023-04-29 17:23:23,707] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 11: [2023-04-29 17:23:23,708] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 29: [2023-04-29 17:23:23,708] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 0: [2023-04-29 17:23:23,708] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 0: [2023-04-29 17:23:23,708] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 0: [2023-04-29 17:23:23,708] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 11: [2023-04-29 17:23:23,710] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 11: [2023-04-29 17:23:23,710] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 29: [2023-04-29 17:23:23,710] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 25: [2023-04-29 17:23:23,711] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 28: [2023-04-29 17:23:23,711] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 28: [2023-04-29 17:23:23,711] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 28: [2023-04-29 17:23:23,711] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 28: [2023-04-29 17:23:23,712] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 25: [2023-04-29 17:23:23,712] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 28: [2023-04-29 17:23:23,712] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_16-model_00-model_states.pt. 29: [2023-04-29 17:23:23,712] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 4: [2023-04-29 17:23:23,712] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 29: [2023-04-29 17:23:23,713] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 25: [2023-04-29 17:23:23,713] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 22: [2023-04-29 17:23:23,713] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 13: [2023-04-29 17:23:23,714] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 13: [2023-04-29 17:23:23,714] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 4: [2023-04-29 17:23:23,714] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 13: [2023-04-29 17:23:23,715] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 13: [2023-04-29 17:23:23,715] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 13: [2023-04-29 17:23:23,715] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 25: [2023-04-29 17:23:23,716] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 13: [2023-04-29 17:23:23,716] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 13: [2023-04-29 17:23:23,716] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 13: [2023-04-29 17:23:23,716] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 4: [2023-04-29 17:23:23,716] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 4: [2023-04-29 17:23:23,716] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 13: [2023-04-29 17:23:23,721] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 13: [2023-04-29 17:23:23,722] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 13: [2023-04-29 17:23:23,723] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 13: [2023-04-29 17:23:23,724] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 22: [2023-04-29 17:23:23,724] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 13: [2023-04-29 17:23:23,725] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 0: [2023-04-29 17:23:23,726] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 0: [2023-04-29 17:23:23,726] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 28: [2023-04-29 17:23:23,726] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 28: [2023-04-29 17:23:23,726] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 13: [2023-04-29 17:23:23,726] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 13: [2023-04-29 17:23:23,727] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 13: [2023-04-29 17:23:23,727] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 28: [2023-04-29 17:23:23,729] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 16: [2023-04-29 17:23:23,730] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 22: [2023-04-29 17:23:23,734] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 16: [2023-04-29 17:23:23,737] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 16: [2023-04-29 17:23:23,737] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 22: [2023-04-29 17:23:23,738] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 22: [2023-04-29 17:23:23,739] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 0: [2023-04-29 17:23:23,739] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 0: [2023-04-29 17:23:23,740] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 3: [2023-04-29 17:23:23,740] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 3: [2023-04-29 17:23:23,740] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 22: [2023-04-29 17:23:23,741] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 0: [2023-04-29 17:23:23,742] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 3: [2023-04-29 17:23:23,742] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 3: [2023-04-29 17:23:23,742] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 3: [2023-04-29 17:23:23,742] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 3: [2023-04-29 17:23:23,742] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 3: [2023-04-29 17:23:23,742] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 3: [2023-04-29 17:23:23,743] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 0: [2023-04-29 17:23:23,743] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 3: [2023-04-29 17:23:23,743] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 28: [2023-04-29 17:23:23,744] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 3: [2023-04-29 17:23:23,744] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 0: [2023-04-29 17:23:23,745] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 28: [2023-04-29 17:23:23,745] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 28: [2023-04-29 17:23:23,745] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 22: [2023-04-29 17:23:23,745] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 14: [2023-04-29 17:23:23,747] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 16: [2023-04-29 17:23:23,750] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 16: [2023-04-29 17:23:23,750] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 16: [2023-04-29 17:23:23,750] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 16: [2023-04-29 17:23:23,750] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 3: [2023-04-29 17:23:23,749] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 3: [2023-04-29 17:23:23,750] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 28: [2023-04-29 17:23:23,750] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 16: [2023-04-29 17:23:23,750] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 3: [2023-04-29 17:23:23,750] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 28: [2023-04-29 17:23:23,750] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 3: [2023-04-29 17:23:23,750] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 3: [2023-04-29 17:23:23,750] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 3: [2023-04-29 17:23:23,751] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 16: [2023-04-29 17:23:23,751] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 22: [2023-04-29 17:23:23,753] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 22: [2023-04-29 17:23:23,757] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 22: [2023-04-29 17:23:23,757] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 16: [2023-04-29 17:23:23,763] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 16: [2023-04-29 17:23:23,764] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 22: [2023-04-29 17:23:23,765] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 22: [2023-04-29 17:23:23,766] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 14: [2023-04-29 17:23:23,766] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 22: [2023-04-29 17:23:23,768] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 14: [2023-04-29 17:23:23,775] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 14: [2023-04-29 17:23:23,775] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 13: [2023-04-29 17:23:23,775] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 13: [2023-04-29 17:23:23,776] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 16: [2023-04-29 17:23:23,777] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 16: [2023-04-29 17:23:23,777] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 16: [2023-04-29 17:23:23,778] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 14: [2023-04-29 17:23:23,778] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 16: [2023-04-29 17:23:23,780] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 16: [2023-04-29 17:23:23,780] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 12: [2023-04-29 17:23:23,783] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 12: [2023-04-29 17:23:23,783] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 22: [2023-04-29 17:23:23,784] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 12: [2023-04-29 17:23:23,784] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 12: [2023-04-29 17:23:23,784] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 12: [2023-04-29 17:23:23,785] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 12: [2023-04-29 17:23:23,785] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 12: [2023-04-29 17:23:23,785] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 12: [2023-04-29 17:23:23,785] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 22: [2023-04-29 17:23:23,786] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 3: [2023-04-29 17:23:23,787] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 3: [2023-04-29 17:23:23,787] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 14: [2023-04-29 17:23:23,789] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 22: [2023-04-29 17:23:23,789] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 12: [2023-04-29 17:23:23,791] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 12: [2023-04-29 17:23:23,792] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 13: [2023-04-29 17:23:23,792] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 13: [2023-04-29 17:23:23,792] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 13: [2023-04-29 17:23:23,792] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 12: [2023-04-29 17:23:23,792] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 12: [2023-04-29 17:23:23,792] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 12: [2023-04-29 17:23:23,792] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 12: [2023-04-29 17:23:23,792] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 12: [2023-04-29 17:23:23,792] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 12: [2023-04-29 17:23:23,794] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 14: [2023-04-29 17:23:23,794] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 14: [2023-04-29 17:23:23,794] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 14: [2023-04-29 17:23:23,794] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 13: [2023-04-29 17:23:23,796] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 13: [2023-04-29 17:23:23,796] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 13: [2023-04-29 17:23:23,796] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 13: [2023-04-29 17:23:23,797] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 13: [2023-04-29 17:23:23,801] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 14: [2023-04-29 17:23:23,804] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 19: [2023-04-29 17:23:23,808] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 19: [2023-04-29 17:23:23,808] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 3: [2023-04-29 17:23:23,808] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 19: [2023-04-29 17:23:23,808] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 19: [2023-04-29 17:23:23,809] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 19: [2023-04-29 17:23:23,809] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 19: [2023-04-29 17:23:23,809] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 19: [2023-04-29 17:23:23,809] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 19: [2023-04-29 17:23:23,809] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 14: [2023-04-29 17:23:23,809] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 8: [2023-04-29 17:23:23,810] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 8: [2023-04-29 17:23:23,810] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 8: [2023-04-29 17:23:23,810] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 8: [2023-04-29 17:23:23,810] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 8: [2023-04-29 17:23:23,810] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 8: [2023-04-29 17:23:23,810] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 8: [2023-04-29 17:23:23,810] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 27: [2023-04-29 17:23:23,810] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 17: [2023-04-29 17:23:23,810] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 17: [2023-04-29 17:23:23,810] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 17: [2023-04-29 17:23:23,810] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 17: [2023-04-29 17:23:23,810] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 17: [2023-04-29 17:23:23,810] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 17: [2023-04-29 17:23:23,810] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 17: [2023-04-29 17:23:23,810] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 8: [2023-04-29 17:23:23,811] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 17: [2023-04-29 17:23:23,811] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 27: [2023-04-29 17:23:23,811] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 3: [2023-04-29 17:23:23,811] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 27: [2023-04-29 17:23:23,811] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 27: [2023-04-29 17:23:23,811] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 27: [2023-04-29 17:23:23,811] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 27: [2023-04-29 17:23:23,811] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 27: [2023-04-29 17:23:23,811] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 27: [2023-04-29 17:23:23,811] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 19: [2023-04-29 17:23:23,812] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 19: [2023-04-29 17:23:23,812] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 19: [2023-04-29 17:23:23,813] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 27: [2023-04-29 17:23:23,814] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 17: [2023-04-29 17:23:23,815] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 14: [2023-04-29 17:23:23,816] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 17: [2023-04-29 17:23:23,816] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 8: [2023-04-29 17:23:23,816] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 8: [2023-04-29 17:23:23,817] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 19: [2023-04-29 17:23:23,817] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 19: [2023-04-29 17:23:23,817] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 19: [2023-04-29 17:23:23,818] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 17: [2023-04-29 17:23:23,818] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 8: [2023-04-29 17:23:23,818] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 19: [2023-04-29 17:23:23,818] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 8: [2023-04-29 17:23:23,819] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 8: [2023-04-29 17:23:23,819] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 19: [2023-04-29 17:23:23,819] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 8: [2023-04-29 17:23:23,820] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 8: [2023-04-29 17:23:23,820] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 8: [2023-04-29 17:23:23,821] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 17: [2023-04-29 17:23:23,820] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 17: [2023-04-29 17:23:23,821] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 3: [2023-04-29 17:23:23,821] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 3: [2023-04-29 17:23:23,821] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 3: [2023-04-29 17:23:23,821] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 3: [2023-04-29 17:23:23,821] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 3: [2023-04-29 17:23:23,821] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 3: [2023-04-29 17:23:23,821] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 17: [2023-04-29 17:23:23,822] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 17: [2023-04-29 17:23:23,822] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 17: [2023-04-29 17:23:23,822] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 27: [2023-04-29 17:23:23,823] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 27: [2023-04-29 17:23:23,823] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 27: [2023-04-29 17:23:23,824] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 27: [2023-04-29 17:23:23,824] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 27: [2023-04-29 17:23:23,824] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 14: [2023-04-29 17:23:23,824] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 14: [2023-04-29 17:23:23,825] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 13: [2023-04-29 17:23:23,825] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 13: [2023-04-29 17:23:23,825] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 13: [2023-04-29 17:23:23,825] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 27: [2023-04-29 17:23:23,825] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 27: [2023-04-29 17:23:23,825] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 14: [2023-04-29 17:23:23,828] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 14: [2023-04-29 17:23:23,828] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 13: [2023-04-29 17:23:23,831] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 13: [2023-04-29 17:23:23,831] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 21: [2023-04-29 17:23:23,831] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 21: [2023-04-29 17:23:23,831] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 21: [2023-04-29 17:23:23,832] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 21: [2023-04-29 17:23:23,832] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 21: [2023-04-29 17:23:23,832] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 21: [2023-04-29 17:23:23,832] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 21: [2023-04-29 17:23:23,832] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 6: [2023-04-29 17:23:23,832] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 6: [2023-04-29 17:23:23,832] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 21: [2023-04-29 17:23:23,832] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 6: [2023-04-29 17:23:23,832] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 13: [2023-04-29 17:23:23,833] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 6: [2023-04-29 17:23:23,833] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 6: [2023-04-29 17:23:23,833] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 6: [2023-04-29 17:23:23,833] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 6: [2023-04-29 17:23:23,833] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 6: [2023-04-29 17:23:23,833] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 21: [2023-04-29 17:23:23,836] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 21: [2023-04-29 17:23:23,836] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 6: [2023-04-29 17:23:23,836] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 6: [2023-04-29 17:23:23,836] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 21: [2023-04-29 17:23:23,837] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 21: [2023-04-29 17:23:23,838] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 21: [2023-04-29 17:23:23,838] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 21: [2023-04-29 17:23:23,838] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 21: [2023-04-29 17:23:23,838] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 21: [2023-04-29 17:23:23,839] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 6: [2023-04-29 17:23:23,841] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 6: [2023-04-29 17:23:23,842] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 6: [2023-04-29 17:23:23,842] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 6: [2023-04-29 17:23:23,843] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 6: [2023-04-29 17:23:23,843] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 12: [2023-04-29 17:23:23,843] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 6: [2023-04-29 17:23:23,844] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 12: [2023-04-29 17:23:23,846] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 12: [2023-04-29 17:23:23,846] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 3: [2023-04-29 17:23:23,849] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 3: [2023-04-29 17:23:23,852] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 3: [2023-04-29 17:23:23,853] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 3: [2023-04-29 17:23:23,854] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 3: [2023-04-29 17:23:23,855] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 3: [2023-04-29 17:23:23,856] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 12: [2023-04-29 17:23:23,857] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 19: [2023-04-29 17:23:23,858] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 12: [2023-04-29 17:23:23,859] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 12: [2023-04-29 17:23:23,859] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 12: [2023-04-29 17:23:23,859] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 12: [2023-04-29 17:23:23,859] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 1: [2023-04-29 17:23:23,861] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 1: [2023-04-29 17:23:23,861] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 1: [2023-04-29 17:23:23,861] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 1: [2023-04-29 17:23:23,861] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 1: [2023-04-29 17:23:23,862] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 1: [2023-04-29 17:23:23,862] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 1: [2023-04-29 17:23:23,862] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 1: [2023-04-29 17:23:23,862] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 27: [2023-04-29 17:23:23,863] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 10: [2023-04-29 17:23:23,864] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 10: [2023-04-29 17:23:23,864] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 10: [2023-04-29 17:23:23,864] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 10: [2023-04-29 17:23:23,864] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 10: [2023-04-29 17:23:23,864] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 10: [2023-04-29 17:23:23,864] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 10: [2023-04-29 17:23:23,864] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 10: [2023-04-29 17:23:23,865] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 26: [2023-04-29 17:23:23,866] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 26: [2023-04-29 17:23:23,866] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 26: [2023-04-29 17:23:23,866] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 26: [2023-04-29 17:23:23,867] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 26: [2023-04-29 17:23:23,867] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 26: [2023-04-29 17:23:23,867] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 26: [2023-04-29 17:23:23,867] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 26: [2023-04-29 17:23:23,867] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 12: [2023-04-29 17:23:23,867] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 1: [2023-04-29 17:23:23,867] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 1: [2023-04-29 17:23:23,867] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 1: [2023-04-29 17:23:23,867] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 1: [2023-04-29 17:23:23,867] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 1: [2023-04-29 17:23:23,868] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 1: [2023-04-29 17:23:23,868] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 12: [2023-04-29 17:23:23,869] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 19: [2023-04-29 17:23:23,869] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 19: [2023-04-29 17:23:23,869] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 17: [2023-04-29 17:23:23,868] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 10: [2023-04-29 17:23:23,869] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 10: [2023-04-29 17:23:23,869] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 10: [2023-04-29 17:23:23,870] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 10: [2023-04-29 17:23:23,870] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 1: [2023-04-29 17:23:23,869] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 1: [2023-04-29 17:23:23,870] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 8: [2023-04-29 17:23:23,870] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 8: [2023-04-29 17:23:23,870] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 17: [2023-04-29 17:23:23,870] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 9: [2023-04-29 17:23:23,870] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 9: [2023-04-29 17:23:23,870] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 9: [2023-04-29 17:23:23,870] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 9: [2023-04-29 17:23:23,870] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 9: [2023-04-29 17:23:23,870] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 9: [2023-04-29 17:23:23,870] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 9: [2023-04-29 17:23:23,870] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 9: [2023-04-29 17:23:23,871] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 10: [2023-04-29 17:23:23,872] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 10: [2023-04-29 17:23:23,872] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 26: [2023-04-29 17:23:23,872] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 12: [2023-04-29 17:23:23,872] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 10: [2023-04-29 17:23:23,873] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 26: [2023-04-29 17:23:23,873] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 10: [2023-04-29 17:23:23,874] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 26: [2023-04-29 17:23:23,874] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 8: [2023-04-29 17:23:23,874] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 26: [2023-04-29 17:23:23,874] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 26: [2023-04-29 17:23:23,874] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 26: [2023-04-29 17:23:23,875] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 26: [2023-04-29 17:23:23,875] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 17: [2023-04-29 17:23:23,875] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 9: [2023-04-29 17:23:23,876] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 9: [2023-04-29 17:23:23,876] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 26: [2023-04-29 17:23:23,876] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 9: [2023-04-29 17:23:23,876] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 9: [2023-04-29 17:23:23,876] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 9: [2023-04-29 17:23:23,876] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 9: [2023-04-29 17:23:23,876] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 9: [2023-04-29 17:23:23,877] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 9: [2023-04-29 17:23:23,877] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 19: [2023-04-29 17:23:23,878] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 8: [2023-04-29 17:23:23,880] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 8: [2023-04-29 17:23:23,880] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 8: [2023-04-29 17:23:23,880] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 8: [2023-04-29 17:23:23,880] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 8: [2023-04-29 17:23:23,880] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 20: [2023-04-29 17:23:23,882] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 20: [2023-04-29 17:23:23,882] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 19: [2023-04-29 17:23:23,882] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 27: [2023-04-29 17:23:23,884] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 19: [2023-04-29 17:23:23,885] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 19: [2023-04-29 17:23:23,885] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 19: [2023-04-29 17:23:23,886] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 19: [2023-04-29 17:23:23,885] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 20: [2023-04-29 17:23:23,885] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 20: [2023-04-29 17:23:23,886] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 20: [2023-04-29 17:23:23,886] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 20: [2023-04-29 17:23:23,886] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 20: [2023-04-29 17:23:23,886] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 20: [2023-04-29 17:23:23,886] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 20: [2023-04-29 17:23:23,886] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 20: [2023-04-29 17:23:23,887] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 12: [2023-04-29 17:23:23,887] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 12: [2023-04-29 17:23:23,888] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 6: [2023-04-29 17:23:23,889] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 6: [2023-04-29 17:23:23,889] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 12: [2023-04-29 17:23:23,889] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 19: [2023-04-29 17:23:23,890] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 19: [2023-04-29 17:23:23,891] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 12: [2023-04-29 17:23:23,891] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 12: [2023-04-29 17:23:23,891] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 21: [2023-04-29 17:23:23,891] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 21: [2023-04-29 17:23:23,891] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 21: [2023-04-29 17:23:23,891] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 20: [2023-04-29 17:23:23,891] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 17: [2023-04-29 17:23:23,892] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 8: [2023-04-29 17:23:23,895] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 8: [2023-04-29 17:23:23,895] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 17: [2023-04-29 17:23:23,895] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 20: [2023-04-29 17:23:23,895] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 20: [2023-04-29 17:23:23,896] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 27: [2023-04-29 17:23:23,896] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 27: [2023-04-29 17:23:23,897] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 27: [2023-04-29 17:23:23,897] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 20: [2023-04-29 17:23:23,897] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 20: [2023-04-29 17:23:23,897] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 20: [2023-04-29 17:23:23,897] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 17: [2023-04-29 17:23:23,897] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 17: [2023-04-29 17:23:23,899] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 17: [2023-04-29 17:23:23,899] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 17: [2023-04-29 17:23:23,899] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 27: [2023-04-29 17:23:23,900] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 17: [2023-04-29 17:23:23,901] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 17: [2023-04-29 17:23:23,902] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 8: [2023-04-29 17:23:23,902] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 27: [2023-04-29 17:23:23,903] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 27: [2023-04-29 17:23:23,903] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 27: [2023-04-29 17:23:23,903] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 21: [2023-04-29 17:23:23,905] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 21: [2023-04-29 17:23:23,905] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 21: [2023-04-29 17:23:23,905] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 21: [2023-04-29 17:23:23,905] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 21: [2023-04-29 17:23:23,905] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 30: [2023-04-29 17:23:23,906] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 30: [2023-04-29 17:23:23,907] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 30: [2023-04-29 17:23:23,907] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 30: [2023-04-29 17:23:23,907] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 30: [2023-04-29 17:23:23,907] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 30: [2023-04-29 17:23:23,907] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 30: [2023-04-29 17:23:23,907] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 30: [2023-04-29 17:23:23,908] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 6: [2023-04-29 17:23:23,909] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 8: [2023-04-29 17:23:23,910] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 6: [2023-04-29 17:23:23,911] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 6: [2023-04-29 17:23:23,911] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 6: [2023-04-29 17:23:23,911] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 19: [2023-04-29 17:23:23,911] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 8: [2023-04-29 17:23:23,912] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 8: [2023-04-29 17:23:23,914] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 21: [2023-04-29 17:23:23,915] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 8: [2023-04-29 17:23:23,914] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 8: [2023-04-29 17:23:23,914] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 19: [2023-04-29 17:23:23,915] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 21: [2023-04-29 17:23:23,915] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 19: [2023-04-29 17:23:23,915] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 19: [2023-04-29 17:23:23,915] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 21: [2023-04-29 17:23:23,915] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 31: [2023-04-29 17:23:23,915] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 31: [2023-04-29 17:23:23,915] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 31: [2023-04-29 17:23:23,915] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 31: [2023-04-29 17:23:23,916] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 31: [2023-04-29 17:23:23,916] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 31: [2023-04-29 17:23:23,916] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 31: [2023-04-29 17:23:23,916] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 31: [2023-04-29 17:23:23,916] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 19: [2023-04-29 17:23:23,918] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 30: [2023-04-29 17:23:23,919] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 26: [2023-04-29 17:23:23,919] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 30: [2023-04-29 17:23:23,919] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 30: [2023-04-29 17:23:23,919] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 31: [2023-04-29 17:23:23,919] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 30: [2023-04-29 17:23:23,919] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 30: [2023-04-29 17:23:23,920] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 30: [2023-04-29 17:23:23,920] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 31: [2023-04-29 17:23:23,920] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 30: [2023-04-29 17:23:23,920] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 31: [2023-04-29 17:23:23,920] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 31: [2023-04-29 17:23:23,922] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 31: [2023-04-29 17:23:23,922] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 31: [2023-04-29 17:23:23,922] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 30: [2023-04-29 17:23:23,922] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 31: [2023-04-29 17:23:23,922] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 31: [2023-04-29 17:23:23,923] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 6: [2023-04-29 17:23:23,923] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 6: [2023-04-29 17:23:23,923] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 6: [2023-04-29 17:23:23,923] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 6: [2023-04-29 17:23:23,923] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 27: [2023-04-29 17:23:23,924] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 1: [2023-04-29 17:23:23,924] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 1: [2023-04-29 17:23:23,924] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 1: [2023-04-29 17:23:23,924] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 1: [2023-04-29 17:23:23,924] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 10: [2023-04-29 17:23:23,926] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 10: [2023-04-29 17:23:23,926] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 10: [2023-04-29 17:23:23,926] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 10: [2023-04-29 17:23:23,926] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 17: [2023-04-29 17:23:23,927] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 1: [2023-04-29 17:23:23,929] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 1: [2023-04-29 17:23:23,929] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 1: [2023-04-29 17:23:23,929] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 1: [2023-04-29 17:23:23,929] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 27: [2023-04-29 17:23:23,930] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 27: [2023-04-29 17:23:23,930] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 17: [2023-04-29 17:23:23,932] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 20: [2023-04-29 17:23:23,932] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 21: [2023-04-29 17:23:23,933] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 10: [2023-04-29 17:23:23,933] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 10: [2023-04-29 17:23:23,933] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 10: [2023-04-29 17:23:23,933] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 10: [2023-04-29 17:23:23,933] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 9: [2023-04-29 17:23:23,934] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 9: [2023-04-29 17:23:23,934] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 9: [2023-04-29 17:23:23,934] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 9: [2023-04-29 17:23:23,934] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 7: [2023-04-29 17:23:23,933] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 7: [2023-04-29 17:23:23,933] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 7: [2023-04-29 17:23:23,933] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 7: [2023-04-29 17:23:23,934] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 7: [2023-04-29 17:23:23,934] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 7: [2023-04-29 17:23:23,934] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 7: [2023-04-29 17:23:23,934] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 6: [2023-04-29 17:23:23,934] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 7: [2023-04-29 17:23:23,934] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 21: [2023-04-29 17:23:23,934] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 17: [2023-04-29 17:23:23,934] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 17: [2023-04-29 17:23:23,935] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 26: [2023-04-29 17:23:23,935] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 26: [2023-04-29 17:23:23,935] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 17: [2023-04-29 17:23:23,935] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 21: [2023-04-29 17:23:23,935] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 21: [2023-04-29 17:23:23,935] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 27: [2023-04-29 17:23:23,935] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 27: [2023-04-29 17:23:23,935] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 21: [2023-04-29 17:23:23,936] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 27: [2023-04-29 17:23:23,937] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 26: [2023-04-29 17:23:23,937] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 27: [2023-04-29 17:23:23,937] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 6: [2023-04-29 17:23:23,938] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 9: [2023-04-29 17:23:23,938] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 9: [2023-04-29 17:23:23,938] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 9: [2023-04-29 17:23:23,938] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 9: [2023-04-29 17:23:23,938] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 7: [2023-04-29 17:23:23,938] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 7: [2023-04-29 17:23:23,939] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 7: [2023-04-29 17:23:23,939] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 7: [2023-04-29 17:23:23,939] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 26: [2023-04-29 17:23:23,939] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 26: [2023-04-29 17:23:23,939] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 26: [2023-04-29 17:23:23,939] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 26: [2023-04-29 17:23:23,939] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 7: [2023-04-29 17:23:23,940] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 7: [2023-04-29 17:23:23,940] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 7: [2023-04-29 17:23:23,941] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 7: [2023-04-29 17:23:23,941] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 26: [2023-04-29 17:23:23,941] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 20: [2023-04-29 17:23:23,944] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 20: [2023-04-29 17:23:23,951] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 10: [2023-04-29 17:23:23,951] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 10: [2023-04-29 17:23:23,953] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 10: [2023-04-29 17:23:23,953] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 10: [2023-04-29 17:23:23,954] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 20: [2023-04-29 17:23:23,955] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 6: [2023-04-29 17:23:23,955] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 1: [2023-04-29 17:23:23,956] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 1: [2023-04-29 17:23:23,956] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 1: [2023-04-29 17:23:23,956] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 20: [2023-04-29 17:23:23,956] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 6: [2023-04-29 17:23:23,956] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 6: [2023-04-29 17:23:23,956] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 1: [2023-04-29 17:23:23,956] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 6: [2023-04-29 17:23:23,957] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 9: [2023-04-29 17:23:23,962] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 10: [2023-04-29 17:23:23,962] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 9: [2023-04-29 17:23:23,962] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 9: [2023-04-29 17:23:23,962] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 9: [2023-04-29 17:23:23,962] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 9: [2023-04-29 17:23:23,963] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 10: [2023-04-29 17:23:23,963] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 1: [2023-04-29 17:23:23,963] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 1: [2023-04-29 17:23:23,963] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 10: [2023-04-29 17:23:23,964] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 22: [2023-04-29 17:23:23,963] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 22: [2023-04-29 17:23:23,963] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 22: [2023-04-29 17:23:23,963] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 22: [2023-04-29 17:23:23,964] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 22: [2023-04-29 17:23:23,964] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 22: [2023-04-29 17:23:23,964] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 22: [2023-04-29 17:23:23,964] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 22: [2023-04-29 17:23:23,964] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 26: [2023-04-29 17:23:23,964] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 10: [2023-04-29 17:23:23,965] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 20: [2023-04-29 17:23:23,965] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 1: [2023-04-29 17:23:23,965] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 9: [2023-04-29 17:23:23,965] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 1: [2023-04-29 17:23:23,965] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 9: [2023-04-29 17:23:23,965] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 20: [2023-04-29 17:23:23,966] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 20: [2023-04-29 17:23:23,966] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 26: [2023-04-29 17:23:23,966] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 20: [2023-04-29 17:23:23,966] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 26: [2023-04-29 17:23:23,967] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 26: [2023-04-29 17:23:23,968] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 20: [2023-04-29 17:23:23,968] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 31: [2023-04-29 17:23:23,968] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 26: [2023-04-29 17:23:23,968] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 26: [2023-04-29 17:23:23,968] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 22: [2023-04-29 17:23:23,968] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 22: [2023-04-29 17:23:23,968] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 9: [2023-04-29 17:23:23,969] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 26: [2023-04-29 17:23:23,970] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 22: [2023-04-29 17:23:23,973] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 22: [2023-04-29 17:23:23,974] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 22: [2023-04-29 17:23:23,975] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 22: [2023-04-29 17:23:23,975] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 31: [2023-04-29 17:23:23,975] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 31: [2023-04-29 17:23:23,975] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 22: [2023-04-29 17:23:23,976] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 22: [2023-04-29 17:23:23,976] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 5: [2023-04-29 17:23:23,977] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 5: [2023-04-29 17:23:23,977] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 20: [2023-04-29 17:23:23,978] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 20: [2023-04-29 17:23:23,979] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 14: [2023-04-29 17:23:23,981] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 14: [2023-04-29 17:23:23,981] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 5: [2023-04-29 17:23:23,981] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 5: [2023-04-29 17:23:23,981] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 5: [2023-04-29 17:23:23,981] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 5: [2023-04-29 17:23:23,981] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 5: [2023-04-29 17:23:23,981] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 14: [2023-04-29 17:23:23,981] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 14: [2023-04-29 17:23:23,981] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 5: [2023-04-29 17:23:23,981] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 14: [2023-04-29 17:23:23,981] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 14: [2023-04-29 17:23:23,981] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 14: [2023-04-29 17:23:23,981] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 5: [2023-04-29 17:23:23,982] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 14: [2023-04-29 17:23:23,982] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 5: [2023-04-29 17:23:23,982] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 23: [2023-04-29 17:23:23,982] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 23: [2023-04-29 17:23:23,983] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 14: [2023-04-29 17:23:23,984] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 14: [2023-04-29 17:23:23,985] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 23: [2023-04-29 17:23:23,987] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 23: [2023-04-29 17:23:23,987] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 31: [2023-04-29 17:23:23,987] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 23: [2023-04-29 17:23:23,987] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 23: [2023-04-29 17:23:23,987] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 23: [2023-04-29 17:23:23,987] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 23: [2023-04-29 17:23:23,987] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 23: [2023-04-29 17:23:23,987] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 23: [2023-04-29 17:23:23,989] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 31: [2023-04-29 17:23:23,989] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 31: [2023-04-29 17:23:23,989] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 31: [2023-04-29 17:23:23,989] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 31: [2023-04-29 17:23:23,989] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 31: [2023-04-29 17:23:23,989] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 5: [2023-04-29 17:23:23,990] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 5: [2023-04-29 17:23:23,991] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 14: [2023-04-29 17:23:23,991] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 5: [2023-04-29 17:23:23,991] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 30: [2023-04-29 17:23:23,991] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 5: [2023-04-29 17:23:23,991] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 7: [2023-04-29 17:23:23,991] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 7: [2023-04-29 17:23:23,991] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 14: [2023-04-29 17:23:23,992] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 23: [2023-04-29 17:23:23,992] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 5: [2023-04-29 17:23:23,992] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 5: [2023-04-29 17:23:23,992] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 14: [2023-04-29 17:23:23,992] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 14: [2023-04-29 17:23:23,993] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 7: [2023-04-29 17:23:23,993] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 14: [2023-04-29 17:23:23,993] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 14: [2023-04-29 17:23:23,993] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 20: [2023-04-29 17:23:23,994] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 20: [2023-04-29 17:23:23,995] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 20: [2023-04-29 17:23:23,995] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 31: [2023-04-29 17:23:23,996] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 20: [2023-04-29 17:23:23,997] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 31: [2023-04-29 17:23:23,997] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 7: [2023-04-29 17:23:23,997] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 23: [2023-04-29 17:23:23,997] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 23: [2023-04-29 17:23:23,997] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 23: [2023-04-29 17:23:23,997] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 23: [2023-04-29 17:23:23,998] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 23: [2023-04-29 17:23:23,998] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 24: [2023-04-29 17:23:24,003] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 29: [2023-04-29 17:23:24,003] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 29: [2023-04-29 17:23:24,003] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 24: [2023-04-29 17:23:24,004] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 24: [2023-04-29 17:23:24,004] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 24: [2023-04-29 17:23:24,004] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 24: [2023-04-29 17:23:24,004] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 24: [2023-04-29 17:23:24,004] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 24: [2023-04-29 17:23:24,004] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 24: [2023-04-29 17:23:24,005] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 29: [2023-04-29 17:23:24,006] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 29: [2023-04-29 17:23:24,006] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 29: [2023-04-29 17:23:24,006] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 29: [2023-04-29 17:23:24,006] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 29: [2023-04-29 17:23:24,006] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 29: [2023-04-29 17:23:24,007] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 29: [2023-04-29 17:23:24,007] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 24: [2023-04-29 17:23:24,008] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 7: [2023-04-29 17:23:24,009] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 7: [2023-04-29 17:23:24,009] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 7: [2023-04-29 17:23:24,009] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 7: [2023-04-29 17:23:24,009] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 29: [2023-04-29 17:23:24,010] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 30: [2023-04-29 17:23:24,011] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 30: [2023-04-29 17:23:24,011] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 30: [2023-04-29 17:23:24,011] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 30: [2023-04-29 17:23:24,011] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 30: [2023-04-29 17:23:24,011] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 30: [2023-04-29 17:23:24,011] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 30: [2023-04-29 17:23:24,011] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 29: [2023-04-29 17:23:24,012] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 7: [2023-04-29 17:23:24,012] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 16: [2023-04-29 17:23:24,012] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 16: [2023-04-29 17:23:24,012] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 16: [2023-04-29 17:23:24,013] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 16: [2023-04-29 17:23:24,013] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 16: [2023-04-29 17:23:24,013] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 16: [2023-04-29 17:23:24,013] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 16: [2023-04-29 17:23:24,013] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 16: [2023-04-29 17:23:24,013] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 24: [2023-04-29 17:23:24,014] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 7: [2023-04-29 17:23:24,014] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 24: [2023-04-29 17:23:24,014] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 30: [2023-04-29 17:23:24,015] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 31: [2023-04-29 17:23:24,015] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 24: [2023-04-29 17:23:24,015] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 25: [2023-04-29 17:23:24,016] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 25: [2023-04-29 17:23:24,016] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 24: [2023-04-29 17:23:24,016] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 7: [2023-04-29 17:23:24,016] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 31: [2023-04-29 17:23:24,016] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 31: [2023-04-29 17:23:24,016] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 24: [2023-04-29 17:23:24,017] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 29: [2023-04-29 17:23:24,016] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 29: [2023-04-29 17:23:24,016] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 31: [2023-04-29 17:23:24,018] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 29: [2023-04-29 17:23:24,018] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 16: [2023-04-29 17:23:24,017] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 24: [2023-04-29 17:23:24,018] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 24: [2023-04-29 17:23:24,018] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 29: [2023-04-29 17:23:24,018] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 29: [2023-04-29 17:23:24,019] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 16: [2023-04-29 17:23:24,019] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 16: [2023-04-29 17:23:24,019] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 16: [2023-04-29 17:23:24,019] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 25: [2023-04-29 17:23:24,019] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 25: [2023-04-29 17:23:24,019] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 25: [2023-04-29 17:23:24,019] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 25: [2023-04-29 17:23:24,019] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 25: [2023-04-29 17:23:24,019] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 16: [2023-04-29 17:23:24,020] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 25: [2023-04-29 17:23:24,020] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 16: [2023-04-29 17:23:24,020] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 16: [2023-04-29 17:23:24,020] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 25: [2023-04-29 17:23:24,020] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 16: [2023-04-29 17:23:24,020] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 25: [2023-04-29 17:23:24,020] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 31: [2023-04-29 17:23:24,020] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 22: [2023-04-29 17:23:24,021] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 22: [2023-04-29 17:23:24,021] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 7: [2023-04-29 17:23:24,023] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 25: [2023-04-29 17:23:24,026] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 25: [2023-04-29 17:23:24,028] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 25: [2023-04-29 17:23:24,030] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 25: [2023-04-29 17:23:24,030] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 25: [2023-04-29 17:23:24,030] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 25: [2023-04-29 17:23:24,031] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 5: [2023-04-29 17:23:24,033] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 5: [2023-04-29 17:23:24,033] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 2: [2023-04-29 17:23:24,033] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 2: [2023-04-29 17:23:24,033] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 2: [2023-04-29 17:23:24,035] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 2: [2023-04-29 17:23:24,035] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 2: [2023-04-29 17:23:24,035] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 2: [2023-04-29 17:23:24,035] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 2: [2023-04-29 17:23:24,035] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 2: [2023-04-29 17:23:24,035] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 7: [2023-04-29 17:23:24,036] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 14: [2023-04-29 17:23:24,037] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 7: [2023-04-29 17:23:24,040] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 11: [2023-04-29 17:23:24,040] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 11: [2023-04-29 17:23:24,040] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 2: [2023-04-29 17:23:24,040] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 2: [2023-04-29 17:23:24,040] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 2: [2023-04-29 17:23:24,040] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 14: [2023-04-29 17:23:24,040] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 7: [2023-04-29 17:23:24,040] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 7: [2023-04-29 17:23:24,040] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 15: [2023-04-29 17:23:24,040] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 15: [2023-04-29 17:23:24,040] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 15: [2023-04-29 17:23:24,040] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 15: [2023-04-29 17:23:24,040] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 15: [2023-04-29 17:23:24,040] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 15: [2023-04-29 17:23:24,040] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 15: [2023-04-29 17:23:24,040] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 15: [2023-04-29 17:23:24,041] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 2: [2023-04-29 17:23:24,041] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 23: [2023-04-29 17:23:24,041] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 2: [2023-04-29 17:23:24,042] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 11: [2023-04-29 17:23:24,042] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 11: [2023-04-29 17:23:24,042] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 11: [2023-04-29 17:23:24,042] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 11: [2023-04-29 17:23:24,042] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 11: [2023-04-29 17:23:24,042] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 11: [2023-04-29 17:23:24,043] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 2: [2023-04-29 17:23:24,043] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 22: [2023-04-29 17:23:24,043] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 28: [2023-04-29 17:23:24,043] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 28: [2023-04-29 17:23:24,043] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 22: [2023-04-29 17:23:24,043] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 28: [2023-04-29 17:23:24,043] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 22: [2023-04-29 17:23:24,043] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 22: [2023-04-29 17:23:24,043] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 22: [2023-04-29 17:23:24,043] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 28: [2023-04-29 17:23:24,043] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 28: [2023-04-29 17:23:24,043] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 28: [2023-04-29 17:23:24,043] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 28: [2023-04-29 17:23:24,043] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 28: [2023-04-29 17:23:24,044] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 2: [2023-04-29 17:23:24,044] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 2: [2023-04-29 17:23:24,044] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 23: [2023-04-29 17:23:24,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 11: [2023-04-29 17:23:24,045] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 11: [2023-04-29 17:23:24,045] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 11: [2023-04-29 17:23:24,046] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 22: [2023-04-29 17:23:24,046] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 22: [2023-04-29 17:23:24,046] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 22: [2023-04-29 17:23:24,047] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 30: [2023-04-29 17:23:24,047] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 30: [2023-04-29 17:23:24,047] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 30: [2023-04-29 17:23:24,048] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 30: [2023-04-29 17:23:24,048] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 5: [2023-04-29 17:23:24,051] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 15: [2023-04-29 17:23:24,051] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 30: [2023-04-29 17:23:24,051] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 30: [2023-04-29 17:23:24,051] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 15: [2023-04-29 17:23:24,051] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 13: [2023-04-29 17:23:24,051] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 30: [2023-04-29 17:23:24,051] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 13: [2023-04-29 17:23:24,051] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 11: [2023-04-29 17:23:24,052] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 11: [2023-04-29 17:23:24,052] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 13: [2023-04-29 17:23:24,052] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 13: [2023-04-29 17:23:24,052] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 13: [2023-04-29 17:23:24,052] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 13: [2023-04-29 17:23:24,052] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 11: [2023-04-29 17:23:24,052] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 13: [2023-04-29 17:23:24,052] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 15: [2023-04-29 17:23:24,052] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 13: [2023-04-29 17:23:24,052] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 15: [2023-04-29 17:23:24,053] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 15: [2023-04-29 17:23:24,053] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 11: [2023-04-29 17:23:24,053] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 11: [2023-04-29 17:23:24,053] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 15: [2023-04-29 17:23:24,053] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 5: [2023-04-29 17:23:24,054] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 15: [2023-04-29 17:23:24,054] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 15: [2023-04-29 17:23:24,054] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 28: [2023-04-29 17:23:24,055] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 28: [2023-04-29 17:23:24,055] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 5: [2023-04-29 17:23:24,056] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 28: [2023-04-29 17:23:24,056] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 28: [2023-04-29 17:23:24,057] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 28: [2023-04-29 17:23:24,057] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 13: [2023-04-29 17:23:24,057] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 24: [2023-04-29 17:23:24,057] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 13: [2023-04-29 17:23:24,058] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 28: [2023-04-29 17:23:24,058] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 28: [2023-04-29 17:23:24,059] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 28: [2023-04-29 17:23:24,059] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 14: [2023-04-29 17:23:24,060] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 29: [2023-04-29 17:23:24,056] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 23: [2023-04-29 17:23:24,061] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 13: [2023-04-29 17:23:24,062] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 14: [2023-04-29 17:23:24,063] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 13: [2023-04-29 17:23:24,063] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 23: [2023-04-29 17:23:24,063] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 13: [2023-04-29 17:23:24,063] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 13: [2023-04-29 17:23:24,064] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 13: [2023-04-29 17:23:24,064] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 16: [2023-04-29 17:23:24,064] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 13: [2023-04-29 17:23:24,065] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 29: [2023-04-29 17:23:24,065] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 14: [2023-04-29 17:23:24,066] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 14: [2023-04-29 17:23:24,066] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 18: [2023-04-29 17:23:24,065] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 18: [2023-04-29 17:23:24,066] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 18: [2023-04-29 17:23:24,066] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 18: [2023-04-29 17:23:24,066] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 18: [2023-04-29 17:23:24,066] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 18: [2023-04-29 17:23:24,066] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 18: [2023-04-29 17:23:24,066] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 18: [2023-04-29 17:23:24,066] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 5: [2023-04-29 17:23:24,067] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 5: [2023-04-29 17:23:24,067] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 5: [2023-04-29 17:23:24,067] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 5: [2023-04-29 17:23:24,067] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 5: [2023-04-29 17:23:24,069] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 14: [2023-04-29 17:23:24,069] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 14: [2023-04-29 17:23:24,069] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 14: [2023-04-29 17:23:24,069] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 14: [2023-04-29 17:23:24,069] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 23: [2023-04-29 17:23:24,068] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 23: [2023-04-29 17:23:24,069] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 23: [2023-04-29 17:23:24,069] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 23: [2023-04-29 17:23:24,070] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 23: [2023-04-29 17:23:24,070] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 4: [2023-04-29 17:23:24,070] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 4: [2023-04-29 17:23:24,070] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 4: [2023-04-29 17:23:24,070] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 4: [2023-04-29 17:23:24,070] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 4: [2023-04-29 17:23:24,070] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 4: [2023-04-29 17:23:24,070] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 4: [2023-04-29 17:23:24,070] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 4: [2023-04-29 17:23:24,070] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 25: [2023-04-29 17:23:24,071] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 25: [2023-04-29 17:23:24,071] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 22: [2023-04-29 17:23:24,073] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 5: [2023-04-29 17:23:24,073] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 22: [2023-04-29 17:23:24,073] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 23: [2023-04-29 17:23:24,074] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 4: [2023-04-29 17:23:24,074] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 4: [2023-04-29 17:23:24,074] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 22: [2023-04-29 17:23:24,076] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 4: [2023-04-29 17:23:24,078] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 18: [2023-04-29 17:23:24,078] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 18: [2023-04-29 17:23:24,079] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 16: [2023-04-29 17:23:24,079] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 16: [2023-04-29 17:23:24,079] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 24: [2023-04-29 17:23:24,079] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 18: [2023-04-29 17:23:24,079] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 29: [2023-04-29 17:23:24,080] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 18: [2023-04-29 17:23:24,080] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 18: [2023-04-29 17:23:24,080] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 16: [2023-04-29 17:23:24,080] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 18: [2023-04-29 17:23:24,081] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 4: [2023-04-29 17:23:24,080] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 4: [2023-04-29 17:23:24,081] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 4: [2023-04-29 17:23:24,082] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 18: [2023-04-29 17:23:24,082] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 4: [2023-04-29 17:23:24,082] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 18: [2023-04-29 17:23:24,082] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 4: [2023-04-29 17:23:24,083] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 22: [2023-04-29 17:23:24,083] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 22: [2023-04-29 17:23:24,083] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 25: [2023-04-29 17:23:24,083] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 16: [2023-04-29 17:23:24,084] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 24: [2023-04-29 17:23:24,084] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 29: [2023-04-29 17:23:24,085] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 22: [2023-04-29 17:23:24,086] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 23: [2023-04-29 17:23:24,088] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 16: [2023-04-29 17:23:24,091] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 16: [2023-04-29 17:23:24,091] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 16: [2023-04-29 17:23:24,091] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 16: [2023-04-29 17:23:24,091] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 29: [2023-04-29 17:23:24,091] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 29: [2023-04-29 17:23:24,091] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 29: [2023-04-29 17:23:24,091] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 29: [2023-04-29 17:23:24,091] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 29: [2023-04-29 17:23:24,091] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 29: [2023-04-29 17:23:24,091] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 24: [2023-04-29 17:23:24,092] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 24: [2023-04-29 17:23:24,092] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 24: [2023-04-29 17:23:24,092] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 0: [2023-04-29 17:23:24,092] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 0: [2023-04-29 17:23:24,092] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 0: [2023-04-29 17:23:24,092] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 0: [2023-04-29 17:23:24,092] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 0: [2023-04-29 17:23:24,092] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 0: [2023-04-29 17:23:24,092] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 0: [2023-04-29 17:23:24,092] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 0: [2023-04-29 17:23:24,093] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 25: [2023-04-29 17:23:24,094] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 25: [2023-04-29 17:23:24,095] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 2: [2023-04-29 17:23:24,094] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 2: [2023-04-29 17:23:24,094] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 2: [2023-04-29 17:23:24,094] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 5: [2023-04-29 17:23:24,095] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 25: [2023-04-29 17:23:24,096] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 5: [2023-04-29 17:23:24,097] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 5: [2023-04-29 17:23:24,097] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 8: [2023-04-29 17:23:24,097] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 8: [2023-04-29 17:23:24,097] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 8: [2023-04-29 17:23:24,097] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 8: [2023-04-29 17:23:24,097] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 8: [2023-04-29 17:23:24,097] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 8: [2023-04-29 17:23:24,097] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 8: [2023-04-29 17:23:24,097] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 8: [2023-04-29 17:23:24,098] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 11: [2023-04-29 17:23:24,097] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 11: [2023-04-29 17:23:24,097] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 11: [2023-04-29 17:23:24,097] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 5: [2023-04-29 17:23:24,099] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 23: [2023-04-29 17:23:24,099] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 14: [2023-04-29 17:23:24,100] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 24: [2023-04-29 17:23:24,101] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 24: [2023-04-29 17:23:24,101] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 5: [2023-04-29 17:23:24,102] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 2: [2023-04-29 17:23:24,102] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 14: [2023-04-29 17:23:24,102] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 14: [2023-04-29 17:23:24,102] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 24: [2023-04-29 17:23:24,102] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 23: [2023-04-29 17:23:24,103] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 8: [2023-04-29 17:23:24,103] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 23: [2023-04-29 17:23:24,104] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 25: [2023-04-29 17:23:24,104] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 8: [2023-04-29 17:23:24,104] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 8: [2023-04-29 17:23:24,105] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 14: [2023-04-29 17:23:24,104] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 23: [2023-04-29 17:23:24,105] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 2: [2023-04-29 17:23:24,105] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 2: [2023-04-29 17:23:24,105] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 2: [2023-04-29 17:23:24,105] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 8: [2023-04-29 17:23:24,105] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 14: [2023-04-29 17:23:24,105] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 14: [2023-04-29 17:23:24,105] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 0: [2023-04-29 17:23:24,105] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 8: [2023-04-29 17:23:24,105] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 23: [2023-04-29 17:23:24,106] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 8: [2023-04-29 17:23:24,106] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 25: [2023-04-29 17:23:24,106] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 0: [2023-04-29 17:23:24,106] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 8: [2023-04-29 17:23:24,107] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 0: [2023-04-29 17:23:24,107] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 8: [2023-04-29 17:23:24,107] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 0: [2023-04-29 17:23:24,107] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 0: [2023-04-29 17:23:24,108] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 16: [2023-04-29 17:23:24,108] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 0: [2023-04-29 17:23:24,108] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 0: [2023-04-29 17:23:24,109] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 25: [2023-04-29 17:23:24,109] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 25: [2023-04-29 17:23:24,109] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 25: [2023-04-29 17:23:24,109] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 13: [2023-04-29 17:23:24,109] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 0: [2023-04-29 17:23:24,110] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt... 16: [2023-04-29 17:23:24,111] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 27: [2023-04-29 17:23:24,111] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 16: [2023-04-29 17:23:24,111] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 27: [2023-04-29 17:23:24,111] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 27: [2023-04-29 17:23:24,111] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 27: [2023-04-29 17:23:24,111] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 27: [2023-04-29 17:23:24,111] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 27: [2023-04-29 17:23:24,111] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 27: [2023-04-29 17:23:24,111] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 27: [2023-04-29 17:23:24,112] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 27: [2023-04-29 17:23:24,114] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 13: [2023-04-29 17:23:24,114] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 24: [2023-04-29 17:23:24,114] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 11: [2023-04-29 17:23:24,115] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 11: [2023-04-29 17:23:24,115] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 2: [2023-04-29 17:23:24,117] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 11: [2023-04-29 17:23:24,118] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 11: [2023-04-29 17:23:24,118] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 11: [2023-04-29 17:23:24,118] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 2: [2023-04-29 17:23:24,119] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 2: [2023-04-29 17:23:24,119] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 11: [2023-04-29 17:23:24,119] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 11: [2023-04-29 17:23:24,120] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 11: [2023-04-29 17:23:24,120] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 27: [2023-04-29 17:23:24,120] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 24: [2023-04-29 17:23:24,121] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 2: [2023-04-29 17:23:24,121] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 16: [2023-04-29 17:23:24,123] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 25: [2023-04-29 17:23:24,123] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 16: [2023-04-29 17:23:24,124] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 16: [2023-04-29 17:23:24,124] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 27: [2023-04-29 17:23:24,123] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 27: [2023-04-29 17:23:24,124] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 27: [2023-04-29 17:23:24,124] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 16: [2023-04-29 17:23:24,124] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 29: [2023-04-29 17:23:24,124] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 27: [2023-04-29 17:23:24,125] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 27: [2023-04-29 17:23:24,125] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 24: [2023-04-29 17:23:24,126] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 4: [2023-04-29 17:23:24,125] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 4: [2023-04-29 17:23:24,125] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 24: [2023-04-29 17:23:24,126] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 27: [2023-04-29 17:23:24,126] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 28: [2023-04-29 17:23:24,126] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 15: [2023-04-29 17:23:24,128] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 29: [2023-04-29 17:23:24,128] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 29: [2023-04-29 17:23:24,129] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 29: [2023-04-29 17:23:24,129] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 24: [2023-04-29 17:23:24,130] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 13: [2023-04-29 17:23:24,130] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 29: [2023-04-29 17:23:24,132] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 13: [2023-04-29 17:23:24,132] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 13: [2023-04-29 17:23:24,132] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 13: [2023-04-29 17:23:24,132] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 29: [2023-04-29 17:23:24,132] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 24: [2023-04-29 17:23:24,133] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 25: [2023-04-29 17:23:24,133] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 15: [2023-04-29 17:23:24,133] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 24: [2023-04-29 17:23:24,133] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 15: [2023-04-29 17:23:24,133] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 15: [2023-04-29 17:23:24,133] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 15: [2023-04-29 17:23:24,133] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 13: [2023-04-29 17:23:24,135] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 13: [2023-04-29 17:23:24,135] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 13: [2023-04-29 17:23:24,135] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 28: [2023-04-29 17:23:24,135] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 15: [2023-04-29 17:23:24,136] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 13: [2023-04-29 17:23:24,137] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 28: [2023-04-29 17:23:24,137] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 2: [2023-04-29 17:23:24,138] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 2: [2023-04-29 17:23:24,138] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 15: [2023-04-29 17:23:24,138] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 25: [2023-04-29 17:23:24,139] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 25: [2023-04-29 17:23:24,139] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 2: [2023-04-29 17:23:24,140] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 2: [2023-04-29 17:23:24,140] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 25: [2023-04-29 17:23:24,141] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 11: [2023-04-29 17:23:24,142] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 3: [2023-04-29 17:23:24,142] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 3: [2023-04-29 17:23:24,142] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 11: [2023-04-29 17:23:24,143] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 3: [2023-04-29 17:23:24,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 3: [2023-04-29 17:23:24,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 3: [2023-04-29 17:23:24,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 3: [2023-04-29 17:23:24,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 3: [2023-04-29 17:23:24,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 3: [2023-04-29 17:23:24,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 28: [2023-04-29 17:23:24,144] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 2: [2023-04-29 17:23:24,145] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 4: [2023-04-29 17:23:24,146] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 4: [2023-04-29 17:23:24,147] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 3: [2023-04-29 17:23:24,147] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 3: [2023-04-29 17:23:24,147] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 3: [2023-04-29 17:23:24,150] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 3: [2023-04-29 17:23:24,151] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 3: [2023-04-29 17:23:24,151] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 11: [2023-04-29 17:23:24,151] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 3: [2023-04-29 17:23:24,151] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 4: [2023-04-29 17:23:24,151] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 3: [2023-04-29 17:23:24,151] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 11: [2023-04-29 17:23:24,152] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 11: [2023-04-29 17:23:24,152] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 3: [2023-04-29 17:23:24,152] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 28: [2023-04-29 17:23:24,152] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 15: [2023-04-29 17:23:24,153] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 15: [2023-04-29 17:23:24,153] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 4: [2023-04-29 17:23:24,154] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 4: [2023-04-29 17:23:24,154] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 4: [2023-04-29 17:23:24,154] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 4: [2023-04-29 17:23:24,154] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 4: [2023-04-29 17:23:24,154] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 27: [2023-04-29 17:23:24,155] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 18: [2023-04-29 17:23:24,157] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 18: [2023-04-29 17:23:24,157] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 28: [2023-04-29 17:23:24,158] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 28: [2023-04-29 17:23:24,158] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 28: [2023-04-29 17:23:24,158] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 28: [2023-04-29 17:23:24,158] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 8: [2023-04-29 17:23:24,158] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 8: [2023-04-29 17:23:24,158] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 8: [2023-04-29 17:23:24,158] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 18: [2023-04-29 17:23:24,160] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 18: [2023-04-29 17:23:24,160] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 13: [2023-04-29 17:23:24,162] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 13: [2023-04-29 17:23:24,162] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 13: [2023-04-29 17:23:24,165] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 8: [2023-04-29 17:23:24,166] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 8: [2023-04-29 17:23:24,166] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 15: [2023-04-29 17:23:24,167] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 8: [2023-04-29 17:23:24,168] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 8: [2023-04-29 17:23:24,168] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 8: [2023-04-29 17:23:24,168] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 13: [2023-04-29 17:23:24,169] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 28: [2023-04-29 17:23:24,169] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 13: [2023-04-29 17:23:24,170] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 13: [2023-04-29 17:23:24,170] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 15: [2023-04-29 17:23:24,172] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 15: [2023-04-29 17:23:24,172] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 18: [2023-04-29 17:23:24,174] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 18: [2023-04-29 17:23:24,174] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 18: [2023-04-29 17:23:24,174] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 18: [2023-04-29 17:23:24,174] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 15: [2023-04-29 17:23:24,175] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 15: [2023-04-29 17:23:24,175] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 27: [2023-04-29 17:23:24,175] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 26: [2023-04-29 17:23:24,179] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 26: [2023-04-29 17:23:24,179] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 26: [2023-04-29 17:23:24,179] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 26: [2023-04-29 17:23:24,179] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 26: [2023-04-29 17:23:24,179] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 26: [2023-04-29 17:23:24,179] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 26: [2023-04-29 17:23:24,179] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 26: [2023-04-29 17:23:24,180] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 15: [2023-04-29 17:23:24,180] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 28: [2023-04-29 17:23:24,181] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 1: [2023-04-29 17:23:24,181] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 1: [2023-04-29 17:23:24,181] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 1: [2023-04-29 17:23:24,181] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 28: [2023-04-29 17:23:24,181] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 1: [2023-04-29 17:23:24,181] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 1: [2023-04-29 17:23:24,181] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 1: [2023-04-29 17:23:24,181] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 1: [2023-04-29 17:23:24,181] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 1: [2023-04-29 17:23:24,182] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 8: [2023-04-29 17:23:24,182] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 8: [2023-04-29 17:23:24,182] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 15: [2023-04-29 17:23:24,182] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 26: [2023-04-29 17:23:24,183] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 4: [2023-04-29 17:23:24,185] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 8: [2023-04-29 17:23:24,185] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 4: [2023-04-29 17:23:24,186] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 26: [2023-04-29 17:23:24,186] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 26: [2023-04-29 17:23:24,186] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 26: [2023-04-29 17:23:24,186] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 26: [2023-04-29 17:23:24,187] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 26: [2023-04-29 17:23:24,187] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 1: [2023-04-29 17:23:24,187] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 1: [2023-04-29 17:23:24,187] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 27: [2023-04-29 17:23:24,186] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 0: [2023-04-29 17:23:24,187] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 1: [2023-04-29 17:23:24,187] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 26: [2023-04-29 17:23:24,187] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 4: [2023-04-29 17:23:24,187] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 1: [2023-04-29 17:23:24,187] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 26: [2023-04-29 17:23:24,188] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 0: [2023-04-29 17:23:24,189] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 0: [2023-04-29 17:23:24,189] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 18: [2023-04-29 17:23:24,189] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 1: [2023-04-29 17:23:24,189] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 18: [2023-04-29 17:23:24,189] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 1: [2023-04-29 17:23:24,190] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 1: [2023-04-29 17:23:24,190] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 4: [2023-04-29 17:23:24,190] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 1: [2023-04-29 17:23:24,190] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 4: [2023-04-29 17:23:24,191] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 28: [2023-04-29 17:23:24,192] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 28: [2023-04-29 17:23:24,192] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 28: [2023-04-29 17:23:24,193] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 18: [2023-04-29 17:23:24,193] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 4: [2023-04-29 17:23:24,193] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 8: [2023-04-29 17:23:24,195] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 28: [2023-04-29 17:23:24,196] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 0: [2023-04-29 17:23:24,197] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 0: [2023-04-29 17:23:24,197] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 0: [2023-04-29 17:23:24,197] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 0: [2023-04-29 17:23:24,197] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 0: [2023-04-29 17:23:24,197] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_17-model_00-model_states.pt. 3: [2023-04-29 17:23:24,197] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 18: [2023-04-29 17:23:24,198] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 3: [2023-04-29 17:23:24,198] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 8: [2023-04-29 17:23:24,195] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 8: [2023-04-29 17:23:24,196] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 8: [2023-04-29 17:23:24,197] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 8: [2023-04-29 17:23:24,197] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 27: [2023-04-29 17:23:24,201] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 27: [2023-04-29 17:23:24,201] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 27: [2023-04-29 17:23:24,201] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 27: [2023-04-29 17:23:24,204] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 27: [2023-04-29 17:23:24,206] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 27: [2023-04-29 17:23:24,206] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 27: [2023-04-29 17:23:24,210] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 18: [2023-04-29 17:23:24,212] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 18: [2023-04-29 17:23:24,213] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 18: [2023-04-29 17:23:24,214] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 18: [2023-04-29 17:23:24,215] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 0: [2023-04-29 17:23:24,216] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 3: [2023-04-29 17:23:24,217] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 3: [2023-04-29 17:23:24,217] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 3: [2023-04-29 17:23:24,219] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 0: [2023-04-29 17:23:24,220] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 20: [2023-04-29 17:23:24,220] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 20: [2023-04-29 17:23:24,220] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 20: [2023-04-29 17:23:24,219] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 20: [2023-04-29 17:23:24,220] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 20: [2023-04-29 17:23:24,220] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 20: [2023-04-29 17:23:24,220] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 20: [2023-04-29 17:23:24,220] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 20: [2023-04-29 17:23:24,220] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 0: [2023-04-29 17:23:24,222] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 3: [2023-04-29 17:23:24,224] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 3: [2023-04-29 17:23:24,224] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 3: [2023-04-29 17:23:24,224] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 3: [2023-04-29 17:23:24,224] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 3: [2023-04-29 17:23:24,224] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 20: [2023-04-29 17:23:24,225] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 20: [2023-04-29 17:23:24,226] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 20: [2023-04-29 17:23:24,227] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 20: [2023-04-29 17:23:24,230] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 20: [2023-04-29 17:23:24,230] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 20: [2023-04-29 17:23:24,230] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 20: [2023-04-29 17:23:24,230] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 20: [2023-04-29 17:23:24,231] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 12: [2023-04-29 17:23:24,231] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 12: [2023-04-29 17:23:24,231] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 12: [2023-04-29 17:23:24,231] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 12: [2023-04-29 17:23:24,231] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 12: [2023-04-29 17:23:24,231] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 12: [2023-04-29 17:23:24,231] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 12: [2023-04-29 17:23:24,231] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 12: [2023-04-29 17:23:24,232] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 0: [2023-04-29 17:23:24,235] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 12: [2023-04-29 17:23:24,235] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 0: [2023-04-29 17:23:24,235] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 0: [2023-04-29 17:23:24,235] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 27: [2023-04-29 17:23:24,236] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 0: [2023-04-29 17:23:24,237] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 12: [2023-04-29 17:23:24,237] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 27: [2023-04-29 17:23:24,237] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 27: [2023-04-29 17:23:24,237] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 12: [2023-04-29 17:23:24,237] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 0: [2023-04-29 17:23:24,237] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 27: [2023-04-29 17:23:24,237] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 12: [2023-04-29 17:23:24,238] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 12: [2023-04-29 17:23:24,239] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 12: [2023-04-29 17:23:24,239] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 12: [2023-04-29 17:23:24,239] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 27: [2023-04-29 17:23:24,240] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 12: [2023-04-29 17:23:24,241] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 26: [2023-04-29 17:23:24,241] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 26: [2023-04-29 17:23:24,241] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 26: [2023-04-29 17:23:24,242] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 27: [2023-04-29 17:23:24,242] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 30: [2023-04-29 17:23:24,242] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 30: [2023-04-29 17:23:24,243] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 30: [2023-04-29 17:23:24,243] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 30: [2023-04-29 17:23:24,243] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 30: [2023-04-29 17:23:24,243] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 30: [2023-04-29 17:23:24,243] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 30: [2023-04-29 17:23:24,243] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 30: [2023-04-29 17:23:24,244] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 1: [2023-04-29 17:23:24,244] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 1: [2023-04-29 17:23:24,244] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 1: [2023-04-29 17:23:24,244] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 1: [2023-04-29 17:23:24,244] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 3: [2023-04-29 17:23:24,246] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 26: [2023-04-29 17:23:24,249] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 1: [2023-04-29 17:23:24,250] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 1: [2023-04-29 17:23:24,250] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 1: [2023-04-29 17:23:24,250] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 1: [2023-04-29 17:23:24,250] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 26: [2023-04-29 17:23:24,251] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 26: [2023-04-29 17:23:24,251] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 26: [2023-04-29 17:23:24,251] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 26: [2023-04-29 17:23:24,251] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 21: [2023-04-29 17:23:24,252] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 21: [2023-04-29 17:23:24,252] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 21: [2023-04-29 17:23:24,252] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 21: [2023-04-29 17:23:24,252] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 21: [2023-04-29 17:23:24,252] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 21: [2023-04-29 17:23:24,252] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 21: [2023-04-29 17:23:24,252] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 21: [2023-04-29 17:23:24,253] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 30: [2023-04-29 17:23:24,254] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 30: [2023-04-29 17:23:24,254] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 3: [2023-04-29 17:23:24,254] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 30: [2023-04-29 17:23:24,255] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 30: [2023-04-29 17:23:24,255] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 30: [2023-04-29 17:23:24,255] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 3: [2023-04-29 17:23:24,255] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 30: [2023-04-29 17:23:24,255] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 30: [2023-04-29 17:23:24,256] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 21: [2023-04-29 17:23:24,256] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 21: [2023-04-29 17:23:24,257] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 21: [2023-04-29 17:23:24,257] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 30: [2023-04-29 17:23:24,257] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 3: [2023-04-29 17:23:24,257] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 3: [2023-04-29 17:23:24,258] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 21: [2023-04-29 17:23:24,258] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 3: [2023-04-29 17:23:24,259] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 21: [2023-04-29 17:23:24,259] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 21: [2023-04-29 17:23:24,259] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 21: [2023-04-29 17:23:24,259] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 21: [2023-04-29 17:23:24,260] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 10: [2023-04-29 17:23:24,261] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 10: [2023-04-29 17:23:24,261] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 10: [2023-04-29 17:23:24,261] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 10: [2023-04-29 17:23:24,261] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 10: [2023-04-29 17:23:24,261] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 10: [2023-04-29 17:23:24,261] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 10: [2023-04-29 17:23:24,261] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 10: [2023-04-29 17:23:24,262] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 26: [2023-04-29 17:23:24,263] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 6: [2023-04-29 17:23:24,264] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 6: [2023-04-29 17:23:24,264] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 6: [2023-04-29 17:23:24,264] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 6: [2023-04-29 17:23:24,265] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 6: [2023-04-29 17:23:24,265] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 6: [2023-04-29 17:23:24,265] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 6: [2023-04-29 17:23:24,265] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 7: [2023-04-29 17:23:24,265] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 7: [2023-04-29 17:23:24,265] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 7: [2023-04-29 17:23:24,265] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 6: [2023-04-29 17:23:24,265] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 7: [2023-04-29 17:23:24,265] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 7: [2023-04-29 17:23:24,265] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 7: [2023-04-29 17:23:24,265] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 7: [2023-04-29 17:23:24,265] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 26: [2023-04-29 17:23:24,265] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 7: [2023-04-29 17:23:24,266] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 10: [2023-04-29 17:23:24,267] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 10: [2023-04-29 17:23:24,267] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 10: [2023-04-29 17:23:24,267] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 10: [2023-04-29 17:23:24,267] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 1: [2023-04-29 17:23:24,268] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 1: [2023-04-29 17:23:24,268] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 7: [2023-04-29 17:23:24,268] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 10: [2023-04-29 17:23:24,269] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 7: [2023-04-29 17:23:24,269] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 6: [2023-04-29 17:23:24,269] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 6: [2023-04-29 17:23:24,269] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 7: [2023-04-29 17:23:24,269] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 10: [2023-04-29 17:23:24,269] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 10: [2023-04-29 17:23:24,271] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 10: [2023-04-29 17:23:24,271] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 7: [2023-04-29 17:23:24,271] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 1: [2023-04-29 17:23:24,271] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 1: [2023-04-29 17:23:24,271] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 7: [2023-04-29 17:23:24,271] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 7: [2023-04-29 17:23:24,271] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 7: [2023-04-29 17:23:24,272] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 7: [2023-04-29 17:23:24,272] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 26: [2023-04-29 17:23:24,272] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 6: [2023-04-29 17:23:24,274] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 6: [2023-04-29 17:23:24,274] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 6: [2023-04-29 17:23:24,274] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 6: [2023-04-29 17:23:24,275] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 6: [2023-04-29 17:23:24,275] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 26: [2023-04-29 17:23:24,276] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 6: [2023-04-29 17:23:24,276] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 1: [2023-04-29 17:23:24,278] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 1: [2023-04-29 17:23:24,278] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 26: [2023-04-29 17:23:24,279] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 26: [2023-04-29 17:23:24,280] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 26: [2023-04-29 17:23:24,280] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 20: [2023-04-29 17:23:24,280] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 26: [2023-04-29 17:23:24,281] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 1: [2023-04-29 17:23:24,281] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 12: [2023-04-29 17:23:24,281] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 20: [2023-04-29 17:23:24,281] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 1: [2023-04-29 17:23:24,282] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 20: [2023-04-29 17:23:24,284] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 20: [2023-04-29 17:23:24,294] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 20: [2023-04-29 17:23:24,294] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 20: [2023-04-29 17:23:24,295] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 20: [2023-04-29 17:23:24,295] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 20: [2023-04-29 17:23:24,295] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 12: [2023-04-29 17:23:24,296] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 12: [2023-04-29 17:23:24,298] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 12: [2023-04-29 17:23:24,300] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 20: [2023-04-29 17:23:24,304] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 12: [2023-04-29 17:23:24,306] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 17: [2023-04-29 17:23:24,306] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 20: [2023-04-29 17:23:24,307] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 17: [2023-04-29 17:23:24,307] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 17: [2023-04-29 17:23:24,307] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 17: [2023-04-29 17:23:24,307] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 17: [2023-04-29 17:23:24,307] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 17: [2023-04-29 17:23:24,307] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 17: [2023-04-29 17:23:24,307] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 12: [2023-04-29 17:23:24,308] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 17: [2023-04-29 17:23:24,308] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 20: [2023-04-29 17:23:24,309] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 21: [2023-04-29 17:23:24,310] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 21: [2023-04-29 17:23:24,310] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 21: [2023-04-29 17:23:24,310] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 12: [2023-04-29 17:23:24,310] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 12: [2023-04-29 17:23:24,311] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 12: [2023-04-29 17:23:24,311] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 17: [2023-04-29 17:23:24,312] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 17: [2023-04-29 17:23:24,313] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 7: [2023-04-29 17:23:24,314] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 17: [2023-04-29 17:23:24,315] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 17: [2023-04-29 17:23:24,317] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 17: [2023-04-29 17:23:24,318] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 17: [2023-04-29 17:23:24,318] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 17: [2023-04-29 17:23:24,318] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 17: [2023-04-29 17:23:24,319] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 6: [2023-04-29 17:23:24,320] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 6: [2023-04-29 17:23:24,320] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 5: [2023-04-29 17:23:24,320] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 5: [2023-04-29 17:23:24,320] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 5: [2023-04-29 17:23:24,321] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 5: [2023-04-29 17:23:24,321] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 5: [2023-04-29 17:23:24,321] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 5: [2023-04-29 17:23:24,321] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 5: [2023-04-29 17:23:24,321] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 5: [2023-04-29 17:23:24,322] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 20: [2023-04-29 17:23:24,323] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 10: [2023-04-29 17:23:24,323] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 10: [2023-04-29 17:23:24,323] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 10: [2023-04-29 17:23:24,323] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 10: [2023-04-29 17:23:24,323] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 7: [2023-04-29 17:23:24,324] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 20: [2023-04-29 17:23:24,325] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 12: [2023-04-29 17:23:24,325] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 5: [2023-04-29 17:23:24,325] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 5: [2023-04-29 17:23:24,325] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 21: [2023-04-29 17:23:24,326] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 21: [2023-04-29 17:23:24,326] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 21: [2023-04-29 17:23:24,326] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 21: [2023-04-29 17:23:24,326] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 21: [2023-04-29 17:23:24,326] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 20: [2023-04-29 17:23:24,327] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 12: [2023-04-29 17:23:24,326] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 20: [2023-04-29 17:23:24,327] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 7: [2023-04-29 17:23:24,327] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 30: [2023-04-29 17:23:24,327] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 12: [2023-04-29 17:23:24,327] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 20: [2023-04-29 17:23:24,329] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 10: [2023-04-29 17:23:24,329] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 10: [2023-04-29 17:23:24,329] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 10: [2023-04-29 17:23:24,329] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 10: [2023-04-29 17:23:24,329] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 5: [2023-04-29 17:23:24,331] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 16: [2023-04-29 17:23:24,331] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 16: [2023-04-29 17:23:24,331] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 16: [2023-04-29 17:23:24,331] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 16: [2023-04-29 17:23:24,332] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 16: [2023-04-29 17:23:24,332] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 16: [2023-04-29 17:23:24,332] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 16: [2023-04-29 17:23:24,332] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 5: [2023-04-29 17:23:24,332] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 21: [2023-04-29 17:23:24,332] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 16: [2023-04-29 17:23:24,332] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 5: [2023-04-29 17:23:24,333] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 21: [2023-04-29 17:23:24,333] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 21: [2023-04-29 17:23:24,333] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 5: [2023-04-29 17:23:24,333] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 5: [2023-04-29 17:23:24,333] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 7: [2023-04-29 17:23:24,334] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 5: [2023-04-29 17:23:24,334] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 12: [2023-04-29 17:23:24,336] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 16: [2023-04-29 17:23:24,336] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 16: [2023-04-29 17:23:24,338] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 16: [2023-04-29 17:23:24,338] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 12: [2023-04-29 17:23:24,338] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 16: [2023-04-29 17:23:24,338] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 16: [2023-04-29 17:23:24,338] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 16: [2023-04-29 17:23:24,339] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 12: [2023-04-29 17:23:24,339] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 16: [2023-04-29 17:23:24,339] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 12: [2023-04-29 17:23:24,339] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 16: [2023-04-29 17:23:24,339] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 7: [2023-04-29 17:23:24,339] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 7: [2023-04-29 17:23:24,339] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 7: [2023-04-29 17:23:24,339] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 7: [2023-04-29 17:23:24,339] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 7: [2023-04-29 17:23:24,339] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 6: [2023-04-29 17:23:24,341] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 6: [2023-04-29 17:23:24,342] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 6: [2023-04-29 17:23:24,343] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 30: [2023-04-29 17:23:24,346] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 30: [2023-04-29 17:23:24,346] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 30: [2023-04-29 17:23:24,346] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 30: [2023-04-29 17:23:24,346] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 30: [2023-04-29 17:23:24,346] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 30: [2023-04-29 17:23:24,346] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 30: [2023-04-29 17:23:24,346] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 7: [2023-04-29 17:23:24,346] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 7: [2023-04-29 17:23:24,347] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 25: [2023-04-29 17:23:24,346] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 25: [2023-04-29 17:23:24,346] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 25: [2023-04-29 17:23:24,347] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 25: [2023-04-29 17:23:24,347] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 25: [2023-04-29 17:23:24,347] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 25: [2023-04-29 17:23:24,347] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 25: [2023-04-29 17:23:24,347] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 25: [2023-04-29 17:23:24,347] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 10: [2023-04-29 17:23:24,348] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 6: [2023-04-29 17:23:24,350] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 6: [2023-04-29 17:23:24,350] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 6: [2023-04-29 17:23:24,350] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 6: [2023-04-29 17:23:24,350] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 6: [2023-04-29 17:23:24,350] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 10: [2023-04-29 17:23:24,350] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 10: [2023-04-29 17:23:24,350] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 10: [2023-04-29 17:23:24,350] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 30: [2023-04-29 17:23:24,351] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 25: [2023-04-29 17:23:24,351] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 25: [2023-04-29 17:23:24,351] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 21: [2023-04-29 17:23:24,352] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 21: [2023-04-29 17:23:24,353] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 21: [2023-04-29 17:23:24,354] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 25: [2023-04-29 17:23:24,356] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 25: [2023-04-29 17:23:24,357] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 10: [2023-04-29 17:23:24,357] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 25: [2023-04-29 17:23:24,357] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 25: [2023-04-29 17:23:24,358] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 25: [2023-04-29 17:23:24,358] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 10: [2023-04-29 17:23:24,359] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 25: [2023-04-29 17:23:24,359] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 21: [2023-04-29 17:23:24,359] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 21: [2023-04-29 17:23:24,359] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 10: [2023-04-29 17:23:24,361] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 10: [2023-04-29 17:23:24,361] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 7: [2023-04-29 17:23:24,365] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 17: [2023-04-29 17:23:24,366] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 7: [2023-04-29 17:23:24,368] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 17: [2023-04-29 17:23:24,368] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 6: [2023-04-29 17:23:24,369] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 7: [2023-04-29 17:23:24,370] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 24: [2023-04-29 17:23:24,371] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 24: [2023-04-29 17:23:24,372] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 24: [2023-04-29 17:23:24,372] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 24: [2023-04-29 17:23:24,372] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 24: [2023-04-29 17:23:24,372] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 24: [2023-04-29 17:23:24,372] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 24: [2023-04-29 17:23:24,372] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 11: [2023-04-29 17:23:24,372] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 11: [2023-04-29 17:23:24,372] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 11: [2023-04-29 17:23:24,372] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 24: [2023-04-29 17:23:24,372] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 11: [2023-04-29 17:23:24,372] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 11: [2023-04-29 17:23:24,372] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 11: [2023-04-29 17:23:24,372] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 11: [2023-04-29 17:23:24,372] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 7: [2023-04-29 17:23:24,373] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 7: [2023-04-29 17:23:24,373] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 2: [2023-04-29 17:23:24,372] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 2: [2023-04-29 17:23:24,372] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 2: [2023-04-29 17:23:24,372] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 2: [2023-04-29 17:23:24,373] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 2: [2023-04-29 17:23:24,373] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 2: [2023-04-29 17:23:24,373] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 2: [2023-04-29 17:23:24,373] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 31: [2023-04-29 17:23:24,373] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 31: [2023-04-29 17:23:24,373] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 31: [2023-04-29 17:23:24,373] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 11: [2023-04-29 17:23:24,373] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 2: [2023-04-29 17:23:24,373] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 31: [2023-04-29 17:23:24,374] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 31: [2023-04-29 17:23:24,374] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 31: [2023-04-29 17:23:24,374] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 31: [2023-04-29 17:23:24,374] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 31: [2023-04-29 17:23:24,374] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 19: [2023-04-29 17:23:24,374] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 19: [2023-04-29 17:23:24,374] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 19: [2023-04-29 17:23:24,374] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 19: [2023-04-29 17:23:24,374] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 19: [2023-04-29 17:23:24,375] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 19: [2023-04-29 17:23:24,375] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 19: [2023-04-29 17:23:24,375] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 24: [2023-04-29 17:23:24,375] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 19: [2023-04-29 17:23:24,376] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 2: [2023-04-29 17:23:24,376] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 2: [2023-04-29 17:23:24,376] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 11: [2023-04-29 17:23:24,377] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 29: [2023-04-29 17:23:24,376] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 29: [2023-04-29 17:23:24,376] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 29: [2023-04-29 17:23:24,377] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 29: [2023-04-29 17:23:24,377] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 11: [2023-04-29 17:23:24,377] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 29: [2023-04-29 17:23:24,377] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 29: [2023-04-29 17:23:24,377] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 29: [2023-04-29 17:23:24,377] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 11: [2023-04-29 17:23:24,377] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 31: [2023-04-29 17:23:24,377] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 2: [2023-04-29 17:23:24,377] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 5: [2023-04-29 17:23:24,377] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 5: [2023-04-29 17:23:24,377] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 29: [2023-04-29 17:23:24,377] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 31: [2023-04-29 17:23:24,378] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 31: [2023-04-29 17:23:24,378] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 14: [2023-04-29 17:23:24,378] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 14: [2023-04-29 17:23:24,378] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 9: [2023-04-29 17:23:24,378] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 9: [2023-04-29 17:23:24,378] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 9: [2023-04-29 17:23:24,378] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 9: [2023-04-29 17:23:24,378] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 9: [2023-04-29 17:23:24,378] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 9: [2023-04-29 17:23:24,378] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 9: [2023-04-29 17:23:24,378] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 9: [2023-04-29 17:23:24,379] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 19: [2023-04-29 17:23:24,379] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 19: [2023-04-29 17:23:24,379] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 19: [2023-04-29 17:23:24,379] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 17: [2023-04-29 17:23:24,379] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 14: [2023-04-29 17:23:24,380] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 31: [2023-04-29 17:23:24,380] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 14: [2023-04-29 17:23:24,380] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 29: [2023-04-29 17:23:24,380] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 14: [2023-04-29 17:23:24,380] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 29: [2023-04-29 17:23:24,380] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 31: [2023-04-29 17:23:24,380] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 14: [2023-04-29 17:23:24,380] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 14: [2023-04-29 17:23:24,380] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 6: [2023-04-29 17:23:24,380] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 31: [2023-04-29 17:23:24,380] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 31: [2023-04-29 17:23:24,381] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 14: [2023-04-29 17:23:24,381] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 6: [2023-04-29 17:23:24,381] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 31: [2023-04-29 17:23:24,381] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 2: [2023-04-29 17:23:24,380] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 6: [2023-04-29 17:23:24,382] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 15: [2023-04-29 17:23:24,381] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 15: [2023-04-29 17:23:24,381] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 15: [2023-04-29 17:23:24,381] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 15: [2023-04-29 17:23:24,381] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 15: [2023-04-29 17:23:24,381] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 15: [2023-04-29 17:23:24,381] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 15: [2023-04-29 17:23:24,381] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 15: [2023-04-29 17:23:24,382] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 14: [2023-04-29 17:23:24,382] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 30: [2023-04-29 17:23:24,382] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 11: [2023-04-29 17:23:24,382] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 2: [2023-04-29 17:23:24,382] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 11: [2023-04-29 17:23:24,383] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 24: [2023-04-29 17:23:24,382] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 2: [2023-04-29 17:23:24,383] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 19: [2023-04-29 17:23:24,383] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 24: [2023-04-29 17:23:24,383] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 14: [2023-04-29 17:23:24,383] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 19: [2023-04-29 17:23:24,383] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 24: [2023-04-29 17:23:24,383] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 11: [2023-04-29 17:23:24,383] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 30: [2023-04-29 17:23:24,383] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 24: [2023-04-29 17:23:24,383] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 2: [2023-04-29 17:23:24,384] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 11: [2023-04-29 17:23:24,384] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 9: [2023-04-29 17:23:24,384] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 9: [2023-04-29 17:23:24,384] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 9: [2023-04-29 17:23:24,384] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 9: [2023-04-29 17:23:24,384] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 2: [2023-04-29 17:23:24,384] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 11: [2023-04-29 17:23:24,384] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 6: [2023-04-29 17:23:24,384] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 6: [2023-04-29 17:23:24,384] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 9: [2023-04-29 17:23:24,384] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 19: [2023-04-29 17:23:24,384] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 24: [2023-04-29 17:23:24,384] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 9: [2023-04-29 17:23:24,384] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 9: [2023-04-29 17:23:24,385] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 30: [2023-04-29 17:23:24,385] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 19: [2023-04-29 17:23:24,385] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 9: [2023-04-29 17:23:24,385] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 24: [2023-04-29 17:23:24,385] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 19: [2023-04-29 17:23:24,385] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 24: [2023-04-29 17:23:24,385] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 17: [2023-04-29 17:23:24,387] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 17: [2023-04-29 17:23:24,387] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 23: [2023-04-29 17:23:24,387] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 29: [2023-04-29 17:23:24,387] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 29: [2023-04-29 17:23:24,388] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 23: [2023-04-29 17:23:24,388] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 29: [2023-04-29 17:23:24,388] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 29: [2023-04-29 17:23:24,388] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 30: [2023-04-29 17:23:24,388] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 30: [2023-04-29 17:23:24,388] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 30: [2023-04-29 17:23:24,388] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 30: [2023-04-29 17:23:24,388] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 14: [2023-04-29 17:23:24,388] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 14: [2023-04-29 17:23:24,388] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 29: [2023-04-29 17:23:24,388] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 23: [2023-04-29 17:23:24,389] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 23: [2023-04-29 17:23:24,389] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 23: [2023-04-29 17:23:24,389] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 23: [2023-04-29 17:23:24,389] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 23: [2023-04-29 17:23:24,389] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 29: [2023-04-29 17:23:24,389] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 23: [2023-04-29 17:23:24,389] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 14: [2023-04-29 17:23:24,390] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 14: [2023-04-29 17:23:24,391] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 14: [2023-04-29 17:23:24,391] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 17: [2023-04-29 17:23:24,392] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 23: [2023-04-29 17:23:24,392] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 23: [2023-04-29 17:23:24,392] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 14: [2023-04-29 17:23:24,392] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 17: [2023-04-29 17:23:24,393] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 15: [2023-04-29 17:23:24,393] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 16: [2023-04-29 17:23:24,394] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 16: [2023-04-29 17:23:24,394] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 17: [2023-04-29 17:23:24,395] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 16: [2023-04-29 17:23:24,396] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 15: [2023-04-29 17:23:24,395] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 15: [2023-04-29 17:23:24,395] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 15: [2023-04-29 17:23:24,396] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 15: [2023-04-29 17:23:24,396] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 15: [2023-04-29 17:23:24,397] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 5: [2023-04-29 17:23:24,397] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 5: [2023-04-29 17:23:24,397] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 15: [2023-04-29 17:23:24,397] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 5: [2023-04-29 17:23:24,398] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 17: [2023-04-29 17:23:24,398] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 17: [2023-04-29 17:23:24,398] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 15: [2023-04-29 17:23:24,398] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 23: [2023-04-29 17:23:24,399] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 23: [2023-04-29 17:23:24,399] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 23: [2023-04-29 17:23:24,399] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 23: [2023-04-29 17:23:24,399] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 23: [2023-04-29 17:23:24,400] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 23: [2023-04-29 17:23:24,400] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 25: [2023-04-29 17:23:24,402] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 25: [2023-04-29 17:23:24,402] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 5: [2023-04-29 17:23:24,403] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 17: [2023-04-29 17:23:24,404] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 16: [2023-04-29 17:23:24,405] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 16: [2023-04-29 17:23:24,405] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 16: [2023-04-29 17:23:24,405] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 16: [2023-04-29 17:23:24,405] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 16: [2023-04-29 17:23:24,405] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 5: [2023-04-29 17:23:24,405] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 5: [2023-04-29 17:23:24,408] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 5: [2023-04-29 17:23:24,408] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 5: [2023-04-29 17:23:24,408] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 13: [2023-04-29 17:23:24,409] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 13: [2023-04-29 17:23:24,409] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 13: [2023-04-29 17:23:24,411] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 13: [2023-04-29 17:23:24,411] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 13: [2023-04-29 17:23:24,411] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 13: [2023-04-29 17:23:24,412] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 13: [2023-04-29 17:23:24,412] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 13: [2023-04-29 17:23:24,412] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 13: [2023-04-29 17:23:24,413] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 17: [2023-04-29 17:23:24,415] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 13: [2023-04-29 17:23:24,416] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 28: [2023-04-29 17:23:24,417] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 28: [2023-04-29 17:23:24,417] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 28: [2023-04-29 17:23:24,417] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 28: [2023-04-29 17:23:24,418] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 28: [2023-04-29 17:23:24,418] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 28: [2023-04-29 17:23:24,418] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 28: [2023-04-29 17:23:24,418] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 28: [2023-04-29 17:23:24,418] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 13: [2023-04-29 17:23:24,419] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 5: [2023-04-29 17:23:24,420] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 13: [2023-04-29 17:23:24,421] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 13: [2023-04-29 17:23:24,421] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 13: [2023-04-29 17:23:24,422] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 25: [2023-04-29 17:23:24,422] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 13: [2023-04-29 17:23:24,423] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 31: [2023-04-29 17:23:24,422] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 25: [2023-04-29 17:23:24,423] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 13: [2023-04-29 17:23:24,423] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 2: [2023-04-29 17:23:24,424] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 25: [2023-04-29 17:23:24,425] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 25: [2023-04-29 17:23:24,425] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 25: [2023-04-29 17:23:24,425] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 24: [2023-04-29 17:23:24,425] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 25: [2023-04-29 17:23:24,425] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 17: [2023-04-29 17:23:24,426] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 22: [2023-04-29 17:23:24,427] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 22: [2023-04-29 17:23:24,427] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 16: [2023-04-29 17:23:24,427] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 22: [2023-04-29 17:23:24,427] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 22: [2023-04-29 17:23:24,427] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 22: [2023-04-29 17:23:24,427] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 16: [2023-04-29 17:23:24,428] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 22: [2023-04-29 17:23:24,428] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 22: [2023-04-29 17:23:24,428] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 16: [2023-04-29 17:23:24,428] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 22: [2023-04-29 17:23:24,428] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 25: [2023-04-29 17:23:24,428] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 25: [2023-04-29 17:23:24,428] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 17: [2023-04-29 17:23:24,429] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 28: [2023-04-29 17:23:24,429] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 28: [2023-04-29 17:23:24,429] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 17: [2023-04-29 17:23:24,429] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 17: [2023-04-29 17:23:24,430] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 29: [2023-04-29 17:23:24,430] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 11: [2023-04-29 17:23:24,430] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 11: [2023-04-29 17:23:24,430] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 11: [2023-04-29 17:23:24,430] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 22: [2023-04-29 17:23:24,430] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 28: [2023-04-29 17:23:24,431] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 28: [2023-04-29 17:23:24,431] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 28: [2023-04-29 17:23:24,432] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 28: [2023-04-29 17:23:24,432] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 5: [2023-04-29 17:23:24,432] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 28: [2023-04-29 17:23:24,432] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 16: [2023-04-29 17:23:24,432] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 22: [2023-04-29 17:23:24,432] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 19: [2023-04-29 17:23:24,433] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 19: [2023-04-29 17:23:24,433] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 19: [2023-04-29 17:23:24,433] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 14: [2023-04-29 17:23:24,432] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 16: [2023-04-29 17:23:24,433] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 28: [2023-04-29 17:23:24,434] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 2: [2023-04-29 17:23:24,434] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 2: [2023-04-29 17:23:24,434] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 29: [2023-04-29 17:23:24,434] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 31: [2023-04-29 17:23:24,434] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 31: [2023-04-29 17:23:24,434] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 8: [2023-04-29 17:23:24,434] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 8: [2023-04-29 17:23:24,434] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 16: [2023-04-29 17:23:24,435] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 16: [2023-04-29 17:23:24,435] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 14: [2023-04-29 17:23:24,436] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 8: [2023-04-29 17:23:24,436] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 8: [2023-04-29 17:23:24,436] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 8: [2023-04-29 17:23:24,436] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 8: [2023-04-29 17:23:24,436] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 8: [2023-04-29 17:23:24,436] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 5: [2023-04-29 17:23:24,437] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 8: [2023-04-29 17:23:24,437] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 22: [2023-04-29 17:23:24,437] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 16: [2023-04-29 17:23:24,438] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 22: [2023-04-29 17:23:24,438] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 22: [2023-04-29 17:23:24,438] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 2: [2023-04-29 17:23:24,439] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 22: [2023-04-29 17:23:24,439] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 22: [2023-04-29 17:23:24,440] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 5: [2023-04-29 17:23:24,440] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 5: [2023-04-29 17:23:24,440] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 22: [2023-04-29 17:23:24,440] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 23: [2023-04-29 17:23:24,439] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 8: [2023-04-29 17:23:24,440] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 8: [2023-04-29 17:23:24,441] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 5: [2023-04-29 17:23:24,441] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 31: [2023-04-29 17:23:24,442] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 9: [2023-04-29 17:23:24,442] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 9: [2023-04-29 17:23:24,442] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 9: [2023-04-29 17:23:24,442] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 9: [2023-04-29 17:23:24,442] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 8: [2023-04-29 17:23:24,443] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 8: [2023-04-29 17:23:24,443] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 8: [2023-04-29 17:23:24,443] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 2: [2023-04-29 17:23:24,443] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 4: [2023-04-29 17:23:24,444] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 4: [2023-04-29 17:23:24,444] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 31: [2023-04-29 17:23:24,444] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 8: [2023-04-29 17:23:24,444] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 27: [2023-04-29 17:23:24,444] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 8: [2023-04-29 17:23:24,445] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 27: [2023-04-29 17:23:24,444] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 27: [2023-04-29 17:23:24,445] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 27: [2023-04-29 17:23:24,445] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 27: [2023-04-29 17:23:24,445] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 27: [2023-04-29 17:23:24,445] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 27: [2023-04-29 17:23:24,445] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 8: [2023-04-29 17:23:24,445] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 2: [2023-04-29 17:23:24,445] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 27: [2023-04-29 17:23:24,445] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 11: [2023-04-29 17:23:24,446] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 11: [2023-04-29 17:23:24,446] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 11: [2023-04-29 17:23:24,446] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 24: [2023-04-29 17:23:24,447] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 9: [2023-04-29 17:23:24,447] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 9: [2023-04-29 17:23:24,447] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 9: [2023-04-29 17:23:24,448] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 9: [2023-04-29 17:23:24,448] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 27: [2023-04-29 17:23:24,448] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 11: [2023-04-29 17:23:24,448] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 11: [2023-04-29 17:23:24,448] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 31: [2023-04-29 17:23:24,448] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 31: [2023-04-29 17:23:24,448] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 31: [2023-04-29 17:23:24,448] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 31: [2023-04-29 17:23:24,448] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 23: [2023-04-29 17:23:24,448] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 29: [2023-04-29 17:23:24,449] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 19: [2023-04-29 17:23:24,450] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 19: [2023-04-29 17:23:24,450] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 19: [2023-04-29 17:23:24,450] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 19: [2023-04-29 17:23:24,450] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 4: [2023-04-29 17:23:24,449] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 4: [2023-04-29 17:23:24,449] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 4: [2023-04-29 17:23:24,450] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 4: [2023-04-29 17:23:24,451] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 4: [2023-04-29 17:23:24,451] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 4: [2023-04-29 17:23:24,451] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 4: [2023-04-29 17:23:24,451] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 4: [2023-04-29 17:23:24,451] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 11: [2023-04-29 17:23:24,451] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 19: [2023-04-29 17:23:24,452] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 14: [2023-04-29 17:23:24,453] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 11: [2023-04-29 17:23:24,453] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 11: [2023-04-29 17:23:24,453] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 19: [2023-04-29 17:23:24,453] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 19: [2023-04-29 17:23:24,455] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 29: [2023-04-29 17:23:24,455] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 2: [2023-04-29 17:23:24,455] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 19: [2023-04-29 17:23:24,455] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 31: [2023-04-29 17:23:24,455] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 27: [2023-04-29 17:23:24,455] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 27: [2023-04-29 17:23:24,456] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 2: [2023-04-29 17:23:24,456] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 31: [2023-04-29 17:23:24,456] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 27: [2023-04-29 17:23:24,457] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 2: [2023-04-29 17:23:24,457] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 2: [2023-04-29 17:23:24,457] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 14: [2023-04-29 17:23:24,457] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 27: [2023-04-29 17:23:24,457] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 2: [2023-04-29 17:23:24,457] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 14: [2023-04-29 17:23:24,457] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 25: [2023-04-29 17:23:24,457] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 13: [2023-04-29 17:23:24,457] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 27: [2023-04-29 17:23:24,458] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 0: [2023-04-29 17:23:24,458] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 0: [2023-04-29 17:23:24,458] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 0: [2023-04-29 17:23:24,458] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 27: [2023-04-29 17:23:24,458] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 0: [2023-04-29 17:23:24,458] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 0: [2023-04-29 17:23:24,458] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 0: [2023-04-29 17:23:24,458] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 0: [2023-04-29 17:23:24,458] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 27: [2023-04-29 17:23:24,458] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 0: [2023-04-29 17:23:24,459] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 24: [2023-04-29 17:23:24,459] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 24: [2023-04-29 17:23:24,459] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 24: [2023-04-29 17:23:24,459] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 25: [2023-04-29 17:23:24,460] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 29: [2023-04-29 17:23:24,460] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 29: [2023-04-29 17:23:24,460] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 24: [2023-04-29 17:23:24,461] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 24: [2023-04-29 17:23:24,461] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 23: [2023-04-29 17:23:24,461] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 24: [2023-04-29 17:23:24,462] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 4: [2023-04-29 17:23:24,461] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 4: [2023-04-29 17:23:24,462] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 24: [2023-04-29 17:23:24,462] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 23: [2023-04-29 17:23:24,462] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 4: [2023-04-29 17:23:24,463] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 2: [2023-04-29 17:23:24,463] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 4: [2023-04-29 17:23:24,463] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 29: [2023-04-29 17:23:24,463] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 29: [2023-04-29 17:23:24,463] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 29: [2023-04-29 17:23:24,463] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 29: [2023-04-29 17:23:24,463] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 4: [2023-04-29 17:23:24,463] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 4: [2023-04-29 17:23:24,464] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 25: [2023-04-29 17:23:24,464] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 25: [2023-04-29 17:23:24,465] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 0: [2023-04-29 17:23:24,465] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 25: [2023-04-29 17:23:24,466] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 15: [2023-04-29 17:23:24,465] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 14: [2023-04-29 17:23:24,466] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 14: [2023-04-29 17:23:24,466] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 31: [2023-04-29 17:23:24,467] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 25: [2023-04-29 17:23:24,467] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 2: [2023-04-29 17:23:24,473] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 0: [2023-04-29 17:23:24,472] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 0: [2023-04-29 17:23:24,473] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 0: [2023-04-29 17:23:24,473] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 9: [2023-04-29 17:23:24,473] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 13: [2023-04-29 17:23:24,473] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 23: [2023-04-29 17:23:24,473] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 23: [2023-04-29 17:23:24,473] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 0: [2023-04-29 17:23:24,473] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 11: [2023-04-29 17:23:24,473] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 31: [2023-04-29 17:23:24,473] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 23: [2023-04-29 17:23:24,473] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 23: [2023-04-29 17:23:24,473] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 23: [2023-04-29 17:23:24,474] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 9: [2023-04-29 17:23:24,473] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 14: [2023-04-29 17:23:24,474] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 0: [2023-04-29 17:23:24,474] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 31: [2023-04-29 17:23:24,474] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 23: [2023-04-29 17:23:24,474] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 0: [2023-04-29 17:23:24,474] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 14: [2023-04-29 17:23:24,474] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 14: [2023-04-29 17:23:24,474] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 9: [2023-04-29 17:23:24,475] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 9: [2023-04-29 17:23:24,475] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 31: [2023-04-29 17:23:24,475] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 0: [2023-04-29 17:23:24,476] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 11: [2023-04-29 17:23:24,476] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 11: [2023-04-29 17:23:24,476] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 22: [2023-04-29 17:23:24,476] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 9: [2023-04-29 17:23:24,476] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 11: [2023-04-29 17:23:24,477] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 31: [2023-04-29 17:23:24,477] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 13: [2023-04-29 17:23:24,477] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 19: [2023-04-29 17:23:24,477] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 9: [2023-04-29 17:23:24,478] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 19: [2023-04-29 17:23:24,478] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 15: [2023-04-29 17:23:24,478] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 15: [2023-04-29 17:23:24,478] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 15: [2023-04-29 17:23:24,478] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 15: [2023-04-29 17:23:24,478] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 11: [2023-04-29 17:23:24,478] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 19: [2023-04-29 17:23:24,479] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 9: [2023-04-29 17:23:24,480] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 9: [2023-04-29 17:23:24,480] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 19: [2023-04-29 17:23:24,481] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 2: [2023-04-29 17:23:24,482] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 14: [2023-04-29 17:23:24,483] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 2: [2023-04-29 17:23:24,485] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 2: [2023-04-29 17:23:24,485] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 19: [2023-04-29 17:23:24,485] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 15: [2023-04-29 17:23:24,484] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 15: [2023-04-29 17:23:24,484] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 15: [2023-04-29 17:23:24,484] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 23: [2023-04-29 17:23:24,487] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 22: [2023-04-29 17:23:24,487] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 13: [2023-04-29 17:23:24,487] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 15: [2023-04-29 17:23:24,489] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 13: [2023-04-29 17:23:24,489] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 13: [2023-04-29 17:23:24,489] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 13: [2023-04-29 17:23:24,490] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 29: [2023-04-29 17:23:24,492] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 24: [2023-04-29 17:23:24,493] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 14: [2023-04-29 17:23:24,494] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 29: [2023-04-29 17:23:24,494] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 14: [2023-04-29 17:23:24,494] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 13: [2023-04-29 17:23:24,494] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 13: [2023-04-29 17:23:24,494] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 3: [2023-04-29 17:23:24,494] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 3: [2023-04-29 17:23:24,494] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 29: [2023-04-29 17:23:24,495] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 24: [2023-04-29 17:23:24,496] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 3: [2023-04-29 17:23:24,496] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 3: [2023-04-29 17:23:24,496] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 3: [2023-04-29 17:23:24,496] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 3: [2023-04-29 17:23:24,496] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 3: [2023-04-29 17:23:24,496] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 29: [2023-04-29 17:23:24,496] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 3: [2023-04-29 17:23:24,497] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 27: [2023-04-29 17:23:24,497] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 8: [2023-04-29 17:23:24,497] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 8: [2023-04-29 17:23:24,497] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 3: [2023-04-29 17:23:24,498] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 24: [2023-04-29 17:23:24,498] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 24: [2023-04-29 17:23:24,498] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 13: [2023-04-29 17:23:24,498] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 3: [2023-04-29 17:23:24,499] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 22: [2023-04-29 17:23:24,499] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 29: [2023-04-29 17:23:24,499] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 29: [2023-04-29 17:23:24,499] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 8: [2023-04-29 17:23:24,500] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 4: [2023-04-29 17:23:24,500] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 8: [2023-04-29 17:23:24,502] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 8: [2023-04-29 17:23:24,502] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 4: [2023-04-29 17:23:24,502] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 3: [2023-04-29 17:23:24,502] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 24: [2023-04-29 17:23:24,502] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 24: [2023-04-29 17:23:24,503] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 24: [2023-04-29 17:23:24,503] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 18: [2023-04-29 17:23:24,503] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 18: [2023-04-29 17:23:24,503] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 18: [2023-04-29 17:23:24,503] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 3: [2023-04-29 17:23:24,503] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 18: [2023-04-29 17:23:24,503] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 18: [2023-04-29 17:23:24,503] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 18: [2023-04-29 17:23:24,503] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 18: [2023-04-29 17:23:24,503] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 3: [2023-04-29 17:23:24,504] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 14: [2023-04-29 17:23:24,504] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 18: [2023-04-29 17:23:24,504] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 3: [2023-04-29 17:23:24,504] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 1: [2023-04-29 17:23:24,504] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 3: [2023-04-29 17:23:24,504] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 1: [2023-04-29 17:23:24,504] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 1: [2023-04-29 17:23:24,504] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 1: [2023-04-29 17:23:24,504] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 1: [2023-04-29 17:23:24,504] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 1: [2023-04-29 17:23:24,504] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 1: [2023-04-29 17:23:24,504] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 3: [2023-04-29 17:23:24,504] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 1: [2023-04-29 17:23:24,505] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 8: [2023-04-29 17:23:24,505] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 8: [2023-04-29 17:23:24,505] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 8: [2023-04-29 17:23:24,505] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 23: [2023-04-29 17:23:24,505] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 23: [2023-04-29 17:23:24,506] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 14: [2023-04-29 17:23:24,506] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 23: [2023-04-29 17:23:24,507] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 14: [2023-04-29 17:23:24,507] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 22: [2023-04-29 17:23:24,509] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 22: [2023-04-29 17:23:24,509] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 22: [2023-04-29 17:23:24,509] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 23: [2023-04-29 17:23:24,510] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 1: [2023-04-29 17:23:24,509] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 1: [2023-04-29 17:23:24,510] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 1: [2023-04-29 17:23:24,510] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 1: [2023-04-29 17:23:24,510] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 22: [2023-04-29 17:23:24,510] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 22: [2023-04-29 17:23:24,511] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 22: [2023-04-29 17:23:24,511] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 15: [2023-04-29 17:23:24,511] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 15: [2023-04-29 17:23:24,511] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 28: [2023-04-29 17:23:24,511] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 28: [2023-04-29 17:23:24,511] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 28: [2023-04-29 17:23:24,511] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 28: [2023-04-29 17:23:24,511] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 28: [2023-04-29 17:23:24,511] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 1: [2023-04-29 17:23:24,511] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 22: [2023-04-29 17:23:24,512] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 1: [2023-04-29 17:23:24,512] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 1: [2023-04-29 17:23:24,512] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 1: [2023-04-29 17:23:24,513] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 23: [2023-04-29 17:23:24,513] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 15: [2023-04-29 17:23:24,515] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 27: [2023-04-29 17:23:24,515] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 18: [2023-04-29 17:23:24,515] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 15: [2023-04-29 17:23:24,515] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 18: [2023-04-29 17:23:24,517] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 13: [2023-04-29 17:23:24,517] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 18: [2023-04-29 17:23:24,518] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 15: [2023-04-29 17:23:24,518] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 18: [2023-04-29 17:23:24,518] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 18: [2023-04-29 17:23:24,519] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 18: [2023-04-29 17:23:24,519] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 18: [2023-04-29 17:23:24,519] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 15: [2023-04-29 17:23:24,520] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 4: [2023-04-29 17:23:24,521] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 13: [2023-04-29 17:23:24,520] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 18: [2023-04-29 17:23:24,521] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt... 13: [2023-04-29 17:23:24,521] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 8: [2023-04-29 17:23:24,522] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 8: [2023-04-29 17:23:24,522] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 13: [2023-04-29 17:23:24,522] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 4: [2023-04-29 17:23:24,523] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 15: [2023-04-29 17:23:24,523] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 13: [2023-04-29 17:23:24,525] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 13: [2023-04-29 17:23:24,525] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 8: [2023-04-29 17:23:24,526] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 8: [2023-04-29 17:23:24,528] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 8: [2023-04-29 17:23:24,529] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 27: [2023-04-29 17:23:24,530] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 27: [2023-04-29 17:23:24,530] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 27: [2023-04-29 17:23:24,530] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 8: [2023-04-29 17:23:24,532] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 8: [2023-04-29 17:23:24,533] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 4: [2023-04-29 17:23:24,533] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 4: [2023-04-29 17:23:24,533] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 0: [2023-04-29 17:23:24,533] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 8: [2023-04-29 17:23:24,533] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 28: [2023-04-29 17:23:24,533] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 28: [2023-04-29 17:23:24,533] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 28: [2023-04-29 17:23:24,533] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 27: [2023-04-29 17:23:24,534] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 27: [2023-04-29 17:23:24,534] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 27: [2023-04-29 17:23:24,534] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 27: [2023-04-29 17:23:24,534] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 4: [2023-04-29 17:23:24,536] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 4: [2023-04-29 17:23:24,536] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 4: [2023-04-29 17:23:24,536] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 4: [2023-04-29 17:23:24,537] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 28: [2023-04-29 17:23:24,539] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 22: [2023-04-29 17:23:24,540] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 3: [2023-04-29 17:23:24,540] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 28: [2023-04-29 17:23:24,541] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 28: [2023-04-29 17:23:24,543] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 20: [2023-04-29 17:23:24,547] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 20: [2023-04-29 17:23:24,547] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 20: [2023-04-29 17:23:24,547] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 20: [2023-04-29 17:23:24,547] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 20: [2023-04-29 17:23:24,547] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 20: [2023-04-29 17:23:24,547] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 20: [2023-04-29 17:23:24,547] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 28: [2023-04-29 17:23:24,548] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 20: [2023-04-29 17:23:24,548] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 22: [2023-04-29 17:23:24,549] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 22: [2023-04-29 17:23:24,549] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 22: [2023-04-29 17:23:24,549] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 22: [2023-04-29 17:23:24,550] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 22: [2023-04-29 17:23:24,550] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 0: [2023-04-29 17:23:24,550] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 0: [2023-04-29 17:23:24,550] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 3: [2023-04-29 17:23:24,551] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 28: [2023-04-29 17:23:24,553] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 26: [2023-04-29 17:23:24,553] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 26: [2023-04-29 17:23:24,553] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 20: [2023-04-29 17:23:24,554] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 20: [2023-04-29 17:23:24,554] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 20: [2023-04-29 17:23:24,554] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 26: [2023-04-29 17:23:24,554] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 26: [2023-04-29 17:23:24,554] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 26: [2023-04-29 17:23:24,554] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 26: [2023-04-29 17:23:24,555] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 26: [2023-04-29 17:23:24,555] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 20: [2023-04-29 17:23:24,555] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 26: [2023-04-29 17:23:24,555] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 20: [2023-04-29 17:23:24,556] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 20: [2023-04-29 17:23:24,557] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 20: [2023-04-29 17:23:24,557] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 20: [2023-04-29 17:23:24,558] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 26: [2023-04-29 17:23:24,558] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 0: [2023-04-29 17:23:24,559] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 3: [2023-04-29 17:23:24,560] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 26: [2023-04-29 17:23:24,560] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 26: [2023-04-29 17:23:24,561] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 26: [2023-04-29 17:23:24,562] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 26: [2023-04-29 17:23:24,562] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 26: [2023-04-29 17:23:24,563] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 26: [2023-04-29 17:23:24,563] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 26: [2023-04-29 17:23:24,563] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 27: [2023-04-29 17:23:24,564] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 27: [2023-04-29 17:23:24,564] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 28: [2023-04-29 17:23:24,564] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 28: [2023-04-29 17:23:24,565] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 28: [2023-04-29 17:23:24,565] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 4: [2023-04-29 17:23:24,566] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 4: [2023-04-29 17:23:24,566] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 1: [2023-04-29 17:23:24,567] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 1: [2023-04-29 17:23:24,567] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 1: [2023-04-29 17:23:24,567] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 1: [2023-04-29 17:23:24,567] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 3: [2023-04-29 17:23:24,568] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 27: [2023-04-29 17:23:24,568] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 4: [2023-04-29 17:23:24,569] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 4: [2023-04-29 17:23:24,570] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 4: [2023-04-29 17:23:24,570] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 27: [2023-04-29 17:23:24,571] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 1: [2023-04-29 17:23:24,571] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 1: [2023-04-29 17:23:24,571] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 1: [2023-04-29 17:23:24,571] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 1: [2023-04-29 17:23:24,572] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 4: [2023-04-29 17:23:24,573] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 27: [2023-04-29 17:23:24,574] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 27: [2023-04-29 17:23:24,574] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 3: [2023-04-29 17:23:24,574] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 27: [2023-04-29 17:23:24,575] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 0: [2023-04-29 17:23:24,576] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 0: [2023-04-29 17:23:24,577] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 0: [2023-04-29 17:23:24,577] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 0: [2023-04-29 17:23:24,577] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 0: [2023-04-29 17:23:24,577] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 0: [2023-04-29 17:23:24,578] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 0: [2023-04-29 17:23:24,578] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 3: [2023-04-29 17:23:24,580] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 3: [2023-04-29 17:23:24,580] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 3: [2023-04-29 17:23:24,580] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 3: [2023-04-29 17:23:24,580] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 3: [2023-04-29 17:23:24,580] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 3: [2023-04-29 17:23:24,589] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 18: [2023-04-29 17:23:24,589] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 18: [2023-04-29 17:23:24,590] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 1: [2023-04-29 17:23:24,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 1: [2023-04-29 17:23:24,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 1: [2023-04-29 17:23:24,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 1: [2023-04-29 17:23:24,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 18: [2023-04-29 17:23:24,596] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 1: [2023-04-29 17:23:24,598] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 1: [2023-04-29 17:23:24,599] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 1: [2023-04-29 17:23:24,601] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 1: [2023-04-29 17:23:24,603] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 10: [2023-04-29 17:23:24,605] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 10: [2023-04-29 17:23:24,605] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 10: [2023-04-29 17:23:24,605] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 10: [2023-04-29 17:23:24,605] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 7: [2023-04-29 17:23:24,605] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 7: [2023-04-29 17:23:24,605] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 7: [2023-04-29 17:23:24,605] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 7: [2023-04-29 17:23:24,605] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 7: [2023-04-29 17:23:24,605] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 10: [2023-04-29 17:23:24,605] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 10: [2023-04-29 17:23:24,605] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 10: [2023-04-29 17:23:24,605] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 7: [2023-04-29 17:23:24,605] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 7: [2023-04-29 17:23:24,605] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 10: [2023-04-29 17:23:24,606] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 7: [2023-04-29 17:23:24,606] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 0: [2023-04-29 17:23:24,606] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 0: [2023-04-29 17:23:24,607] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 3: [2023-04-29 17:23:24,607] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 0: [2023-04-29 17:23:24,608] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 10: [2023-04-29 17:23:24,609] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 7: [2023-04-29 17:23:24,609] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 7: [2023-04-29 17:23:24,610] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 7: [2023-04-29 17:23:24,610] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 20: [2023-04-29 17:23:24,609] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 0: [2023-04-29 17:23:24,610] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 10: [2023-04-29 17:23:24,610] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 0: [2023-04-29 17:23:24,610] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 20: [2023-04-29 17:23:24,610] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 20: [2023-04-29 17:23:24,610] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 3: [2023-04-29 17:23:24,610] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 10: [2023-04-29 17:23:24,611] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 3: [2023-04-29 17:23:24,611] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 18: [2023-04-29 17:23:24,611] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 18: [2023-04-29 17:23:24,611] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 18: [2023-04-29 17:23:24,611] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 18: [2023-04-29 17:23:24,611] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 18: [2023-04-29 17:23:24,611] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_18-model_00-model_states.pt. 3: [2023-04-29 17:23:24,611] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 10: [2023-04-29 17:23:24,611] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 20: [2023-04-29 17:23:24,611] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 7: [2023-04-29 17:23:24,611] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 7: [2023-04-29 17:23:24,612] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 7: [2023-04-29 17:23:24,612] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 7: [2023-04-29 17:23:24,612] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 7: [2023-04-29 17:23:24,613] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 12: [2023-04-29 17:23:24,613] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 12: [2023-04-29 17:23:24,613] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 12: [2023-04-29 17:23:24,613] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 3: [2023-04-29 17:23:24,613] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 12: [2023-04-29 17:23:24,613] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 12: [2023-04-29 17:23:24,614] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 12: [2023-04-29 17:23:24,614] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 10: [2023-04-29 17:23:24,613] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 12: [2023-04-29 17:23:24,614] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 10: [2023-04-29 17:23:24,614] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 12: [2023-04-29 17:23:24,614] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 10: [2023-04-29 17:23:24,615] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 10: [2023-04-29 17:23:24,615] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 26: [2023-04-29 17:23:24,616] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 26: [2023-04-29 17:23:24,616] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 26: [2023-04-29 17:23:24,620] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 12: [2023-04-29 17:23:24,620] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 12: [2023-04-29 17:23:24,620] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 12: [2023-04-29 17:23:24,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 12: [2023-04-29 17:23:24,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 12: [2023-04-29 17:23:24,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 18: [2023-04-29 17:23:24,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 18: [2023-04-29 17:23:24,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 5: [2023-04-29 17:23:24,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 5: [2023-04-29 17:23:24,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 26: [2023-04-29 17:23:24,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 12: [2023-04-29 17:23:24,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 12: [2023-04-29 17:23:24,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 26: [2023-04-29 17:23:24,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 26: [2023-04-29 17:23:24,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 26: [2023-04-29 17:23:24,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 12: [2023-04-29 17:23:24,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 20: [2023-04-29 17:23:24,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 5: [2023-04-29 17:23:24,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 5: [2023-04-29 17:23:24,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 5: [2023-04-29 17:23:24,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 5: [2023-04-29 17:23:24,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 5: [2023-04-29 17:23:24,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 5: [2023-04-29 17:23:24,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 20: [2023-04-29 17:23:24,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 5: [2023-04-29 17:23:24,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 5: [2023-04-29 17:23:24,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 20: [2023-04-29 17:23:24,628] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 26: [2023-04-29 17:23:24,629] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 21: [2023-04-29 17:23:24,630] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 21: [2023-04-29 17:23:24,630] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 21: [2023-04-29 17:23:24,630] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 18: [2023-04-29 17:23:24,630] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 21: [2023-04-29 17:23:24,631] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 21: [2023-04-29 17:23:24,631] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 21: [2023-04-29 17:23:24,631] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 21: [2023-04-29 17:23:24,631] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 21: [2023-04-29 17:23:24,631] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 5: [2023-04-29 17:23:24,632] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 20: [2023-04-29 17:23:24,633] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 5: [2023-04-29 17:23:24,633] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 5: [2023-04-29 17:23:24,634] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 20: [2023-04-29 17:23:24,634] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 5: [2023-04-29 17:23:24,634] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 5: [2023-04-29 17:23:24,635] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 21: [2023-04-29 17:23:24,635] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 21: [2023-04-29 17:23:24,635] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 5: [2023-04-29 17:23:24,635] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 21: [2023-04-29 17:23:24,635] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 20: [2023-04-29 17:23:24,636] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 20: [2023-04-29 17:23:24,636] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 21: [2023-04-29 17:23:24,637] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 30: [2023-04-29 17:23:24,637] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 21: [2023-04-29 17:23:24,637] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 21: [2023-04-29 17:23:24,637] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 21: [2023-04-29 17:23:24,637] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 30: [2023-04-29 17:23:24,637] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 30: [2023-04-29 17:23:24,637] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 30: [2023-04-29 17:23:24,637] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 30: [2023-04-29 17:23:24,637] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 30: [2023-04-29 17:23:24,637] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 30: [2023-04-29 17:23:24,638] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 20: [2023-04-29 17:23:24,638] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 21: [2023-04-29 17:23:24,638] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 30: [2023-04-29 17:23:24,638] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 26: [2023-04-29 17:23:24,642] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 18: [2023-04-29 17:23:24,642] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 26: [2023-04-29 17:23:24,642] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 18: [2023-04-29 17:23:24,645] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 18: [2023-04-29 17:23:24,645] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 26: [2023-04-29 17:23:24,647] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 18: [2023-04-29 17:23:24,647] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 18: [2023-04-29 17:23:24,648] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 25: [2023-04-29 17:23:24,648] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 25: [2023-04-29 17:23:24,648] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 25: [2023-04-29 17:23:24,650] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 25: [2023-04-29 17:23:24,650] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 25: [2023-04-29 17:23:24,650] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 25: [2023-04-29 17:23:24,650] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 25: [2023-04-29 17:23:24,650] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 30: [2023-04-29 17:23:24,649] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 30: [2023-04-29 17:23:24,649] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 30: [2023-04-29 17:23:24,649] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 26: [2023-04-29 17:23:24,650] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 25: [2023-04-29 17:23:24,650] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 30: [2023-04-29 17:23:24,650] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 30: [2023-04-29 17:23:24,650] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 30: [2023-04-29 17:23:24,650] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 30: [2023-04-29 17:23:24,650] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 26: [2023-04-29 17:23:24,651] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 30: [2023-04-29 17:23:24,652] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 25: [2023-04-29 17:23:24,652] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 25: [2023-04-29 17:23:24,652] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 26: [2023-04-29 17:23:24,653] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 26: [2023-04-29 17:23:24,654] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 20: [2023-04-29 17:23:24,654] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 20: [2023-04-29 17:23:24,654] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 26: [2023-04-29 17:23:24,654] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 25: [2023-04-29 17:23:24,658] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 7: [2023-04-29 17:23:24,658] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 20: [2023-04-29 17:23:24,659] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 10: [2023-04-29 17:23:24,659] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 25: [2023-04-29 17:23:24,660] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 25: [2023-04-29 17:23:24,660] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 25: [2023-04-29 17:23:24,661] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 20: [2023-04-29 17:23:24,662] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 25: [2023-04-29 17:23:24,662] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 25: [2023-04-29 17:23:24,662] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 7: [2023-04-29 17:23:24,663] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 7: [2023-04-29 17:23:24,663] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 10: [2023-04-29 17:23:24,672] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 10: [2023-04-29 17:23:24,672] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 10: [2023-04-29 17:23:24,672] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 10: [2023-04-29 17:23:24,676] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 10: [2023-04-29 17:23:24,676] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 10: [2023-04-29 17:23:24,676] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 10: [2023-04-29 17:23:24,676] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 12: [2023-04-29 17:23:24,677] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 12: [2023-04-29 17:23:24,677] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 5: [2023-04-29 17:23:24,678] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 5: [2023-04-29 17:23:24,678] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 10: [2023-04-29 17:23:24,679] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 12: [2023-04-29 17:23:24,679] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 12: [2023-04-29 17:23:24,679] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 7: [2023-04-29 17:23:24,680] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 6: [2023-04-29 17:23:24,680] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 6: [2023-04-29 17:23:24,680] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 7: [2023-04-29 17:23:24,680] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 7: [2023-04-29 17:23:24,680] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 7: [2023-04-29 17:23:24,680] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 7: [2023-04-29 17:23:24,680] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 7: [2023-04-29 17:23:24,680] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 6: [2023-04-29 17:23:24,681] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 6: [2023-04-29 17:23:24,682] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 6: [2023-04-29 17:23:24,682] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 6: [2023-04-29 17:23:24,682] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 6: [2023-04-29 17:23:24,682] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 6: [2023-04-29 17:23:24,682] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 6: [2023-04-29 17:23:24,684] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 6: [2023-04-29 17:23:24,685] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 7: [2023-04-29 17:23:24,686] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 7: [2023-04-29 17:23:24,686] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 21: [2023-04-29 17:23:24,686] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 21: [2023-04-29 17:23:24,689] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 21: [2023-04-29 17:23:24,689] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 6: [2023-04-29 17:23:24,691] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 6: [2023-04-29 17:23:24,691] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 6: [2023-04-29 17:23:24,692] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 6: [2023-04-29 17:23:24,692] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 6: [2023-04-29 17:23:24,692] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 6: [2023-04-29 17:23:24,693] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 12: [2023-04-29 17:23:24,693] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 12: [2023-04-29 17:23:24,693] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 12: [2023-04-29 17:23:24,693] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 12: [2023-04-29 17:23:24,693] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 5: [2023-04-29 17:23:24,694] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 5: [2023-04-29 17:23:24,694] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 10: [2023-04-29 17:23:24,696] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 10: [2023-04-29 17:23:24,696] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 5: [2023-04-29 17:23:24,696] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 5: [2023-04-29 17:23:24,698] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 5: [2023-04-29 17:23:24,699] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 12: [2023-04-29 17:23:24,699] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 12: [2023-04-29 17:23:24,701] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 10: [2023-04-29 17:23:24,701] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 12: [2023-04-29 17:23:24,703] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 21: [2023-04-29 17:23:24,705] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 21: [2023-04-29 17:23:24,705] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 21: [2023-04-29 17:23:24,705] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 21: [2023-04-29 17:23:24,705] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 21: [2023-04-29 17:23:24,705] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 25: [2023-04-29 17:23:24,705] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 25: [2023-04-29 17:23:24,705] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 7: [2023-04-29 17:23:24,706] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 12: [2023-04-29 17:23:24,707] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 10: [2023-04-29 17:23:24,707] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 21: [2023-04-29 17:23:24,708] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 7: [2023-04-29 17:23:24,709] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 7: [2023-04-29 17:23:24,709] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 10: [2023-04-29 17:23:24,709] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 10: [2023-04-29 17:23:24,709] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 10: [2023-04-29 17:23:24,709] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 7: [2023-04-29 17:23:24,710] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 7: [2023-04-29 17:23:24,711] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 21: [2023-04-29 17:23:24,714] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 21: [2023-04-29 17:23:24,714] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 17: [2023-04-29 17:23:24,716] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 17: [2023-04-29 17:23:24,717] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 5: [2023-04-29 17:23:24,718] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 25: [2023-04-29 17:23:24,719] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 17: [2023-04-29 17:23:24,720] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 17: [2023-04-29 17:23:24,720] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 17: [2023-04-29 17:23:24,720] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 17: [2023-04-29 17:23:24,720] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 17: [2023-04-29 17:23:24,720] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 5: [2023-04-29 17:23:24,721] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 5: [2023-04-29 17:23:24,721] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 5: [2023-04-29 17:23:24,721] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 11: [2023-04-29 17:23:24,721] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 11: [2023-04-29 17:23:24,721] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 17: [2023-04-29 17:23:24,721] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 5: [2023-04-29 17:23:24,721] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 17: [2023-04-29 17:23:24,721] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 11: [2023-04-29 17:23:24,721] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 12: [2023-04-29 17:23:24,722] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 30: [2023-04-29 17:23:24,722] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 11: [2023-04-29 17:23:24,722] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 11: [2023-04-29 17:23:24,722] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 11: [2023-04-29 17:23:24,722] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 11: [2023-04-29 17:23:24,722] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 12: [2023-04-29 17:23:24,722] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 12: [2023-04-29 17:23:24,722] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 11: [2023-04-29 17:23:24,722] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 17: [2023-04-29 17:23:24,724] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 5: [2023-04-29 17:23:24,725] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 11: [2023-04-29 17:23:24,725] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 17: [2023-04-29 17:23:24,725] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 11: [2023-04-29 17:23:24,725] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 25: [2023-04-29 17:23:24,725] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 25: [2023-04-29 17:23:24,726] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 11: [2023-04-29 17:23:24,726] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 12: [2023-04-29 17:23:24,727] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 17: [2023-04-29 17:23:24,729] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 11: [2023-04-29 17:23:24,731] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 17: [2023-04-29 17:23:24,730] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 17: [2023-04-29 17:23:24,731] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 17: [2023-04-29 17:23:24,731] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 11: [2023-04-29 17:23:24,732] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 17: [2023-04-29 17:23:24,732] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 11: [2023-04-29 17:23:24,733] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 11: [2023-04-29 17:23:24,733] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 11: [2023-04-29 17:23:24,733] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 25: [2023-04-29 17:23:24,734] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 25: [2023-04-29 17:23:24,734] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 21: [2023-04-29 17:23:24,734] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 21: [2023-04-29 17:23:24,735] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 16: [2023-04-29 17:23:24,735] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 16: [2023-04-29 17:23:24,735] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 16: [2023-04-29 17:23:24,735] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 16: [2023-04-29 17:23:24,735] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 16: [2023-04-29 17:23:24,735] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 16: [2023-04-29 17:23:24,735] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 16: [2023-04-29 17:23:24,735] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 25: [2023-04-29 17:23:24,736] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 25: [2023-04-29 17:23:24,736] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 25: [2023-04-29 17:23:24,736] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 16: [2023-04-29 17:23:24,736] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 6: [2023-04-29 17:23:24,736] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 6: [2023-04-29 17:23:24,736] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 21: [2023-04-29 17:23:24,738] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 21: [2023-04-29 17:23:24,740] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 21: [2023-04-29 17:23:24,740] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 16: [2023-04-29 17:23:24,739] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 30: [2023-04-29 17:23:24,741] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 30: [2023-04-29 17:23:24,741] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 30: [2023-04-29 17:23:24,741] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 30: [2023-04-29 17:23:24,741] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 30: [2023-04-29 17:23:24,741] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 30: [2023-04-29 17:23:24,741] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 25: [2023-04-29 17:23:24,741] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 30: [2023-04-29 17:23:24,742] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 16: [2023-04-29 17:23:24,742] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 16: [2023-04-29 17:23:24,742] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 16: [2023-04-29 17:23:24,742] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 16: [2023-04-29 17:23:24,742] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 16: [2023-04-29 17:23:24,742] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 16: [2023-04-29 17:23:24,743] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 16: [2023-04-29 17:23:24,743] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 22: [2023-04-29 17:23:24,743] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 22: [2023-04-29 17:23:24,743] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 5: [2023-04-29 17:23:24,746] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 30: [2023-04-29 17:23:24,746] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 22: [2023-04-29 17:23:24,745] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 22: [2023-04-29 17:23:24,746] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 22: [2023-04-29 17:23:24,746] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 22: [2023-04-29 17:23:24,746] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 22: [2023-04-29 17:23:24,746] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 5: [2023-04-29 17:23:24,746] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 22: [2023-04-29 17:23:24,746] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 5: [2023-04-29 17:23:24,747] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 22: [2023-04-29 17:23:24,748] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 22: [2023-04-29 17:23:24,748] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 14: [2023-04-29 17:23:24,752] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 14: [2023-04-29 17:23:24,752] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 27: [2023-04-29 17:23:24,752] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 27: [2023-04-29 17:23:24,753] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 27: [2023-04-29 17:23:24,753] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 27: [2023-04-29 17:23:24,753] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 27: [2023-04-29 17:23:24,753] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 14: [2023-04-29 17:23:24,753] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 14: [2023-04-29 17:23:24,753] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 14: [2023-04-29 17:23:24,753] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 27: [2023-04-29 17:23:24,753] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 14: [2023-04-29 17:23:24,753] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 27: [2023-04-29 17:23:24,753] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 14: [2023-04-29 17:23:24,753] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 27: [2023-04-29 17:23:24,753] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 14: [2023-04-29 17:23:24,754] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 2: [2023-04-29 17:23:24,754] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 2: [2023-04-29 17:23:24,754] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 22: [2023-04-29 17:23:24,755] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 22: [2023-04-29 17:23:24,756] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 2: [2023-04-29 17:23:24,756] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 22: [2023-04-29 17:23:24,756] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 27: [2023-04-29 17:23:24,756] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 2: [2023-04-29 17:23:24,756] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 2: [2023-04-29 17:23:24,756] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 2: [2023-04-29 17:23:24,756] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 2: [2023-04-29 17:23:24,756] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 24: [2023-04-29 17:23:24,756] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 2: [2023-04-29 17:23:24,757] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 22: [2023-04-29 17:23:24,757] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 6: [2023-04-29 17:23:24,757] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 22: [2023-04-29 17:23:24,757] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 14: [2023-04-29 17:23:24,757] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 24: [2023-04-29 17:23:24,757] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 24: [2023-04-29 17:23:24,757] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 24: [2023-04-29 17:23:24,757] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 14: [2023-04-29 17:23:24,758] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 24: [2023-04-29 17:23:24,757] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 24: [2023-04-29 17:23:24,757] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 24: [2023-04-29 17:23:24,757] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 24: [2023-04-29 17:23:24,758] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 22: [2023-04-29 17:23:24,758] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 6: [2023-04-29 17:23:24,757] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 6: [2023-04-29 17:23:24,759] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 2: [2023-04-29 17:23:24,759] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 2: [2023-04-29 17:23:24,759] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 2: [2023-04-29 17:23:24,760] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 14: [2023-04-29 17:23:24,762] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 24: [2023-04-29 17:23:24,761] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 14: [2023-04-29 17:23:24,763] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 27: [2023-04-29 17:23:24,763] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 14: [2023-04-29 17:23:24,764] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 27: [2023-04-29 17:23:24,764] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 14: [2023-04-29 17:23:24,764] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 14: [2023-04-29 17:23:24,764] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 25: [2023-04-29 17:23:24,764] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 27: [2023-04-29 17:23:24,765] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 14: [2023-04-29 17:23:24,765] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 27: [2023-04-29 17:23:24,766] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 2: [2023-04-29 17:23:24,765] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 2: [2023-04-29 17:23:24,766] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 27: [2023-04-29 17:23:24,766] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 25: [2023-04-29 17:23:24,765] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 27: [2023-04-29 17:23:24,766] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 2: [2023-04-29 17:23:24,766] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 27: [2023-04-29 17:23:24,767] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 6: [2023-04-29 17:23:24,767] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 6: [2023-04-29 17:23:24,767] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 6: [2023-04-29 17:23:24,767] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 6: [2023-04-29 17:23:24,767] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 6: [2023-04-29 17:23:24,767] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 2: [2023-04-29 17:23:24,767] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 2: [2023-04-29 17:23:24,767] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 24: [2023-04-29 17:23:24,767] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 24: [2023-04-29 17:23:24,768] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 24: [2023-04-29 17:23:24,768] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 17: [2023-04-29 17:23:24,768] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 25: [2023-04-29 17:23:24,769] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 24: [2023-04-29 17:23:24,769] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 24: [2023-04-29 17:23:24,770] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 24: [2023-04-29 17:23:24,770] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 25: [2023-04-29 17:23:24,772] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 24: [2023-04-29 17:23:24,772] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 25: [2023-04-29 17:23:24,773] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 30: [2023-04-29 17:23:24,774] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 17: [2023-04-29 17:23:24,778] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 30: [2023-04-29 17:23:24,779] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 30: [2023-04-29 17:23:24,779] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 11: [2023-04-29 17:23:24,778] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 11: [2023-04-29 17:23:24,778] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 11: [2023-04-29 17:23:24,778] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 30: [2023-04-29 17:23:24,782] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 30: [2023-04-29 17:23:24,782] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 30: [2023-04-29 17:23:24,782] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 30: [2023-04-29 17:23:24,782] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 16: [2023-04-29 17:23:24,786] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 6: [2023-04-29 17:23:24,788] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 17: [2023-04-29 17:23:24,788] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 17: [2023-04-29 17:23:24,788] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 8: [2023-04-29 17:23:24,788] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 8: [2023-04-29 17:23:24,788] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 8: [2023-04-29 17:23:24,788] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 8: [2023-04-29 17:23:24,788] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 8: [2023-04-29 17:23:24,788] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 8: [2023-04-29 17:23:24,788] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 8: [2023-04-29 17:23:24,789] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 8: [2023-04-29 17:23:24,789] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 11: [2023-04-29 17:23:24,794] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 11: [2023-04-29 17:23:24,794] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 8: [2023-04-29 17:23:24,796] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 8: [2023-04-29 17:23:24,796] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 8: [2023-04-29 17:23:24,797] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 8: [2023-04-29 17:23:24,797] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 8: [2023-04-29 17:23:24,797] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 8: [2023-04-29 17:23:24,797] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 11: [2023-04-29 17:23:24,797] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 11: [2023-04-29 17:23:24,797] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 11: [2023-04-29 17:23:24,797] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 16: [2023-04-29 17:23:24,798] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 16: [2023-04-29 17:23:24,798] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 8: [2023-04-29 17:23:24,799] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 8: [2023-04-29 17:23:24,799] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 6: [2023-04-29 17:23:24,799] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 13: [2023-04-29 17:23:24,800] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 13: [2023-04-29 17:23:24,800] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 13: [2023-04-29 17:23:24,800] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 13: [2023-04-29 17:23:24,800] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 13: [2023-04-29 17:23:24,800] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 6: [2023-04-29 17:23:24,800] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 13: [2023-04-29 17:23:24,800] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 13: [2023-04-29 17:23:24,800] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 11: [2023-04-29 17:23:24,800] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 13: [2023-04-29 17:23:24,801] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 17: [2023-04-29 17:23:24,801] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 22: [2023-04-29 17:23:24,801] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 6: [2023-04-29 17:23:24,801] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 11: [2023-04-29 17:23:24,801] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 11: [2023-04-29 17:23:24,802] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 22: [2023-04-29 17:23:24,802] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 17: [2023-04-29 17:23:24,803] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 6: [2023-04-29 17:23:24,803] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 6: [2023-04-29 17:23:24,804] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 13: [2023-04-29 17:23:24,805] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 27: [2023-04-29 17:23:24,806] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 13: [2023-04-29 17:23:24,806] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 2: [2023-04-29 17:23:24,807] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 14: [2023-04-29 17:23:24,808] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 16: [2023-04-29 17:23:24,809] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 13: [2023-04-29 17:23:24,810] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 13: [2023-04-29 17:23:24,810] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 13: [2023-04-29 17:23:24,810] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 3: [2023-04-29 17:23:24,811] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 3: [2023-04-29 17:23:24,811] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 3: [2023-04-29 17:23:24,811] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 3: [2023-04-29 17:23:24,811] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 3: [2023-04-29 17:23:24,811] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 3: [2023-04-29 17:23:24,811] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 3: [2023-04-29 17:23:24,811] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 17: [2023-04-29 17:23:24,811] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 13: [2023-04-29 17:23:24,812] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 3: [2023-04-29 17:23:24,812] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 13: [2023-04-29 17:23:24,812] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 13: [2023-04-29 17:23:24,812] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 16: [2023-04-29 17:23:24,812] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 16: [2023-04-29 17:23:24,812] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 16: [2023-04-29 17:23:24,812] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 16: [2023-04-29 17:23:24,812] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 16: [2023-04-29 17:23:24,812] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 17: [2023-04-29 17:23:24,812] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 17: [2023-04-29 17:23:24,812] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 17: [2023-04-29 17:23:24,812] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 24: [2023-04-29 17:23:24,812] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 14: [2023-04-29 17:23:24,812] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 17: [2023-04-29 17:23:24,813] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 3: [2023-04-29 17:23:24,815] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 3: [2023-04-29 17:23:24,815] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 2: [2023-04-29 17:23:24,817] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 2: [2023-04-29 17:23:24,817] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 3: [2023-04-29 17:23:24,818] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 3: [2023-04-29 17:23:24,819] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 3: [2023-04-29 17:23:24,819] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 3: [2023-04-29 17:23:24,819] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 3: [2023-04-29 17:23:24,819] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 11: [2023-04-29 17:23:24,820] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 3: [2023-04-29 17:23:24,820] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 22: [2023-04-29 17:23:24,821] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 22: [2023-04-29 17:23:24,822] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 11: [2023-04-29 17:23:24,823] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 22: [2023-04-29 17:23:24,824] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 16: [2023-04-29 17:23:24,824] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 22: [2023-04-29 17:23:24,824] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 22: [2023-04-29 17:23:24,824] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 16: [2023-04-29 17:23:24,825] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 31: [2023-04-29 17:23:24,825] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 31: [2023-04-29 17:23:24,825] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 31: [2023-04-29 17:23:24,825] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 31: [2023-04-29 17:23:24,826] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 31: [2023-04-29 17:23:24,826] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 31: [2023-04-29 17:23:24,826] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 31: [2023-04-29 17:23:24,826] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 31: [2023-04-29 17:23:24,826] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 27: [2023-04-29 17:23:24,827] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 11: [2023-04-29 17:23:24,828] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 22: [2023-04-29 17:23:24,828] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 14: [2023-04-29 17:23:24,828] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 2: [2023-04-29 17:23:24,828] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 11: [2023-04-29 17:23:24,829] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 11: [2023-04-29 17:23:24,829] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 2: [2023-04-29 17:23:24,829] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 2: [2023-04-29 17:23:24,829] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 31: [2023-04-29 17:23:24,830] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 31: [2023-04-29 17:23:24,831] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 31: [2023-04-29 17:23:24,831] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 9: [2023-04-29 17:23:24,831] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 9: [2023-04-29 17:23:24,832] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 9: [2023-04-29 17:23:24,832] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 9: [2023-04-29 17:23:24,832] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 9: [2023-04-29 17:23:24,832] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 9: [2023-04-29 17:23:24,832] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 9: [2023-04-29 17:23:24,832] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 9: [2023-04-29 17:23:24,832] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 31: [2023-04-29 17:23:24,832] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 31: [2023-04-29 17:23:24,832] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 31: [2023-04-29 17:23:24,832] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 31: [2023-04-29 17:23:24,833] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 17: [2023-04-29 17:23:24,833] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 31: [2023-04-29 17:23:24,833] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 2: [2023-04-29 17:23:24,833] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 2: [2023-04-29 17:23:24,833] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 2: [2023-04-29 17:23:24,833] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 22: [2023-04-29 17:23:24,833] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 1: [2023-04-29 17:23:24,833] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 1: [2023-04-29 17:23:24,834] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 1: [2023-04-29 17:23:24,834] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 1: [2023-04-29 17:23:24,834] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 1: [2023-04-29 17:23:24,834] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 1: [2023-04-29 17:23:24,834] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 1: [2023-04-29 17:23:24,834] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 1: [2023-04-29 17:23:24,834] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 14: [2023-04-29 17:23:24,835] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 9: [2023-04-29 17:23:24,836] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 9: [2023-04-29 17:23:24,836] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 24: [2023-04-29 17:23:24,836] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 9: [2023-04-29 17:23:24,837] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 9: [2023-04-29 17:23:24,837] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 9: [2023-04-29 17:23:24,837] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 9: [2023-04-29 17:23:24,837] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 9: [2023-04-29 17:23:24,837] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 9: [2023-04-29 17:23:24,838] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 24: [2023-04-29 17:23:24,838] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 23: [2023-04-29 17:23:24,838] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 1: [2023-04-29 17:23:24,838] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 23: [2023-04-29 17:23:24,838] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 22: [2023-04-29 17:23:24,838] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 17: [2023-04-29 17:23:24,839] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 1: [2023-04-29 17:23:24,839] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 1: [2023-04-29 17:23:24,839] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 1: [2023-04-29 17:23:24,839] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 1: [2023-04-29 17:23:24,839] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 27: [2023-04-29 17:23:24,839] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 27: [2023-04-29 17:23:24,840] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 27: [2023-04-29 17:23:24,840] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 23: [2023-04-29 17:23:24,840] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 23: [2023-04-29 17:23:24,840] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 23: [2023-04-29 17:23:24,840] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 23: [2023-04-29 17:23:24,840] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 23: [2023-04-29 17:23:24,840] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 14: [2023-04-29 17:23:24,840] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 14: [2023-04-29 17:23:24,840] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 14: [2023-04-29 17:23:24,840] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 14: [2023-04-29 17:23:24,840] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 14: [2023-04-29 17:23:24,840] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 23: [2023-04-29 17:23:24,840] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 14: [2023-04-29 17:23:24,840] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 24: [2023-04-29 17:23:24,840] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 24: [2023-04-29 17:23:24,841] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 27: [2023-04-29 17:23:24,841] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 16: [2023-04-29 17:23:24,841] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 16: [2023-04-29 17:23:24,841] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 16: [2023-04-29 17:23:24,841] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 17: [2023-04-29 17:23:24,842] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 27: [2023-04-29 17:23:24,842] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 27: [2023-04-29 17:23:24,842] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 27: [2023-04-29 17:23:24,842] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 1: [2023-04-29 17:23:24,841] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 1: [2023-04-29 17:23:24,841] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 17: [2023-04-29 17:23:24,842] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 17: [2023-04-29 17:23:24,842] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 16: [2023-04-29 17:23:24,842] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 2: [2023-04-29 17:23:24,842] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 16: [2023-04-29 17:23:24,842] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 1: [2023-04-29 17:23:24,842] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 2: [2023-04-29 17:23:24,843] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 15: [2023-04-29 17:23:24,844] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 15: [2023-04-29 17:23:24,844] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 15: [2023-04-29 17:23:24,844] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 15: [2023-04-29 17:23:24,844] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 15: [2023-04-29 17:23:24,844] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 15: [2023-04-29 17:23:24,844] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 15: [2023-04-29 17:23:24,844] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 15: [2023-04-29 17:23:24,844] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 23: [2023-04-29 17:23:24,844] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 23: [2023-04-29 17:23:24,845] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 8: [2023-04-29 17:23:24,849] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 23: [2023-04-29 17:23:24,850] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 23: [2023-04-29 17:23:24,850] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 23: [2023-04-29 17:23:24,851] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 23: [2023-04-29 17:23:24,851] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 8: [2023-04-29 17:23:24,852] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 8: [2023-04-29 17:23:24,852] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 23: [2023-04-29 17:23:24,852] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 23: [2023-04-29 17:23:24,852] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 2: [2023-04-29 17:23:24,852] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 22: [2023-04-29 17:23:24,853] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 2: [2023-04-29 17:23:24,854] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 0: [2023-04-29 17:23:24,855] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 0: [2023-04-29 17:23:24,855] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 0: [2023-04-29 17:23:24,855] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 24: [2023-04-29 17:23:24,855] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 24: [2023-04-29 17:23:24,855] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 0: [2023-04-29 17:23:24,855] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 0: [2023-04-29 17:23:24,855] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 0: [2023-04-29 17:23:24,855] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 0: [2023-04-29 17:23:24,855] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 0: [2023-04-29 17:23:24,855] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 22: [2023-04-29 17:23:24,855] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 28: [2023-04-29 17:23:24,855] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 28: [2023-04-29 17:23:24,855] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 28: [2023-04-29 17:23:24,855] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 28: [2023-04-29 17:23:24,856] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 28: [2023-04-29 17:23:24,856] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 28: [2023-04-29 17:23:24,856] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 28: [2023-04-29 17:23:24,856] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 28: [2023-04-29 17:23:24,856] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 22: [2023-04-29 17:23:24,856] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 15: [2023-04-29 17:23:24,857] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 15: [2023-04-29 17:23:24,857] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 15: [2023-04-29 17:23:24,858] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 8: [2023-04-29 17:23:24,858] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 8: [2023-04-29 17:23:24,858] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 8: [2023-04-29 17:23:24,858] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 13: [2023-04-29 17:23:24,857] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 15: [2023-04-29 17:23:24,858] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 15: [2023-04-29 17:23:24,859] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 8: [2023-04-29 17:23:24,859] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 8: [2023-04-29 17:23:24,859] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 15: [2023-04-29 17:23:24,859] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 22: [2023-04-29 17:23:24,859] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 15: [2023-04-29 17:23:24,859] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 15: [2023-04-29 17:23:24,860] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 2: [2023-04-29 17:23:24,860] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 24: [2023-04-29 17:23:24,862] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 2: [2023-04-29 17:23:24,862] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 2: [2023-04-29 17:23:24,862] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 24: [2023-04-29 17:23:24,862] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 13: [2023-04-29 17:23:24,863] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 20: [2023-04-29 17:23:24,862] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 20: [2023-04-29 17:23:24,862] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 20: [2023-04-29 17:23:24,862] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 20: [2023-04-29 17:23:24,863] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 20: [2023-04-29 17:23:24,863] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 20: [2023-04-29 17:23:24,863] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 20: [2023-04-29 17:23:24,863] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 20: [2023-04-29 17:23:24,863] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 22: [2023-04-29 17:23:24,863] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 22: [2023-04-29 17:23:24,866] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 20: [2023-04-29 17:23:24,867] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 3: [2023-04-29 17:23:24,867] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 0: [2023-04-29 17:23:24,868] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 0: [2023-04-29 17:23:24,868] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 20: [2023-04-29 17:23:24,868] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 0: [2023-04-29 17:23:24,868] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 28: [2023-04-29 17:23:24,868] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 3: [2023-04-29 17:23:24,869] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 28: [2023-04-29 17:23:24,869] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 20: [2023-04-29 17:23:24,870] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 0: [2023-04-29 17:23:24,870] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 20: [2023-04-29 17:23:24,870] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 28: [2023-04-29 17:23:24,870] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 0: [2023-04-29 17:23:24,870] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 0: [2023-04-29 17:23:24,870] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 0: [2023-04-29 17:23:24,870] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 28: [2023-04-29 17:23:24,871] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 0: [2023-04-29 17:23:24,871] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 28: [2023-04-29 17:23:24,871] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 28: [2023-04-29 17:23:24,871] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 20: [2023-04-29 17:23:24,871] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 28: [2023-04-29 17:23:24,871] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 20: [2023-04-29 17:23:24,872] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 8: [2023-04-29 17:23:24,872] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 28: [2023-04-29 17:23:24,872] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 14: [2023-04-29 17:23:24,872] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 20: [2023-04-29 17:23:24,873] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 24: [2023-04-29 17:23:24,873] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 20: [2023-04-29 17:23:24,873] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 14: [2023-04-29 17:23:24,873] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 24: [2023-04-29 17:23:24,874] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 14: [2023-04-29 17:23:24,874] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 14: [2023-04-29 17:23:24,875] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 27: [2023-04-29 17:23:24,875] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 19: [2023-04-29 17:23:24,877] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 19: [2023-04-29 17:23:24,877] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 14: [2023-04-29 17:23:24,878] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 14: [2023-04-29 17:23:24,878] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 27: [2023-04-29 17:23:24,878] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 8: [2023-04-29 17:23:24,878] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 8: [2023-04-29 17:23:24,878] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 19: [2023-04-29 17:23:24,879] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 19: [2023-04-29 17:23:24,879] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 19: [2023-04-29 17:23:24,879] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 13: [2023-04-29 17:23:24,879] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 19: [2023-04-29 17:23:24,879] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 19: [2023-04-29 17:23:24,879] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 13: [2023-04-29 17:23:24,879] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 13: [2023-04-29 17:23:24,879] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 13: [2023-04-29 17:23:24,879] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 19: [2023-04-29 17:23:24,879] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 24: [2023-04-29 17:23:24,879] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 19: [2023-04-29 17:23:24,880] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 29: [2023-04-29 17:23:24,880] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 29: [2023-04-29 17:23:24,880] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 27: [2023-04-29 17:23:24,881] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 4: [2023-04-29 17:23:24,881] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 4: [2023-04-29 17:23:24,881] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 27: [2023-04-29 17:23:24,881] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 19: [2023-04-29 17:23:24,882] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 13: [2023-04-29 17:23:24,881] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 13: [2023-04-29 17:23:24,882] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 31: [2023-04-29 17:23:24,882] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 31: [2023-04-29 17:23:24,882] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 31: [2023-04-29 17:23:24,882] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 27: [2023-04-29 17:23:24,883] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 27: [2023-04-29 17:23:24,883] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 3: [2023-04-29 17:23:24,883] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 13: [2023-04-29 17:23:24,883] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 27: [2023-04-29 17:23:24,884] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 19: [2023-04-29 17:23:24,883] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 13: [2023-04-29 17:23:24,884] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 29: [2023-04-29 17:23:24,884] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 29: [2023-04-29 17:23:24,884] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 29: [2023-04-29 17:23:24,884] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 29: [2023-04-29 17:23:24,884] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 29: [2023-04-29 17:23:24,885] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 29: [2023-04-29 17:23:24,885] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 29: [2023-04-29 17:23:24,885] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 29: [2023-04-29 17:23:24,885] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 8: [2023-04-29 17:23:24,885] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 3: [2023-04-29 17:23:24,886] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 19: [2023-04-29 17:23:24,885] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 8: [2023-04-29 17:23:24,886] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 8: [2023-04-29 17:23:24,886] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 4: [2023-04-29 17:23:24,886] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 4: [2023-04-29 17:23:24,887] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 8: [2023-04-29 17:23:24,887] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 26: [2023-04-29 17:23:24,887] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 26: [2023-04-29 17:23:24,887] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 8: [2023-04-29 17:23:24,887] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 9: [2023-04-29 17:23:24,887] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 26: [2023-04-29 17:23:24,888] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 26: [2023-04-29 17:23:24,888] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 26: [2023-04-29 17:23:24,888] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 4: [2023-04-29 17:23:24,888] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 4: [2023-04-29 17:23:24,888] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 19: [2023-04-29 17:23:24,887] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 19: [2023-04-29 17:23:24,887] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 19: [2023-04-29 17:23:24,888] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 4: [2023-04-29 17:23:24,888] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 26: [2023-04-29 17:23:24,888] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 26: [2023-04-29 17:23:24,888] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 4: [2023-04-29 17:23:24,888] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 4: [2023-04-29 17:23:24,888] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 4: [2023-04-29 17:23:24,888] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 26: [2023-04-29 17:23:24,888] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 23: [2023-04-29 17:23:24,889] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 1: [2023-04-29 17:23:24,889] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 24: [2023-04-29 17:23:24,889] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 24: [2023-04-29 17:23:24,889] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 19: [2023-04-29 17:23:24,889] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 3: [2023-04-29 17:23:24,890] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 10: [2023-04-29 17:23:24,890] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 10: [2023-04-29 17:23:24,890] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 10: [2023-04-29 17:23:24,890] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 10: [2023-04-29 17:23:24,890] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 10: [2023-04-29 17:23:24,890] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 10: [2023-04-29 17:23:24,890] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 10: [2023-04-29 17:23:24,890] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 10: [2023-04-29 17:23:24,891] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 24: [2023-04-29 17:23:24,891] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 24: [2023-04-29 17:23:24,891] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 26: [2023-04-29 17:23:24,893] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 26: [2023-04-29 17:23:24,894] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 26: [2023-04-29 17:23:24,895] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 3: [2023-04-29 17:23:24,895] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 3: [2023-04-29 17:23:24,895] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 3: [2023-04-29 17:23:24,895] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 3: [2023-04-29 17:23:24,895] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 9: [2023-04-29 17:23:24,894] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 9: [2023-04-29 17:23:24,894] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 9: [2023-04-29 17:23:24,894] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 9: [2023-04-29 17:23:24,894] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 3: [2023-04-29 17:23:24,895] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 29: [2023-04-29 17:23:24,895] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 29: [2023-04-29 17:23:24,895] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 26: [2023-04-29 17:23:24,895] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 26: [2023-04-29 17:23:24,895] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 26: [2023-04-29 17:23:24,895] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 29: [2023-04-29 17:23:24,896] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 26: [2023-04-29 17:23:24,896] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 10: [2023-04-29 17:23:24,895] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 10: [2023-04-29 17:23:24,896] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 10: [2023-04-29 17:23:24,896] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 10: [2023-04-29 17:23:24,896] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 29: [2023-04-29 17:23:24,896] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 1: [2023-04-29 17:23:24,896] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 29: [2023-04-29 17:23:24,896] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 26: [2023-04-29 17:23:24,897] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 29: [2023-04-29 17:23:24,897] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 10: [2023-04-29 17:23:24,898] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 10: [2023-04-29 17:23:24,899] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 23: [2023-04-29 17:23:24,899] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 4: [2023-04-29 17:23:24,899] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 4: [2023-04-29 17:23:24,899] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 31: [2023-04-29 17:23:24,899] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 31: [2023-04-29 17:23:24,899] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 31: [2023-04-29 17:23:24,899] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 31: [2023-04-29 17:23:24,899] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 31: [2023-04-29 17:23:24,899] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 4: [2023-04-29 17:23:24,899] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 4: [2023-04-29 17:23:24,900] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 10: [2023-04-29 17:23:24,900] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 10: [2023-04-29 17:23:24,900] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 4: [2023-04-29 17:23:24,900] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 4: [2023-04-29 17:23:24,901] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 1: [2023-04-29 17:23:24,901] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 1: [2023-04-29 17:23:24,901] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 1: [2023-04-29 17:23:24,901] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 9: [2023-04-29 17:23:24,902] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 9: [2023-04-29 17:23:24,903] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 9: [2023-04-29 17:23:24,903] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 1: [2023-04-29 17:23:24,903] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 1: [2023-04-29 17:23:24,903] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 1: [2023-04-29 17:23:24,903] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 31: [2023-04-29 17:23:24,904] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 31: [2023-04-29 17:23:24,905] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 3: [2023-04-29 17:23:24,906] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 31: [2023-04-29 17:23:24,907] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 1: [2023-04-29 17:23:24,908] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 13: [2023-04-29 17:23:24,910] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 23: [2023-04-29 17:23:24,910] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 13: [2023-04-29 17:23:24,911] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 13: [2023-04-29 17:23:24,912] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 13: [2023-04-29 17:23:24,913] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 9: [2023-04-29 17:23:24,914] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 13: [2023-04-29 17:23:24,915] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 13: [2023-04-29 17:23:24,916] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 1: [2023-04-29 17:23:24,919] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 3: [2023-04-29 17:23:24,920] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 9: [2023-04-29 17:23:24,920] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 23: [2023-04-29 17:23:24,921] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 23: [2023-04-29 17:23:24,921] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 23: [2023-04-29 17:23:24,921] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 23: [2023-04-29 17:23:24,922] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 9: [2023-04-29 17:23:24,922] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 20: [2023-04-29 17:23:24,922] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 20: [2023-04-29 17:23:24,922] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 9: [2023-04-29 17:23:24,922] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 31: [2023-04-29 17:23:24,922] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 9: [2023-04-29 17:23:24,923] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 23: [2023-04-29 17:23:24,923] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 23: [2023-04-29 17:23:24,923] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 20: [2023-04-29 17:23:24,924] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 1: [2023-04-29 17:23:24,925] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 3: [2023-04-29 17:23:24,925] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 25: [2023-04-29 17:23:24,925] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 3: [2023-04-29 17:23:24,925] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 25: [2023-04-29 17:23:24,925] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 3: [2023-04-29 17:23:24,926] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 1: [2023-04-29 17:23:24,926] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 1: [2023-04-29 17:23:24,926] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 20: [2023-04-29 17:23:24,926] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 23: [2023-04-29 17:23:24,926] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 25: [2023-04-29 17:23:24,926] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 25: [2023-04-29 17:23:24,927] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 19: [2023-04-29 17:23:24,926] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 25: [2023-04-29 17:23:24,927] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 25: [2023-04-29 17:23:24,927] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 25: [2023-04-29 17:23:24,927] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 3: [2023-04-29 17:23:24,927] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 25: [2023-04-29 17:23:24,927] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 9: [2023-04-29 17:23:24,929] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 9: [2023-04-29 17:23:24,929] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 31: [2023-04-29 17:23:24,929] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 9: [2023-04-29 17:23:24,929] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 31: [2023-04-29 17:23:24,930] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 31: [2023-04-29 17:23:24,930] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 25: [2023-04-29 17:23:24,929] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 25: [2023-04-29 17:23:24,929] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 1: [2023-04-29 17:23:24,930] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 31: [2023-04-29 17:23:24,932] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 1: [2023-04-29 17:23:24,933] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 1: [2023-04-29 17:23:24,933] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 25: [2023-04-29 17:23:24,934] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 29: [2023-04-29 17:23:24,936] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 29: [2023-04-29 17:23:24,936] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 25: [2023-04-29 17:23:24,936] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 25: [2023-04-29 17:23:24,937] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 15: [2023-04-29 17:23:24,937] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 15: [2023-04-29 17:23:24,937] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 15: [2023-04-29 17:23:24,937] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 4: [2023-04-29 17:23:24,937] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 4: [2023-04-29 17:23:24,937] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 25: [2023-04-29 17:23:24,937] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 15: [2023-04-29 17:23:24,938] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 25: [2023-04-29 17:23:24,938] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 20: [2023-04-29 17:23:24,938] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 20: [2023-04-29 17:23:24,938] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 25: [2023-04-29 17:23:24,938] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 18: [2023-04-29 17:23:24,938] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 18: [2023-04-29 17:23:24,938] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 18: [2023-04-29 17:23:24,938] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 18: [2023-04-29 17:23:24,938] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 18: [2023-04-29 17:23:24,938] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 18: [2023-04-29 17:23:24,938] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 18: [2023-04-29 17:23:24,938] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 18: [2023-04-29 17:23:24,939] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 20: [2023-04-29 17:23:24,940] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 15: [2023-04-29 17:23:24,941] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 15: [2023-04-29 17:23:24,941] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 15: [2023-04-29 17:23:24,941] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 15: [2023-04-29 17:23:24,941] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 19: [2023-04-29 17:23:24,943] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 20: [2023-04-29 17:23:24,944] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 19: [2023-04-29 17:23:24,944] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 19: [2023-04-29 17:23:24,945] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 19: [2023-04-29 17:23:24,946] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 20: [2023-04-29 17:23:24,946] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 20: [2023-04-29 17:23:24,947] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 28: [2023-04-29 17:23:24,947] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 28: [2023-04-29 17:23:24,947] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 28: [2023-04-29 17:23:24,947] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 0: [2023-04-29 17:23:24,947] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 0: [2023-04-29 17:23:24,948] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 26: [2023-04-29 17:23:24,948] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 26: [2023-04-29 17:23:24,948] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 26: [2023-04-29 17:23:24,949] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 18: [2023-04-29 17:23:24,950] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 18: [2023-04-29 17:23:24,950] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 18: [2023-04-29 17:23:24,950] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 0: [2023-04-29 17:23:24,951] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 5: [2023-04-29 17:23:24,951] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 5: [2023-04-29 17:23:24,951] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 20: [2023-04-29 17:23:24,951] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 18: [2023-04-29 17:23:24,952] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 18: [2023-04-29 17:23:24,952] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 20: [2023-04-29 17:23:24,953] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 18: [2023-04-29 17:23:24,953] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 5: [2023-04-29 17:23:24,953] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 5: [2023-04-29 17:23:24,953] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 5: [2023-04-29 17:23:24,953] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 5: [2023-04-29 17:23:24,953] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 5: [2023-04-29 17:23:24,953] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 5: [2023-04-29 17:23:24,954] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 10: [2023-04-29 17:23:24,953] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 10: [2023-04-29 17:23:24,953] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 10: [2023-04-29 17:23:24,953] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 10: [2023-04-29 17:23:24,953] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 18: [2023-04-29 17:23:24,953] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 18: [2023-04-29 17:23:24,954] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt... 11: [2023-04-29 17:23:24,955] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 11: [2023-04-29 17:23:24,955] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 26: [2023-04-29 17:23:24,955] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 5: [2023-04-29 17:23:24,955] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 5: [2023-04-29 17:23:24,956] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 29: [2023-04-29 17:23:24,956] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 11: [2023-04-29 17:23:24,956] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 11: [2023-04-29 17:23:24,957] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 11: [2023-04-29 17:23:24,957] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 11: [2023-04-29 17:23:24,957] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 11: [2023-04-29 17:23:24,957] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 11: [2023-04-29 17:23:24,957] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 19: [2023-04-29 17:23:24,957] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 19: [2023-04-29 17:23:24,957] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 19: [2023-04-29 17:23:24,958] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 4: [2023-04-29 17:23:24,958] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 4: [2023-04-29 17:23:24,958] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 29: [2023-04-29 17:23:24,958] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 19: [2023-04-29 17:23:24,959] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 26: [2023-04-29 17:23:24,960] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 11: [2023-04-29 17:23:24,960] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 10: [2023-04-29 17:23:24,960] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 10: [2023-04-29 17:23:24,960] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 10: [2023-04-29 17:23:24,960] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 10: [2023-04-29 17:23:24,960] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 11: [2023-04-29 17:23:24,960] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 23: [2023-04-29 17:23:24,961] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 11: [2023-04-29 17:23:24,961] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 23: [2023-04-29 17:23:24,961] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 23: [2023-04-29 17:23:24,961] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 23: [2023-04-29 17:23:24,961] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 26: [2023-04-29 17:23:24,962] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 0: [2023-04-29 17:23:24,962] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 0: [2023-04-29 17:23:24,962] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 0: [2023-04-29 17:23:24,962] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 23: [2023-04-29 17:23:24,962] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 26: [2023-04-29 17:23:24,962] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 0: [2023-04-29 17:23:24,962] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 28: [2023-04-29 17:23:24,962] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 28: [2023-04-29 17:23:24,962] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 28: [2023-04-29 17:23:24,962] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 28: [2023-04-29 17:23:24,962] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 5: [2023-04-29 17:23:24,962] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 0: [2023-04-29 17:23:24,962] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 28: [2023-04-29 17:23:24,963] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 5: [2023-04-29 17:23:24,963] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 5: [2023-04-29 17:23:24,963] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 5: [2023-04-29 17:23:24,964] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 23: [2023-04-29 17:23:24,964] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 20: [2023-04-29 17:23:24,965] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 26: [2023-04-29 17:23:24,965] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 5: [2023-04-29 17:23:24,965] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 5: [2023-04-29 17:23:24,965] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 11: [2023-04-29 17:23:24,965] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 11: [2023-04-29 17:23:24,966] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 20: [2023-04-29 17:23:24,966] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 19: [2023-04-29 17:23:24,966] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 11: [2023-04-29 17:23:24,966] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 11: [2023-04-29 17:23:24,967] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 29: [2023-04-29 17:23:24,967] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 29: [2023-04-29 17:23:24,967] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 30: [2023-04-29 17:23:24,967] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 11: [2023-04-29 17:23:24,967] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 30: [2023-04-29 17:23:24,968] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 30: [2023-04-29 17:23:24,968] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 30: [2023-04-29 17:23:24,968] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 30: [2023-04-29 17:23:24,968] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 30: [2023-04-29 17:23:24,968] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 30: [2023-04-29 17:23:24,968] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 30: [2023-04-29 17:23:24,968] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 19: [2023-04-29 17:23:24,968] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 4: [2023-04-29 17:23:24,969] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 4: [2023-04-29 17:23:24,969] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 15: [2023-04-29 17:23:24,969] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 19: [2023-04-29 17:23:24,969] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 29: [2023-04-29 17:23:24,969] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 29: [2023-04-29 17:23:24,969] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 29: [2023-04-29 17:23:24,969] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 29: [2023-04-29 17:23:24,970] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 20: [2023-04-29 17:23:24,971] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 20: [2023-04-29 17:23:24,971] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 26: [2023-04-29 17:23:24,971] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 26: [2023-04-29 17:23:24,971] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 4: [2023-04-29 17:23:24,972] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 4: [2023-04-29 17:23:24,972] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 4: [2023-04-29 17:23:24,972] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 15: [2023-04-29 17:23:24,972] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 4: [2023-04-29 17:23:24,973] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 26: [2023-04-29 17:23:24,973] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 15: [2023-04-29 17:23:24,973] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 28: [2023-04-29 17:23:24,974] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 15: [2023-04-29 17:23:24,975] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 28: [2023-04-29 17:23:24,976] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 0: [2023-04-29 17:23:24,976] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 28: [2023-04-29 17:23:24,976] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 15: [2023-04-29 17:23:24,976] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 0: [2023-04-29 17:23:24,977] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 0: [2023-04-29 17:23:24,978] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 10: [2023-04-29 17:23:24,978] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 10: [2023-04-29 17:23:24,978] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 30: [2023-04-29 17:23:24,979] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 30: [2023-04-29 17:23:24,979] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 30: [2023-04-29 17:23:24,979] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 30: [2023-04-29 17:23:24,979] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 15: [2023-04-29 17:23:24,980] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 30: [2023-04-29 17:23:24,980] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 30: [2023-04-29 17:23:24,980] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 30: [2023-04-29 17:23:24,980] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 25: [2023-04-29 17:23:24,981] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 25: [2023-04-29 17:23:24,981] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 15: [2023-04-29 17:23:24,982] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 10: [2023-04-29 17:23:24,982] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 15: [2023-04-29 17:23:24,982] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 30: [2023-04-29 17:23:24,982] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 10: [2023-04-29 17:23:24,983] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 26: [2023-04-29 17:23:24,985] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 19: [2023-04-29 17:23:24,985] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 19: [2023-04-29 17:23:24,986] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 26: [2023-04-29 17:23:24,987] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 19: [2023-04-29 17:23:24,987] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 10: [2023-04-29 17:23:24,988] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 19: [2023-04-29 17:23:24,989] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 26: [2023-04-29 17:23:24,990] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 26: [2023-04-29 17:23:24,990] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 26: [2023-04-29 17:23:24,991] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 28: [2023-04-29 17:23:24,992] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 10: [2023-04-29 17:23:24,994] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 10: [2023-04-29 17:23:24,994] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 10: [2023-04-29 17:23:24,994] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 0: [2023-04-29 17:23:24,995] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 25: [2023-04-29 17:23:24,995] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 29: [2023-04-29 17:23:24,995] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 0: [2023-04-29 17:23:24,996] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 0: [2023-04-29 17:23:24,996] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 28: [2023-04-29 17:23:24,996] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 28: [2023-04-29 17:23:24,997] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 0: [2023-04-29 17:23:24,999] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 0: [2023-04-29 17:23:25,000] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 28: [2023-04-29 17:23:25,000] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 29: [2023-04-29 17:23:25,000] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 28: [2023-04-29 17:23:25,000] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 25: [2023-04-29 17:23:25,001] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 29: [2023-04-29 17:23:25,001] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 25: [2023-04-29 17:23:25,002] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 4: [2023-04-29 17:23:25,002] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 4: [2023-04-29 17:23:25,003] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 29: [2023-04-29 17:23:25,003] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 29: [2023-04-29 17:23:25,005] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 29: [2023-04-29 17:23:25,006] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 4: [2023-04-29 17:23:25,006] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 4: [2023-04-29 17:23:25,006] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 5: [2023-04-29 17:23:25,006] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 5: [2023-04-29 17:23:25,006] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 4: [2023-04-29 17:23:25,007] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 4: [2023-04-29 17:23:25,007] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 25: [2023-04-29 17:23:25,010] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 25: [2023-04-29 17:23:25,010] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 25: [2023-04-29 17:23:25,010] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 25: [2023-04-29 17:23:25,010] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 25: [2023-04-29 17:23:25,011] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 11: [2023-04-29 17:23:25,014] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 11: [2023-04-29 17:23:25,014] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 11: [2023-04-29 17:23:25,014] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 11: [2023-04-29 17:23:25,017] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 25: [2023-04-29 17:23:25,018] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 5: [2023-04-29 17:23:25,027] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 21: [2023-04-29 17:23:25,027] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 21: [2023-04-29 17:23:25,027] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 21: [2023-04-29 17:23:25,027] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 5: [2023-04-29 17:23:25,027] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 21: [2023-04-29 17:23:25,027] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 21: [2023-04-29 17:23:25,027] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 21: [2023-04-29 17:23:25,027] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 21: [2023-04-29 17:23:25,027] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 21: [2023-04-29 17:23:25,027] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 18: [2023-04-29 17:23:25,027] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 18: [2023-04-29 17:23:25,027] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 18: [2023-04-29 17:23:25,030] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 18: [2023-04-29 17:23:25,030] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 18: [2023-04-29 17:23:25,030] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 2: [2023-04-29 17:23:25,030] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 2: [2023-04-29 17:23:25,030] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 2: [2023-04-29 17:23:25,031] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 21: [2023-04-29 17:23:25,032] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 21: [2023-04-29 17:23:25,032] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 21: [2023-04-29 17:23:25,032] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 21: [2023-04-29 17:23:25,033] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 21: [2023-04-29 17:23:25,033] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 21: [2023-04-29 17:23:25,034] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 21: [2023-04-29 17:23:25,034] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 2: [2023-04-29 17:23:25,034] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 2: [2023-04-29 17:23:25,034] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 2: [2023-04-29 17:23:25,034] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 2: [2023-04-29 17:23:25,034] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 2: [2023-04-29 17:23:25,034] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 21: [2023-04-29 17:23:25,035] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 11: [2023-04-29 17:23:25,035] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 5: [2023-04-29 17:23:25,035] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 5: [2023-04-29 17:23:25,035] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 5: [2023-04-29 17:23:25,035] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 5: [2023-04-29 17:23:25,035] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 5: [2023-04-29 17:23:25,036] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 5: [2023-04-29 17:23:25,036] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 11: [2023-04-29 17:23:25,036] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 11: [2023-04-29 17:23:25,036] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 11: [2023-04-29 17:23:25,036] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 11: [2023-04-29 17:23:25,037] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 11: [2023-04-29 17:23:25,037] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 11: [2023-04-29 17:23:25,038] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 25: [2023-04-29 17:23:25,039] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 11: [2023-04-29 17:23:25,040] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 25: [2023-04-29 17:23:25,041] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 25: [2023-04-29 17:23:25,041] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 25: [2023-04-29 17:23:25,044] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 25: [2023-04-29 17:23:25,045] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 30: [2023-04-29 17:23:25,051] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 24: [2023-04-29 17:23:25,052] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 24: [2023-04-29 17:23:25,053] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 24: [2023-04-29 17:23:25,053] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 24: [2023-04-29 17:23:25,053] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 24: [2023-04-29 17:23:25,053] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 24: [2023-04-29 17:23:25,053] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 24: [2023-04-29 17:23:25,053] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 24: [2023-04-29 17:23:25,053] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 18: [2023-04-29 17:23:25,057] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 18: [2023-04-29 17:23:25,057] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 24: [2023-04-29 17:23:25,056] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 18: [2023-04-29 17:23:25,057] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_19-model_00-model_states.pt. 18: [2023-04-29 17:23:25,058] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 18: [2023-04-29 17:23:25,058] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 18: [2023-04-29 17:23:25,063] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 11: [2023-04-29 17:23:25,063] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 18: [2023-04-29 17:23:25,064] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 11: [2023-04-29 17:23:25,065] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 5: [2023-04-29 17:23:25,065] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 24: [2023-04-29 17:23:25,065] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 24: [2023-04-29 17:23:25,065] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 18: [2023-04-29 17:23:25,065] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 24: [2023-04-29 17:23:25,066] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 24: [2023-04-29 17:23:25,066] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 11: [2023-04-29 17:23:25,066] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 11: [2023-04-29 17:23:25,066] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 24: [2023-04-29 17:23:25,067] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 24: [2023-04-29 17:23:25,067] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 24: [2023-04-29 17:23:25,067] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 5: [2023-04-29 17:23:25,067] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 30: [2023-04-29 17:23:25,068] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 5: [2023-04-29 17:23:25,070] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 31: [2023-04-29 17:23:25,070] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 31: [2023-04-29 17:23:25,070] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 30: [2023-04-29 17:23:25,071] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 5: [2023-04-29 17:23:25,071] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 30: [2023-04-29 17:23:25,071] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 30: [2023-04-29 17:23:25,071] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 30: [2023-04-29 17:23:25,071] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 30: [2023-04-29 17:23:25,071] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 30: [2023-04-29 17:23:25,071] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 31: [2023-04-29 17:23:25,072] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 31: [2023-04-29 17:23:25,073] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 31: [2023-04-29 17:23:25,073] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 31: [2023-04-29 17:23:25,073] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 31: [2023-04-29 17:23:25,073] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 31: [2023-04-29 17:23:25,073] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 31: [2023-04-29 17:23:25,074] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 6: [2023-04-29 17:23:25,074] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 6: [2023-04-29 17:23:25,075] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 6: [2023-04-29 17:23:25,075] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 2: [2023-04-29 17:23:25,035] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 2: [2023-04-29 17:23:25,036] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 2: [2023-04-29 17:23:25,036] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 2: [2023-04-29 17:23:25,039] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 2: [2023-04-29 17:23:25,043] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 6: [2023-04-29 17:23:25,075] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 6: [2023-04-29 17:23:25,075] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 6: [2023-04-29 17:23:25,075] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 6: [2023-04-29 17:23:25,075] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 2: [2023-04-29 17:23:25,043] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 2: [2023-04-29 17:23:25,044] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 2: [2023-04-29 17:23:25,044] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 6: [2023-04-29 17:23:25,075] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 31: [2023-04-29 17:23:25,075] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 31: [2023-04-29 17:23:25,076] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 5: [2023-04-29 17:23:25,077] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 5: [2023-04-29 17:23:25,077] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 30: [2023-04-29 17:23:25,078] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 31: [2023-04-29 17:23:25,079] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 31: [2023-04-29 17:23:25,079] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 31: [2023-04-29 17:23:25,079] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 6: [2023-04-29 17:23:25,079] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 6: [2023-04-29 17:23:25,079] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 31: [2023-04-29 17:23:25,080] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 31: [2023-04-29 17:23:25,080] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 6: [2023-04-29 17:23:25,084] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 6: [2023-04-29 17:23:25,084] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 6: [2023-04-29 17:23:25,084] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 6: [2023-04-29 17:23:25,085] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 6: [2023-04-29 17:23:25,086] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 6: [2023-04-29 17:23:25,086] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 18: [2023-04-29 17:23:25,087] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 21: [2023-04-29 17:23:25,086] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 21: [2023-04-29 17:23:25,086] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 21: [2023-04-29 17:23:25,086] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 18: [2023-04-29 17:23:25,087] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 18: [2023-04-29 17:23:25,088] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 9: [2023-04-29 17:23:25,093] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 9: [2023-04-29 17:23:25,093] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 9: [2023-04-29 17:23:25,093] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 9: [2023-04-29 17:23:25,094] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 9: [2023-04-29 17:23:25,094] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 9: [2023-04-29 17:23:25,094] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 9: [2023-04-29 17:23:25,094] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 9: [2023-04-29 17:23:25,094] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 9: [2023-04-29 17:23:25,099] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 9: [2023-04-29 17:23:25,099] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 9: [2023-04-29 17:23:25,099] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 9: [2023-04-29 17:23:25,099] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 9: [2023-04-29 17:23:25,099] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 9: [2023-04-29 17:23:25,099] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 9: [2023-04-29 17:23:25,100] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 9: [2023-04-29 17:23:25,100] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 21: [2023-04-29 17:23:25,100] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 21: [2023-04-29 17:23:25,100] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 21: [2023-04-29 17:23:25,100] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 21: [2023-04-29 17:23:25,100] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 21: [2023-04-29 17:23:25,100] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 30: [2023-04-29 17:23:25,107] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 30: [2023-04-29 17:23:25,107] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 24: [2023-04-29 17:23:25,107] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 19: [2023-04-29 17:23:25,107] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 19: [2023-04-29 17:23:25,107] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 19: [2023-04-29 17:23:25,107] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 19: [2023-04-29 17:23:25,109] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 19: [2023-04-29 17:23:25,109] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 19: [2023-04-29 17:23:25,109] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 19: [2023-04-29 17:23:25,109] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 19: [2023-04-29 17:23:25,109] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 30: [2023-04-29 17:23:25,110] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 21: [2023-04-29 17:23:25,110] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 30: [2023-04-29 17:23:25,110] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 19: [2023-04-29 17:23:25,112] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 19: [2023-04-29 17:23:25,112] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 19: [2023-04-29 17:23:25,113] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 30: [2023-04-29 17:23:25,113] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 30: [2023-04-29 17:23:25,113] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 30: [2023-04-29 17:23:25,113] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 17: [2023-04-29 17:23:25,113] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 17: [2023-04-29 17:23:25,114] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 17: [2023-04-29 17:23:25,114] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 17: [2023-04-29 17:23:25,114] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 17: [2023-04-29 17:23:25,114] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 17: [2023-04-29 17:23:25,114] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 17: [2023-04-29 17:23:25,114] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 17: [2023-04-29 17:23:25,114] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 21: [2023-04-29 17:23:25,115] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 21: [2023-04-29 17:23:25,115] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 19: [2023-04-29 17:23:25,116] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 19: [2023-04-29 17:23:25,117] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 19: [2023-04-29 17:23:25,118] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 19: [2023-04-29 17:23:25,118] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 2: [2023-04-29 17:23:25,083] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 2: [2023-04-29 17:23:25,094] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 2: [2023-04-29 17:23:25,094] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 19: [2023-04-29 17:23:25,119] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 2: [2023-04-29 17:23:25,096] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 2: [2023-04-29 17:23:25,103] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 2: [2023-04-29 17:23:25,113] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 2: [2023-04-29 17:23:25,113] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 2: [2023-04-29 17:23:25,116] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 2: [2023-04-29 17:23:25,116] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 2: [2023-04-29 17:23:25,117] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 12: [2023-04-29 17:23:25,120] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 12: [2023-04-29 17:23:25,120] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 17: [2023-04-29 17:23:25,120] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 17: [2023-04-29 17:23:25,120] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 12: [2023-04-29 17:23:25,121] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 12: [2023-04-29 17:23:25,121] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 12: [2023-04-29 17:23:25,121] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 16: [2023-04-29 17:23:25,121] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 16: [2023-04-29 17:23:25,121] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 16: [2023-04-29 17:23:25,121] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 12: [2023-04-29 17:23:25,121] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 12: [2023-04-29 17:23:25,121] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 12: [2023-04-29 17:23:25,121] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 17: [2023-04-29 17:23:25,121] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 16: [2023-04-29 17:23:25,121] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 16: [2023-04-29 17:23:25,121] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 16: [2023-04-29 17:23:25,121] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 16: [2023-04-29 17:23:25,121] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 16: [2023-04-29 17:23:25,122] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 17: [2023-04-29 17:23:25,123] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 17: [2023-04-29 17:23:25,123] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 17: [2023-04-29 17:23:25,124] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 17: [2023-04-29 17:23:25,125] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 29: [2023-04-29 17:23:25,125] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 29: [2023-04-29 17:23:25,125] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 17: [2023-04-29 17:23:25,125] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 8: [2023-04-29 17:23:25,125] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 8: [2023-04-29 17:23:25,125] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 12: [2023-04-29 17:23:25,126] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 12: [2023-04-29 17:23:25,127] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 8: [2023-04-29 17:23:25,127] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 8: [2023-04-29 17:23:25,127] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 8: [2023-04-29 17:23:25,127] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 8: [2023-04-29 17:23:25,127] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 8: [2023-04-29 17:23:25,127] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 12: [2023-04-29 17:23:25,127] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 31: [2023-04-29 17:23:25,127] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 31: [2023-04-29 17:23:25,127] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 31: [2023-04-29 17:23:25,127] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 8: [2023-04-29 17:23:25,128] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 12: [2023-04-29 17:23:25,128] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 16: [2023-04-29 17:23:25,127] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 16: [2023-04-29 17:23:25,128] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 16: [2023-04-29 17:23:25,128] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 16: [2023-04-29 17:23:25,128] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 16: [2023-04-29 17:23:25,128] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 24: [2023-04-29 17:23:25,128] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 16: [2023-04-29 17:23:25,128] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 12: [2023-04-29 17:23:25,128] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 16: [2023-04-29 17:23:25,129] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 16: [2023-04-29 17:23:25,129] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 12: [2023-04-29 17:23:25,129] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 12: [2023-04-29 17:23:25,130] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 29: [2023-04-29 17:23:25,130] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 29: [2023-04-29 17:23:25,130] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 21: [2023-04-29 17:23:25,130] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 21: [2023-04-29 17:23:25,130] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 12: [2023-04-29 17:23:25,131] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 29: [2023-04-29 17:23:25,131] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 29: [2023-04-29 17:23:25,131] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 21: [2023-04-29 17:23:25,131] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 29: [2023-04-29 17:23:25,131] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 29: [2023-04-29 17:23:25,131] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 29: [2023-04-29 17:23:25,131] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 29: [2023-04-29 17:23:25,131] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 6: [2023-04-29 17:23:25,131] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 6: [2023-04-29 17:23:25,131] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 8: [2023-04-29 17:23:25,132] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 8: [2023-04-29 17:23:25,132] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 21: [2023-04-29 17:23:25,133] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 21: [2023-04-29 17:23:25,133] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 8: [2023-04-29 17:23:25,134] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 8: [2023-04-29 17:23:25,134] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 8: [2023-04-29 17:23:25,135] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 8: [2023-04-29 17:23:25,136] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 8: [2023-04-29 17:23:25,136] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 8: [2023-04-29 17:23:25,136] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 24: [2023-04-29 17:23:25,141] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 24: [2023-04-29 17:23:25,141] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 29: [2023-04-29 17:23:25,141] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 29: [2023-04-29 17:23:25,141] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 29: [2023-04-29 17:23:25,142] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 29: [2023-04-29 17:23:25,142] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 29: [2023-04-29 17:23:25,142] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 29: [2023-04-29 17:23:25,142] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 24: [2023-04-29 17:23:25,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 24: [2023-04-29 17:23:25,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 24: [2023-04-29 17:23:25,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 24: [2023-04-29 17:23:25,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 24: [2023-04-29 17:23:25,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 31: [2023-04-29 17:23:25,145] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 31: [2023-04-29 17:23:25,145] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 31: [2023-04-29 17:23:25,145] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 31: [2023-04-29 17:23:25,145] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 31: [2023-04-29 17:23:25,145] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 6: [2023-04-29 17:23:25,151] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 6: [2023-04-29 17:23:25,152] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 6: [2023-04-29 17:23:25,153] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 4: [2023-04-29 17:23:25,154] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 4: [2023-04-29 17:23:25,154] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 4: [2023-04-29 17:23:25,155] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 4: [2023-04-29 17:23:25,155] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 4: [2023-04-29 17:23:25,155] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 4: [2023-04-29 17:23:25,155] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 4: [2023-04-29 17:23:25,155] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 4: [2023-04-29 17:23:25,155] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 9: [2023-04-29 17:23:25,156] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 9: [2023-04-29 17:23:25,156] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 9: [2023-04-29 17:23:25,156] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 9: [2023-04-29 17:23:25,156] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 4: [2023-04-29 17:23:25,158] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 4: [2023-04-29 17:23:25,158] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 6: [2023-04-29 17:23:25,159] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 6: [2023-04-29 17:23:25,159] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 6: [2023-04-29 17:23:25,159] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 6: [2023-04-29 17:23:25,159] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 6: [2023-04-29 17:23:25,159] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 19: [2023-04-29 17:23:25,160] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 9: [2023-04-29 17:23:25,162] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 9: [2023-04-29 17:23:25,162] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 9: [2023-04-29 17:23:25,162] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 9: [2023-04-29 17:23:25,162] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 7: [2023-04-29 17:23:25,162] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 7: [2023-04-29 17:23:25,162] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 7: [2023-04-29 17:23:25,162] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 7: [2023-04-29 17:23:25,162] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 7: [2023-04-29 17:23:25,162] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 7: [2023-04-29 17:23:25,162] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 7: [2023-04-29 17:23:25,162] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 7: [2023-04-29 17:23:25,162] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 2: [2023-04-29 17:23:25,119] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 2: [2023-04-29 17:23:25,120] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 2: [2023-04-29 17:23:25,139] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 2: [2023-04-29 17:23:25,140] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 2: [2023-04-29 17:23:25,144] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 2: [2023-04-29 17:23:25,144] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 4: [2023-04-29 17:23:25,165] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 4: [2023-04-29 17:23:25,166] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 7: [2023-04-29 17:23:25,166] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 7: [2023-04-29 17:23:25,167] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 4: [2023-04-29 17:23:25,167] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 7: [2023-04-29 17:23:25,167] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 4: [2023-04-29 17:23:25,167] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 19: [2023-04-29 17:23:25,167] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 19: [2023-04-29 17:23:25,167] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 4: [2023-04-29 17:23:25,168] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 4: [2023-04-29 17:23:25,168] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 7: [2023-04-29 17:23:25,168] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 7: [2023-04-29 17:23:25,168] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 7: [2023-04-29 17:23:25,169] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 7: [2023-04-29 17:23:25,169] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 7: [2023-04-29 17:23:25,169] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 15: [2023-04-29 17:23:25,169] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 15: [2023-04-29 17:23:25,169] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 15: [2023-04-29 17:23:25,169] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 15: [2023-04-29 17:23:25,169] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 15: [2023-04-29 17:23:25,169] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 15: [2023-04-29 17:23:25,169] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 15: [2023-04-29 17:23:25,169] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 15: [2023-04-29 17:23:25,170] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 28: [2023-04-29 17:23:25,173] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 28: [2023-04-29 17:23:25,173] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 28: [2023-04-29 17:23:25,173] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 28: [2023-04-29 17:23:25,174] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 28: [2023-04-29 17:23:25,174] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 28: [2023-04-29 17:23:25,174] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 28: [2023-04-29 17:23:25,174] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 28: [2023-04-29 17:23:25,174] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 24: [2023-04-29 17:23:25,174] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 12: [2023-04-29 17:23:25,173] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 17: [2023-04-29 17:23:25,175] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 17: [2023-04-29 17:23:25,177] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 24: [2023-04-29 17:23:25,178] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 6: [2023-04-29 17:23:25,178] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 12: [2023-04-29 17:23:25,178] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 24: [2023-04-29 17:23:25,179] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 29: [2023-04-29 17:23:25,181] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 29: [2023-04-29 17:23:25,181] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 19: [2023-04-29 17:23:25,182] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 24: [2023-04-29 17:23:25,182] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 24: [2023-04-29 17:23:25,182] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 24: [2023-04-29 17:23:25,182] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 19: [2023-04-29 17:23:25,183] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 19: [2023-04-29 17:23:25,183] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 19: [2023-04-29 17:23:25,183] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 19: [2023-04-29 17:23:25,183] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 16: [2023-04-29 17:23:25,183] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 16: [2023-04-29 17:23:25,183] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 15: [2023-04-29 17:23:25,183] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 13: [2023-04-29 17:23:25,183] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 15: [2023-04-29 17:23:25,183] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 13: [2023-04-29 17:23:25,183] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 24: [2023-04-29 17:23:25,183] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 13: [2023-04-29 17:23:25,184] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 13: [2023-04-29 17:23:25,184] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 15: [2023-04-29 17:23:25,184] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 13: [2023-04-29 17:23:25,184] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 9: [2023-04-29 17:23:25,184] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 9: [2023-04-29 17:23:25,184] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 13: [2023-04-29 17:23:25,184] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 13: [2023-04-29 17:23:25,184] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 15: [2023-04-29 17:23:25,184] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 13: [2023-04-29 17:23:25,184] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 17: [2023-04-29 17:23:25,185] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 9: [2023-04-29 17:23:25,185] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 19: [2023-04-29 17:23:25,185] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 15: [2023-04-29 17:23:25,186] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 15: [2023-04-29 17:23:25,186] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 19: [2023-04-29 17:23:25,186] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 28: [2023-04-29 17:23:25,186] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 28: [2023-04-29 17:23:25,186] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 15: [2023-04-29 17:23:25,186] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 15: [2023-04-29 17:23:25,186] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 9: [2023-04-29 17:23:25,187] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 28: [2023-04-29 17:23:25,187] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 9: [2023-04-29 17:23:25,187] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 28: [2023-04-29 17:23:25,187] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 31: [2023-04-29 17:23:25,149] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 31: [2023-04-29 17:23:25,151] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 16: [2023-04-29 17:23:25,187] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 31: [2023-04-29 17:23:25,151] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 31: [2023-04-29 17:23:25,173] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 31: [2023-04-29 17:23:25,174] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 31: [2023-04-29 17:23:25,174] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 31: [2023-04-29 17:23:25,174] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 31: [2023-04-29 17:23:25,177] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 28: [2023-04-29 17:23:25,188] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 19: [2023-04-29 17:23:25,188] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 28: [2023-04-29 17:23:25,188] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 9: [2023-04-29 17:23:25,188] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 13: [2023-04-29 17:23:25,188] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 9: [2023-04-29 17:23:25,188] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 28: [2023-04-29 17:23:25,188] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 8: [2023-04-29 17:23:25,188] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 8: [2023-04-29 17:23:25,188] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 9: [2023-04-29 17:23:25,189] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 28: [2023-04-29 17:23:25,189] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 13: [2023-04-29 17:23:25,190] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 8: [2023-04-29 17:23:25,190] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 6: [2023-04-29 17:23:25,191] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 6: [2023-04-29 17:23:25,191] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 12: [2023-04-29 17:23:25,192] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 6: [2023-04-29 17:23:25,193] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 23: [2023-04-29 17:23:25,193] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 23: [2023-04-29 17:23:25,193] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 13: [2023-04-29 17:23:25,193] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 6: [2023-04-29 17:23:25,194] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 6: [2023-04-29 17:23:25,194] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 8: [2023-04-29 17:23:25,194] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 13: [2023-04-29 17:23:25,194] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 17: [2023-04-29 17:23:25,194] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 8: [2023-04-29 17:23:25,194] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 8: [2023-04-29 17:23:25,194] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 8: [2023-04-29 17:23:25,195] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 8: [2023-04-29 17:23:25,195] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 13: [2023-04-29 17:23:25,195] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 23: [2023-04-29 17:23:25,195] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 23: [2023-04-29 17:23:25,195] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 13: [2023-04-29 17:23:25,195] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 23: [2023-04-29 17:23:25,195] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 23: [2023-04-29 17:23:25,195] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 23: [2023-04-29 17:23:25,195] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 13: [2023-04-29 17:23:25,196] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 23: [2023-04-29 17:23:25,196] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 12: [2023-04-29 17:23:25,196] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 16: [2023-04-29 17:23:25,196] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 16: [2023-04-29 17:23:25,196] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 16: [2023-04-29 17:23:25,196] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 16: [2023-04-29 17:23:25,196] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 16: [2023-04-29 17:23:25,196] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 13: [2023-04-29 17:23:25,196] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 12: [2023-04-29 17:23:25,197] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 12: [2023-04-29 17:23:25,197] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 12: [2023-04-29 17:23:25,197] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 12: [2023-04-29 17:23:25,197] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 12: [2023-04-29 17:23:25,197] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 17: [2023-04-29 17:23:25,197] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 17: [2023-04-29 17:23:25,198] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 17: [2023-04-29 17:23:25,199] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 29: [2023-04-29 17:23:25,201] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 23: [2023-04-29 17:23:25,200] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 29: [2023-04-29 17:23:25,201] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 23: [2023-04-29 17:23:25,202] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 17: [2023-04-29 17:23:25,203] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 17: [2023-04-29 17:23:25,203] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 17: [2023-04-29 17:23:25,203] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 12: [2023-04-29 17:23:25,203] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 23: [2023-04-29 17:23:25,203] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 23: [2023-04-29 17:23:25,204] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 23: [2023-04-29 17:23:25,205] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 23: [2023-04-29 17:23:25,206] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 23: [2023-04-29 17:23:25,206] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 23: [2023-04-29 17:23:25,206] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 0: [2023-04-29 17:23:25,207] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 0: [2023-04-29 17:23:25,207] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 0: [2023-04-29 17:23:25,207] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 0: [2023-04-29 17:23:25,207] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 0: [2023-04-29 17:23:25,207] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 0: [2023-04-29 17:23:25,207] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 0: [2023-04-29 17:23:25,207] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 16: [2023-04-29 17:23:25,207] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 0: [2023-04-29 17:23:25,207] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 16: [2023-04-29 17:23:25,208] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 19: [2023-04-29 17:23:25,209] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 29: [2023-04-29 17:23:25,209] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 19: [2023-04-29 17:23:25,209] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 17: [2023-04-29 17:23:25,209] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 4: [2023-04-29 17:23:25,210] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 4: [2023-04-29 17:23:25,210] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 19: [2023-04-29 17:23:25,212] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 16: [2023-04-29 17:23:25,212] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 29: [2023-04-29 17:23:25,212] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 29: [2023-04-29 17:23:25,212] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 19: [2023-04-29 17:23:25,213] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 8: [2023-04-29 17:23:25,214] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 8: [2023-04-29 17:23:25,214] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 14: [2023-04-29 17:23:25,215] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 14: [2023-04-29 17:23:25,215] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 14: [2023-04-29 17:23:25,215] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 14: [2023-04-29 17:23:25,215] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 14: [2023-04-29 17:23:25,216] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 14: [2023-04-29 17:23:25,216] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 14: [2023-04-29 17:23:25,216] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 0: [2023-04-29 17:23:25,216] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 14: [2023-04-29 17:23:25,216] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 0: [2023-04-29 17:23:25,217] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 8: [2023-04-29 17:23:25,217] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 19: [2023-04-29 17:23:25,218] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 12: [2023-04-29 17:23:25,218] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 7: [2023-04-29 17:23:25,219] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 7: [2023-04-29 17:23:25,219] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 7: [2023-04-29 17:23:25,219] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 14: [2023-04-29 17:23:25,219] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 14: [2023-04-29 17:23:25,219] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 0: [2023-04-29 17:23:25,220] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 0: [2023-04-29 17:23:25,221] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 0: [2023-04-29 17:23:25,221] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 0: [2023-04-29 17:23:25,221] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 0: [2023-04-29 17:23:25,222] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 8: [2023-04-29 17:23:25,223] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 29: [2023-04-29 17:23:25,223] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 16: [2023-04-29 17:23:25,223] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 8: [2023-04-29 17:23:25,224] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 0: [2023-04-29 17:23:25,224] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 8: [2023-04-29 17:23:25,224] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 16: [2023-04-29 17:23:25,224] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 8: [2023-04-29 17:23:25,224] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 8: [2023-04-29 17:23:25,225] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 16: [2023-04-29 17:23:25,225] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 12: [2023-04-29 17:23:25,225] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 17: [2023-04-29 17:23:25,226] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 17: [2023-04-29 17:23:25,226] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 14: [2023-04-29 17:23:25,226] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 14: [2023-04-29 17:23:25,226] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 12: [2023-04-29 17:23:25,227] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 14: [2023-04-29 17:23:25,227] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 14: [2023-04-29 17:23:25,227] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 16: [2023-04-29 17:23:25,228] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 16: [2023-04-29 17:23:25,228] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 12: [2023-04-29 17:23:25,228] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 12: [2023-04-29 17:23:25,228] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 14: [2023-04-29 17:23:25,228] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 14: [2023-04-29 17:23:25,228] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 29: [2023-04-29 17:23:25,230] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 4: [2023-04-29 17:23:25,230] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 29: [2023-04-29 17:23:25,230] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 4: [2023-04-29 17:23:25,231] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 12: [2023-04-29 17:23:25,231] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 4: [2023-04-29 17:23:25,231] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 17: [2023-04-29 17:23:25,233] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 1: [2023-04-29 17:23:25,234] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 1: [2023-04-29 17:23:25,234] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 1: [2023-04-29 17:23:25,234] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 1: [2023-04-29 17:23:25,234] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 1: [2023-04-29 17:23:25,234] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 1: [2023-04-29 17:23:25,234] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 1: [2023-04-29 17:23:25,234] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 13: [2023-04-29 17:23:25,234] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 17: [2023-04-29 17:23:25,234] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 7: [2023-04-29 17:23:25,234] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 7: [2023-04-29 17:23:25,234] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 7: [2023-04-29 17:23:25,234] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 7: [2023-04-29 17:23:25,234] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 7: [2023-04-29 17:23:25,234] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 17: [2023-04-29 17:23:25,235] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 1: [2023-04-29 17:23:25,235] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 29: [2023-04-29 17:23:25,236] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 29: [2023-04-29 17:23:25,237] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 1: [2023-04-29 17:23:25,239] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 1: [2023-04-29 17:23:25,239] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 1: [2023-04-29 17:23:25,240] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 1: [2023-04-29 17:23:25,240] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 29: [2023-04-29 17:23:25,240] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 4: [2023-04-29 17:23:25,241] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 4: [2023-04-29 17:23:25,241] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 1: [2023-04-29 17:23:25,242] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 1: [2023-04-29 17:23:25,242] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 7: [2023-04-29 17:23:25,242] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 7: [2023-04-29 17:23:25,242] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 1: [2023-04-29 17:23:25,242] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 1: [2023-04-29 17:23:25,243] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 7: [2023-04-29 17:23:25,243] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 4: [2023-04-29 17:23:25,244] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 4: [2023-04-29 17:23:25,244] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 4: [2023-04-29 17:23:25,244] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 13: [2023-04-29 17:23:25,246] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 27: [2023-04-29 17:23:25,248] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 27: [2023-04-29 17:23:25,249] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 27: [2023-04-29 17:23:25,249] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 27: [2023-04-29 17:23:25,249] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 27: [2023-04-29 17:23:25,249] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 27: [2023-04-29 17:23:25,249] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 27: [2023-04-29 17:23:25,249] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 18: [2023-04-29 17:23:25,249] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 18: [2023-04-29 17:23:25,249] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 18: [2023-04-29 17:23:25,249] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 18: [2023-04-29 17:23:25,249] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 18: [2023-04-29 17:23:25,249] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 18: [2023-04-29 17:23:25,249] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 18: [2023-04-29 17:23:25,250] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 18: [2023-04-29 17:23:25,250] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 27: [2023-04-29 17:23:25,250] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 27: [2023-04-29 17:23:25,251] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 4: [2023-04-29 17:23:25,255] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 13: [2023-04-29 17:23:25,254] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 23: [2023-04-29 17:23:25,255] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 29: [2023-04-29 17:23:25,255] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 13: [2023-04-29 17:23:25,256] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 23: [2023-04-29 17:23:25,257] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 29: [2023-04-29 17:23:25,259] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 29: [2023-04-29 17:23:25,259] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 7: [2023-04-29 17:23:25,260] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 27: [2023-04-29 17:23:25,260] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 27: [2023-04-29 17:23:25,261] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 7: [2023-04-29 17:23:25,261] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 27: [2023-04-29 17:23:25,262] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 27: [2023-04-29 17:23:25,262] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 27: [2023-04-29 17:23:25,262] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 27: [2023-04-29 17:23:25,263] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 18: [2023-04-29 17:23:25,262] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 18: [2023-04-29 17:23:25,263] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 7: [2023-04-29 17:23:25,263] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 27: [2023-04-29 17:23:25,263] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 18: [2023-04-29 17:23:25,263] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 28: [2023-04-29 17:23:25,263] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 28: [2023-04-29 17:23:25,264] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 28: [2023-04-29 17:23:25,264] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 28: [2023-04-29 17:23:25,264] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 18: [2023-04-29 17:23:25,264] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 18: [2023-04-29 17:23:25,264] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 18: [2023-04-29 17:23:25,265] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 13: [2023-04-29 17:23:25,265] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 13: [2023-04-29 17:23:25,265] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 13: [2023-04-29 17:23:25,265] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 18: [2023-04-29 17:23:25,265] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 7: [2023-04-29 17:23:25,265] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 18: [2023-04-29 17:23:25,266] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt... 15: [2023-04-29 17:23:25,265] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 15: [2023-04-29 17:23:25,265] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 15: [2023-04-29 17:23:25,265] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 15: [2023-04-29 17:23:25,266] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 7: [2023-04-29 17:23:25,266] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 22: [2023-04-29 17:23:25,267] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 22: [2023-04-29 17:23:25,267] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 22: [2023-04-29 17:23:25,267] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 22: [2023-04-29 17:23:25,267] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 22: [2023-04-29 17:23:25,267] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 22: [2023-04-29 17:23:25,267] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 22: [2023-04-29 17:23:25,267] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 15: [2023-04-29 17:23:25,267] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 15: [2023-04-29 17:23:25,267] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 15: [2023-04-29 17:23:25,267] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 15: [2023-04-29 17:23:25,267] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 22: [2023-04-29 17:23:25,268] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 14: [2023-04-29 17:23:25,270] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 13: [2023-04-29 17:23:25,271] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 20: [2023-04-29 17:23:25,271] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 20: [2023-04-29 17:23:25,271] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 22: [2023-04-29 17:23:25,270] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 13: [2023-04-29 17:23:25,271] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 20: [2023-04-29 17:23:25,271] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 4: [2023-04-29 17:23:25,271] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 22: [2023-04-29 17:23:25,272] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 20: [2023-04-29 17:23:25,272] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 20: [2023-04-29 17:23:25,272] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 20: [2023-04-29 17:23:25,272] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 20: [2023-04-29 17:23:25,272] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 20: [2023-04-29 17:23:25,272] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 14: [2023-04-29 17:23:25,272] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 13: [2023-04-29 17:23:25,273] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 23: [2023-04-29 17:23:25,274] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 23: [2023-04-29 17:23:25,274] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 23: [2023-04-29 17:23:25,274] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 4: [2023-04-29 17:23:25,277] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 20: [2023-04-29 17:23:25,277] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 20: [2023-04-29 17:23:25,277] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 22: [2023-04-29 17:23:25,277] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 22: [2023-04-29 17:23:25,278] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 4: [2023-04-29 17:23:25,278] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 23: [2023-04-29 17:23:25,278] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 23: [2023-04-29 17:23:25,278] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 23: [2023-04-29 17:23:25,278] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 22: [2023-04-29 17:23:25,278] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 20: [2023-04-29 17:23:25,279] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 22: [2023-04-29 17:23:25,279] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 20: [2023-04-29 17:23:25,279] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 22: [2023-04-29 17:23:25,280] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 22: [2023-04-29 17:23:25,280] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 23: [2023-04-29 17:23:25,280] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 20: [2023-04-29 17:23:25,281] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 3: [2023-04-29 17:23:25,280] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 3: [2023-04-29 17:23:25,280] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 3: [2023-04-29 17:23:25,281] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 3: [2023-04-29 17:23:25,281] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 3: [2023-04-29 17:23:25,281] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 3: [2023-04-29 17:23:25,281] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 3: [2023-04-29 17:23:25,281] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 28: [2023-04-29 17:23:25,281] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 28: [2023-04-29 17:23:25,281] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 28: [2023-04-29 17:23:25,281] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 28: [2023-04-29 17:23:25,281] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 3: [2023-04-29 17:23:25,281] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 4: [2023-04-29 17:23:25,281] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 4: [2023-04-29 17:23:25,281] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 20: [2023-04-29 17:23:25,282] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 20: [2023-04-29 17:23:25,282] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 23: [2023-04-29 17:23:25,282] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 13: [2023-04-29 17:23:25,282] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 20: [2023-04-29 17:23:25,283] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 3: [2023-04-29 17:23:25,283] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 3: [2023-04-29 17:23:25,284] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 0: [2023-04-29 17:23:25,286] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 3: [2023-04-29 17:23:25,288] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 14: [2023-04-29 17:23:25,289] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 3: [2023-04-29 17:23:25,289] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 3: [2023-04-29 17:23:25,289] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 3: [2023-04-29 17:23:25,289] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 3: [2023-04-29 17:23:25,289] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 3: [2023-04-29 17:23:25,289] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 14: [2023-04-29 17:23:25,293] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 28: [2023-04-29 17:23:25,293] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 27: [2023-04-29 17:23:25,293] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 28: [2023-04-29 17:23:25,295] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 13: [2023-04-29 17:23:25,295] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 28: [2023-04-29 17:23:25,295] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 13: [2023-04-29 17:23:25,295] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 13: [2023-04-29 17:23:25,295] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 15: [2023-04-29 17:23:25,295] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 1: [2023-04-29 17:23:25,298] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 1: [2023-04-29 17:23:25,298] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 1: [2023-04-29 17:23:25,298] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 1: [2023-04-29 17:23:25,298] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 28: [2023-04-29 17:23:25,299] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 14: [2023-04-29 17:23:25,300] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 14: [2023-04-29 17:23:25,300] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 13: [2023-04-29 17:23:25,301] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 14: [2023-04-29 17:23:25,301] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 14: [2023-04-29 17:23:25,301] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 14: [2023-04-29 17:23:25,301] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 14: [2023-04-29 17:23:25,301] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 13: [2023-04-29 17:23:25,302] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 0: [2023-04-29 17:23:25,302] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 0: [2023-04-29 17:23:25,302] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 15: [2023-04-29 17:23:25,303] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 1: [2023-04-29 17:23:25,303] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 1: [2023-04-29 17:23:25,303] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 1: [2023-04-29 17:23:25,303] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 1: [2023-04-29 17:23:25,303] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 23: [2023-04-29 17:23:25,307] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 15: [2023-04-29 17:23:25,307] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 23: [2023-04-29 17:23:25,308] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 15: [2023-04-29 17:23:25,308] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 23: [2023-04-29 17:23:25,308] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 23: [2023-04-29 17:23:25,308] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 15: [2023-04-29 17:23:25,309] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 23: [2023-04-29 17:23:25,309] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 15: [2023-04-29 17:23:25,309] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 15: [2023-04-29 17:23:25,311] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 15: [2023-04-29 17:23:25,311] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 0: [2023-04-29 17:23:25,312] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 27: [2023-04-29 17:23:25,312] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 0: [2023-04-29 17:23:25,313] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 23: [2023-04-29 17:23:25,315] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 28: [2023-04-29 17:23:25,315] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 28: [2023-04-29 17:23:25,315] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 28: [2023-04-29 17:23:25,318] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 22: [2023-04-29 17:23:25,317] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 28: [2023-04-29 17:23:25,318] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 0: [2023-04-29 17:23:25,318] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 10: [2023-04-29 17:23:25,320] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 10: [2023-04-29 17:23:25,320] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 10: [2023-04-29 17:23:25,320] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 10: [2023-04-29 17:23:25,320] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 10: [2023-04-29 17:23:25,320] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 10: [2023-04-29 17:23:25,320] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 10: [2023-04-29 17:23:25,320] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 10: [2023-04-29 17:23:25,321] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 1: [2023-04-29 17:23:25,322] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 1: [2023-04-29 17:23:25,322] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 1: [2023-04-29 17:23:25,323] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 1: [2023-04-29 17:23:25,323] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 10: [2023-04-29 17:23:25,324] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 22: [2023-04-29 17:23:25,325] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 10: [2023-04-29 17:23:25,326] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 10: [2023-04-29 17:23:25,326] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 10: [2023-04-29 17:23:25,326] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 3: [2023-04-29 17:23:25,326] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 0: [2023-04-29 17:23:25,327] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 0: [2023-04-29 17:23:25,327] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 0: [2023-04-29 17:23:25,327] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 10: [2023-04-29 17:23:25,327] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 10: [2023-04-29 17:23:25,328] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 10: [2023-04-29 17:23:25,329] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 10: [2023-04-29 17:23:25,329] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 1: [2023-04-29 17:23:25,330] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 14: [2023-04-29 17:23:25,330] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 1: [2023-04-29 17:23:25,330] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 1: [2023-04-29 17:23:25,331] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 14: [2023-04-29 17:23:25,332] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 14: [2023-04-29 17:23:25,333] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 1: [2023-04-29 17:23:25,334] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 20: [2023-04-29 17:23:25,334] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 20: [2023-04-29 17:23:25,335] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 20: [2023-04-29 17:23:25,335] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 0: [2023-04-29 17:23:25,335] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 0: [2023-04-29 17:23:25,335] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 20: [2023-04-29 17:23:25,335] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 14: [2023-04-29 17:23:25,336] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 27: [2023-04-29 17:23:25,336] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 27: [2023-04-29 17:23:25,336] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 27: [2023-04-29 17:23:25,337] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 3: [2023-04-29 17:23:25,337] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 14: [2023-04-29 17:23:25,337] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 14: [2023-04-29 17:23:25,337] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 22: [2023-04-29 17:23:25,339] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 27: [2023-04-29 17:23:25,338] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 27: [2023-04-29 17:23:25,339] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 27: [2023-04-29 17:23:25,339] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 27: [2023-04-29 17:23:25,339] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 18: [2023-04-29 17:23:25,339] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 20: [2023-04-29 17:23:25,339] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 18: [2023-04-29 17:23:25,340] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 18: [2023-04-29 17:23:25,340] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 0: [2023-04-29 17:23:25,345] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 3: [2023-04-29 17:23:25,346] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 5: [2023-04-29 17:23:25,346] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 5: [2023-04-29 17:23:25,346] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 22: [2023-04-29 17:23:25,346] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 22: [2023-04-29 17:23:25,348] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 22: [2023-04-29 17:23:25,348] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 22: [2023-04-29 17:23:25,348] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 5: [2023-04-29 17:23:25,349] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 5: [2023-04-29 17:23:25,349] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 5: [2023-04-29 17:23:25,349] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 5: [2023-04-29 17:23:25,349] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 5: [2023-04-29 17:23:25,349] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 2: [2023-04-29 17:23:25,349] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 2: [2023-04-29 17:23:25,349] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 5: [2023-04-29 17:23:25,349] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 2: [2023-04-29 17:23:25,351] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 22: [2023-04-29 17:23:25,350] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 22: [2023-04-29 17:23:25,350] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 22: [2023-04-29 17:23:25,351] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 5: [2023-04-29 17:23:25,351] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 5: [2023-04-29 17:23:25,351] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 2: [2023-04-29 17:23:25,351] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 2: [2023-04-29 17:23:25,351] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 2: [2023-04-29 17:23:25,351] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 2: [2023-04-29 17:23:25,351] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 2: [2023-04-29 17:23:25,352] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 2: [2023-04-29 17:23:25,353] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 2: [2023-04-29 17:23:25,354] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 0: [2023-04-29 17:23:25,354] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 11: [2023-04-29 17:23:25,355] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 11: [2023-04-29 17:23:25,355] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 2: [2023-04-29 17:23:25,355] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 20: [2023-04-29 17:23:25,355] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 20: [2023-04-29 17:23:25,356] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 20: [2023-04-29 17:23:25,356] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 11: [2023-04-29 17:23:25,356] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 11: [2023-04-29 17:23:25,357] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 11: [2023-04-29 17:23:25,357] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 11: [2023-04-29 17:23:25,357] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 11: [2023-04-29 17:23:25,357] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 0: [2023-04-29 17:23:25,357] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 11: [2023-04-29 17:23:25,357] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 18: [2023-04-29 17:23:25,357] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 18: [2023-04-29 17:23:25,357] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 18: [2023-04-29 17:23:25,357] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 5: [2023-04-29 17:23:25,358] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 18: [2023-04-29 17:23:25,358] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 18: [2023-04-29 17:23:25,358] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_20-model_00-model_states.pt. 3: [2023-04-29 17:23:25,358] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 2: [2023-04-29 17:23:25,358] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 5: [2023-04-29 17:23:25,359] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 0: [2023-04-29 17:23:25,359] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 5: [2023-04-29 17:23:25,359] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 5: [2023-04-29 17:23:25,359] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 20: [2023-04-29 17:23:25,360] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 11: [2023-04-29 17:23:25,360] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 11: [2023-04-29 17:23:25,360] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 0: [2023-04-29 17:23:25,360] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 5: [2023-04-29 17:23:25,360] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 11: [2023-04-29 17:23:25,361] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 5: [2023-04-29 17:23:25,361] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 2: [2023-04-29 17:23:25,360] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 2: [2023-04-29 17:23:25,361] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 2: [2023-04-29 17:23:25,361] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 3: [2023-04-29 17:23:25,361] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 3: [2023-04-29 17:23:25,361] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 3: [2023-04-29 17:23:25,361] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 3: [2023-04-29 17:23:25,361] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 2: [2023-04-29 17:23:25,361] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 3: [2023-04-29 17:23:25,361] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 3: [2023-04-29 17:23:25,361] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 20: [2023-04-29 17:23:25,362] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 20: [2023-04-29 17:23:25,363] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 20: [2023-04-29 17:23:25,364] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 18: [2023-04-29 17:23:25,365] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 11: [2023-04-29 17:23:25,366] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 11: [2023-04-29 17:23:25,366] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 11: [2023-04-29 17:23:25,366] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 18: [2023-04-29 17:23:25,366] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 24: [2023-04-29 17:23:25,366] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 11: [2023-04-29 17:23:25,367] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 11: [2023-04-29 17:23:25,367] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 24: [2023-04-29 17:23:25,367] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 24: [2023-04-29 17:23:25,367] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 24: [2023-04-29 17:23:25,367] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 24: [2023-04-29 17:23:25,367] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 24: [2023-04-29 17:23:25,367] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 24: [2023-04-29 17:23:25,367] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 27: [2023-04-29 17:23:25,368] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 18: [2023-04-29 17:23:25,368] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 27: [2023-04-29 17:23:25,370] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 20: [2023-04-29 17:23:25,372] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 10: [2023-04-29 17:23:25,374] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 27: [2023-04-29 17:23:25,374] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 27: [2023-04-29 17:23:25,375] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 27: [2023-04-29 17:23:25,376] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 27: [2023-04-29 17:23:25,376] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 22: [2023-04-29 17:23:25,377] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 27: [2023-04-29 17:23:25,378] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 22: [2023-04-29 17:23:25,379] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 22: [2023-04-29 17:23:25,380] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 22: [2023-04-29 17:23:25,384] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 22: [2023-04-29 17:23:25,384] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 20: [2023-04-29 17:23:25,384] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 22: [2023-04-29 17:23:25,384] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 20: [2023-04-29 17:23:25,385] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 10: [2023-04-29 17:23:25,385] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 10: [2023-04-29 17:23:25,385] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 10: [2023-04-29 17:23:25,385] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 20: [2023-04-29 17:23:25,387] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 3: [2023-04-29 17:23:25,389] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 18: [2023-04-29 17:23:25,389] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 18: [2023-04-29 17:23:25,389] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 10: [2023-04-29 17:23:25,390] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 10: [2023-04-29 17:23:25,390] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 10: [2023-04-29 17:23:25,390] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 10: [2023-04-29 17:23:25,390] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 3: [2023-04-29 17:23:25,390] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 26: [2023-04-29 17:23:25,390] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 26: [2023-04-29 17:23:25,390] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 26: [2023-04-29 17:23:25,390] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 26: [2023-04-29 17:23:25,390] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 26: [2023-04-29 17:23:25,390] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 18: [2023-04-29 17:23:25,390] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 26: [2023-04-29 17:23:25,390] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 26: [2023-04-29 17:23:25,390] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 26: [2023-04-29 17:23:25,390] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 18: [2023-04-29 17:23:25,391] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 3: [2023-04-29 17:23:25,392] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 18: [2023-04-29 17:23:25,393] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 3: [2023-04-29 17:23:25,394] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 3: [2023-04-29 17:23:25,395] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 26: [2023-04-29 17:23:25,395] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 3: [2023-04-29 17:23:25,395] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 10: [2023-04-29 17:23:25,397] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 26: [2023-04-29 17:23:25,397] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 26: [2023-04-29 17:23:25,397] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 26: [2023-04-29 17:23:25,398] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 26: [2023-04-29 17:23:25,398] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 26: [2023-04-29 17:23:25,399] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 26: [2023-04-29 17:23:25,400] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 26: [2023-04-29 17:23:25,400] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 2: [2023-04-29 17:23:25,400] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 5: [2023-04-29 17:23:25,402] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 5: [2023-04-29 17:23:25,402] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 2: [2023-04-29 17:23:25,411] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 24: [2023-04-29 17:23:25,368] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 24: [2023-04-29 17:23:25,371] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 24: [2023-04-29 17:23:25,376] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 24: [2023-04-29 17:23:25,376] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 24: [2023-04-29 17:23:25,377] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 24: [2023-04-29 17:23:25,379] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 24: [2023-04-29 17:23:25,380] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 24: [2023-04-29 17:23:25,382] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 24: [2023-04-29 17:23:25,382] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 11: [2023-04-29 17:23:25,412] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 11: [2023-04-29 17:23:25,412] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 11: [2023-04-29 17:23:25,412] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 10: [2023-04-29 17:23:25,414] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 10: [2023-04-29 17:23:25,414] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 10: [2023-04-29 17:23:25,414] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 2: [2023-04-29 17:23:25,415] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 2: [2023-04-29 17:23:25,415] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 30: [2023-04-29 17:23:25,417] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 30: [2023-04-29 17:23:25,418] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 30: [2023-04-29 17:23:25,418] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 30: [2023-04-29 17:23:25,418] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 30: [2023-04-29 17:23:25,418] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 30: [2023-04-29 17:23:25,418] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 30: [2023-04-29 17:23:25,418] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 30: [2023-04-29 17:23:25,418] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 5: [2023-04-29 17:23:25,419] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 2: [2023-04-29 17:23:25,421] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 10: [2023-04-29 17:23:25,422] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 5: [2023-04-29 17:23:25,423] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 10: [2023-04-29 17:23:25,423] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 10: [2023-04-29 17:23:25,423] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 10: [2023-04-29 17:23:25,423] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 5: [2023-04-29 17:23:25,423] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 5: [2023-04-29 17:23:25,424] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 19: [2023-04-29 17:23:25,426] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 19: [2023-04-29 17:23:25,427] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 11: [2023-04-29 17:23:25,428] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 25: [2023-04-29 17:23:25,428] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 25: [2023-04-29 17:23:25,428] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 19: [2023-04-29 17:23:25,429] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 19: [2023-04-29 17:23:25,429] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 19: [2023-04-29 17:23:25,429] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 19: [2023-04-29 17:23:25,429] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 19: [2023-04-29 17:23:25,429] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 30: [2023-04-29 17:23:25,429] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 30: [2023-04-29 17:23:25,429] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 19: [2023-04-29 17:23:25,430] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 30: [2023-04-29 17:23:25,430] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 19: [2023-04-29 17:23:25,430] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 30: [2023-04-29 17:23:25,430] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 30: [2023-04-29 17:23:25,430] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 11: [2023-04-29 17:23:25,430] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 11: [2023-04-29 17:23:25,430] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 30: [2023-04-29 17:23:25,430] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 11: [2023-04-29 17:23:25,431] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 11: [2023-04-29 17:23:25,431] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 30: [2023-04-29 17:23:25,431] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 2: [2023-04-29 17:23:25,431] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 19: [2023-04-29 17:23:25,431] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 2: [2023-04-29 17:23:25,432] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 2: [2023-04-29 17:23:25,432] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 2: [2023-04-29 17:23:25,432] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 30: [2023-04-29 17:23:25,432] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 25: [2023-04-29 17:23:25,432] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 25: [2023-04-29 17:23:25,432] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 25: [2023-04-29 17:23:25,433] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 25: [2023-04-29 17:23:25,433] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 25: [2023-04-29 17:23:25,433] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 25: [2023-04-29 17:23:25,433] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 25: [2023-04-29 17:23:25,433] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 25: [2023-04-29 17:23:25,433] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 19: [2023-04-29 17:23:25,433] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 11: [2023-04-29 17:23:25,434] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 11: [2023-04-29 17:23:25,435] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 2: [2023-04-29 17:23:25,435] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 11: [2023-04-29 17:23:25,435] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 5: [2023-04-29 17:23:25,437] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 19: [2023-04-29 17:23:25,437] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 19: [2023-04-29 17:23:25,437] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 5: [2023-04-29 17:23:25,438] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 5: [2023-04-29 17:23:25,438] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 5: [2023-04-29 17:23:25,438] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 19: [2023-04-29 17:23:25,438] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 2: [2023-04-29 17:23:25,438] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 19: [2023-04-29 17:23:25,438] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 19: [2023-04-29 17:23:25,439] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 2: [2023-04-29 17:23:25,440] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 26: [2023-04-29 17:23:25,441] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 5: [2023-04-29 17:23:25,442] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 25: [2023-04-29 17:23:25,443] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 25: [2023-04-29 17:23:25,444] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 25: [2023-04-29 17:23:25,444] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 25: [2023-04-29 17:23:25,444] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 25: [2023-04-29 17:23:25,445] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 25: [2023-04-29 17:23:25,445] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 11: [2023-04-29 17:23:25,454] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 24: [2023-04-29 17:23:25,422] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 24: [2023-04-29 17:23:25,444] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 24: [2023-04-29 17:23:25,448] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 24: [2023-04-29 17:23:25,448] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 24: [2023-04-29 17:23:25,454] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 5: [2023-04-29 17:23:25,457] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 11: [2023-04-29 17:23:25,457] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 26: [2023-04-29 17:23:25,457] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 2: [2023-04-29 17:23:25,458] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 2: [2023-04-29 17:23:25,459] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 24: [2023-04-29 17:23:25,460] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 26: [2023-04-29 17:23:25,460] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 24: [2023-04-29 17:23:25,460] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 2: [2023-04-29 17:23:25,461] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 2: [2023-04-29 17:23:25,461] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 26: [2023-04-29 17:23:25,461] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 11: [2023-04-29 17:23:25,462] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 26: [2023-04-29 17:23:25,462] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 11: [2023-04-29 17:23:25,463] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 11: [2023-04-29 17:23:25,463] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 26: [2023-04-29 17:23:25,464] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 26: [2023-04-29 17:23:25,464] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 26: [2023-04-29 17:23:25,464] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 26: [2023-04-29 17:23:25,464] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 24: [2023-04-29 17:23:25,470] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 5: [2023-04-29 17:23:25,471] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 5: [2023-04-29 17:23:25,472] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 5: [2023-04-29 17:23:25,473] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 5: [2023-04-29 17:23:25,474] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 24: [2023-04-29 17:23:25,474] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 24: [2023-04-29 17:23:25,476] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 19: [2023-04-29 17:23:25,477] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 24: [2023-04-29 17:23:25,478] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 25: [2023-04-29 17:23:25,483] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 25: [2023-04-29 17:23:25,483] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 24: [2023-04-29 17:23:25,484] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 26: [2023-04-29 17:23:25,488] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 26: [2023-04-29 17:23:25,488] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 26: [2023-04-29 17:23:25,488] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 24: [2023-04-29 17:23:25,490] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 26: [2023-04-29 17:23:25,491] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 26: [2023-04-29 17:23:25,491] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 24: [2023-04-29 17:23:25,492] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 19: [2023-04-29 17:23:25,492] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 19: [2023-04-29 17:23:25,492] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 31: [2023-04-29 17:23:25,492] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 31: [2023-04-29 17:23:25,492] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 31: [2023-04-29 17:23:25,492] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 31: [2023-04-29 17:23:25,493] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 31: [2023-04-29 17:23:25,493] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 31: [2023-04-29 17:23:25,493] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 31: [2023-04-29 17:23:25,493] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 31: [2023-04-29 17:23:25,493] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 26: [2023-04-29 17:23:25,494] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 26: [2023-04-29 17:23:25,494] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 19: [2023-04-29 17:23:25,497] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 31: [2023-04-29 17:23:25,497] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 31: [2023-04-29 17:23:25,497] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 19: [2023-04-29 17:23:25,497] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 29: [2023-04-29 17:23:25,498] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 29: [2023-04-29 17:23:25,498] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 24: [2023-04-29 17:23:25,498] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 31: [2023-04-29 17:23:25,499] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 31: [2023-04-29 17:23:25,499] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 31: [2023-04-29 17:23:25,499] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 31: [2023-04-29 17:23:25,500] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 31: [2023-04-29 17:23:25,500] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 31: [2023-04-29 17:23:25,500] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 29: [2023-04-29 17:23:25,502] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 29: [2023-04-29 17:23:25,502] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 29: [2023-04-29 17:23:25,502] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 29: [2023-04-29 17:23:25,502] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 29: [2023-04-29 17:23:25,502] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 29: [2023-04-29 17:23:25,502] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 29: [2023-04-29 17:23:25,502] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 29: [2023-04-29 17:23:25,503] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 30: [2023-04-29 17:23:25,503] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 25: [2023-04-29 17:23:25,504] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 25: [2023-04-29 17:23:25,504] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 24: [2023-04-29 17:23:25,505] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 19: [2023-04-29 17:23:25,509] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 19: [2023-04-29 17:23:25,509] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 19: [2023-04-29 17:23:25,509] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 19: [2023-04-29 17:23:25,509] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 4: [2023-04-29 17:23:25,510] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 4: [2023-04-29 17:23:25,510] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 4: [2023-04-29 17:23:25,511] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 4: [2023-04-29 17:23:25,511] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 4: [2023-04-29 17:23:25,511] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 4: [2023-04-29 17:23:25,511] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 4: [2023-04-29 17:23:25,511] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 4: [2023-04-29 17:23:25,511] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 25: [2023-04-29 17:23:25,511] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 25: [2023-04-29 17:23:25,512] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 29: [2023-04-29 17:23:25,512] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 29: [2023-04-29 17:23:25,513] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 29: [2023-04-29 17:23:25,513] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 29: [2023-04-29 17:23:25,513] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 19: [2023-04-29 17:23:25,513] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 29: [2023-04-29 17:23:25,514] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 4: [2023-04-29 17:23:25,513] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 25: [2023-04-29 17:23:25,514] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 25: [2023-04-29 17:23:25,514] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 29: [2023-04-29 17:23:25,514] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 4: [2023-04-29 17:23:25,514] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 25: [2023-04-29 17:23:25,515] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 25: [2023-04-29 17:23:25,517] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 30: [2023-04-29 17:23:25,517] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 19: [2023-04-29 17:23:25,518] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 4: [2023-04-29 17:23:25,521] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 4: [2023-04-29 17:23:25,522] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 4: [2023-04-29 17:23:25,522] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 4: [2023-04-29 17:23:25,522] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 30: [2023-04-29 17:23:25,522] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 30: [2023-04-29 17:23:25,522] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 30: [2023-04-29 17:23:25,522] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 30: [2023-04-29 17:23:25,522] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 30: [2023-04-29 17:23:25,522] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 30: [2023-04-29 17:23:25,523] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 4: [2023-04-29 17:23:25,523] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 4: [2023-04-29 17:23:25,524] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 19: [2023-04-29 17:23:25,527] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 30: [2023-04-29 17:23:25,527] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 28: [2023-04-29 17:23:25,527] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 28: [2023-04-29 17:23:25,527] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 28: [2023-04-29 17:23:25,527] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 28: [2023-04-29 17:23:25,528] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 28: [2023-04-29 17:23:25,528] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 28: [2023-04-29 17:23:25,528] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 28: [2023-04-29 17:23:25,528] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 28: [2023-04-29 17:23:25,528] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 28: [2023-04-29 17:23:25,540] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 28: [2023-04-29 17:23:25,541] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 9: [2023-04-29 17:23:25,542] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 9: [2023-04-29 17:23:25,542] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 9: [2023-04-29 17:23:25,542] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 9: [2023-04-29 17:23:25,542] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 9: [2023-04-29 17:23:25,542] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 9: [2023-04-29 17:23:25,542] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 9: [2023-04-29 17:23:25,542] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 28: [2023-04-29 17:23:25,542] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 25: [2023-04-29 17:23:25,542] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 9: [2023-04-29 17:23:25,542] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 19: [2023-04-29 17:23:25,543] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 28: [2023-04-29 17:23:25,543] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 28: [2023-04-29 17:23:25,543] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 28: [2023-04-29 17:23:25,543] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 28: [2023-04-29 17:23:25,544] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 19: [2023-04-29 17:23:25,544] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 28: [2023-04-29 17:23:25,544] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 25: [2023-04-29 17:23:25,544] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 19: [2023-04-29 17:23:25,545] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 19: [2023-04-29 17:23:25,545] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 25: [2023-04-29 17:23:25,546] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 15: [2023-04-29 17:23:25,546] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 15: [2023-04-29 17:23:25,546] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 15: [2023-04-29 17:23:25,546] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 15: [2023-04-29 17:23:25,546] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 15: [2023-04-29 17:23:25,546] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 15: [2023-04-29 17:23:25,546] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 15: [2023-04-29 17:23:25,546] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 15: [2023-04-29 17:23:25,547] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 9: [2023-04-29 17:23:25,547] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 9: [2023-04-29 17:23:25,547] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 9: [2023-04-29 17:23:25,547] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 9: [2023-04-29 17:23:25,547] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 9: [2023-04-29 17:23:25,547] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 9: [2023-04-29 17:23:25,548] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 25: [2023-04-29 17:23:25,548] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 25: [2023-04-29 17:23:25,548] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 9: [2023-04-29 17:23:25,548] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 9: [2023-04-29 17:23:25,548] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 25: [2023-04-29 17:23:25,549] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 31: [2023-04-29 17:23:25,550] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 31: [2023-04-29 17:23:25,550] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 31: [2023-04-29 17:23:25,550] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 30: [2023-04-29 17:23:25,552] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 30: [2023-04-29 17:23:25,554] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 29: [2023-04-29 17:23:25,554] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 29: [2023-04-29 17:23:25,554] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 15: [2023-04-29 17:23:25,556] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 30: [2023-04-29 17:23:25,558] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 30: [2023-04-29 17:23:25,559] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 15: [2023-04-29 17:23:25,560] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 15: [2023-04-29 17:23:25,560] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 15: [2023-04-29 17:23:25,560] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 30: [2023-04-29 17:23:25,560] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 15: [2023-04-29 17:23:25,561] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 15: [2023-04-29 17:23:25,561] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 15: [2023-04-29 17:23:25,562] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 23: [2023-04-29 17:23:25,562] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 15: [2023-04-29 17:23:25,562] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 23: [2023-04-29 17:23:25,562] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 23: [2023-04-29 17:23:25,564] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 23: [2023-04-29 17:23:25,564] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 23: [2023-04-29 17:23:25,564] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 4: [2023-04-29 17:23:25,564] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 4: [2023-04-29 17:23:25,564] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 23: [2023-04-29 17:23:25,565] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 23: [2023-04-29 17:23:25,565] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 30: [2023-04-29 17:23:25,565] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 23: [2023-04-29 17:23:25,565] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 30: [2023-04-29 17:23:25,565] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 31: [2023-04-29 17:23:25,566] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 31: [2023-04-29 17:23:25,566] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 31: [2023-04-29 17:23:25,566] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 31: [2023-04-29 17:23:25,566] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 31: [2023-04-29 17:23:25,566] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 23: [2023-04-29 17:23:25,569] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 23: [2023-04-29 17:23:25,570] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 23: [2023-04-29 17:23:25,572] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 23: [2023-04-29 17:23:25,572] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 23: [2023-04-29 17:23:25,573] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 31: [2023-04-29 17:23:25,573] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 31: [2023-04-29 17:23:25,573] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 29: [2023-04-29 17:23:25,574] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 23: [2023-04-29 17:23:25,574] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 29: [2023-04-29 17:23:25,574] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 23: [2023-04-29 17:23:25,574] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 23: [2023-04-29 17:23:25,575] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 0: [2023-04-29 17:23:25,575] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 0: [2023-04-29 17:23:25,575] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 0: [2023-04-29 17:23:25,575] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 0: [2023-04-29 17:23:25,575] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 0: [2023-04-29 17:23:25,575] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 0: [2023-04-29 17:23:25,575] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 0: [2023-04-29 17:23:25,575] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 31: [2023-04-29 17:23:25,575] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 0: [2023-04-29 17:23:25,576] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 8: [2023-04-29 17:23:25,578] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 8: [2023-04-29 17:23:25,578] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 8: [2023-04-29 17:23:25,579] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 29: [2023-04-29 17:23:25,579] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 8: [2023-04-29 17:23:25,579] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 8: [2023-04-29 17:23:25,579] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 8: [2023-04-29 17:23:25,579] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 8: [2023-04-29 17:23:25,579] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 8: [2023-04-29 17:23:25,580] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 8: [2023-04-29 17:23:25,584] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 8: [2023-04-29 17:23:25,585] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 29: [2023-04-29 17:23:25,584] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 29: [2023-04-29 17:23:25,585] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 4: [2023-04-29 17:23:25,585] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 8: [2023-04-29 17:23:25,586] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 8: [2023-04-29 17:23:25,586] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 8: [2023-04-29 17:23:25,587] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 4: [2023-04-29 17:23:25,587] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 8: [2023-04-29 17:23:25,587] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 8: [2023-04-29 17:23:25,587] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 8: [2023-04-29 17:23:25,588] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 0: [2023-04-29 17:23:25,589] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 0: [2023-04-29 17:23:25,589] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 0: [2023-04-29 17:23:25,589] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 0: [2023-04-29 17:23:25,590] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 0: [2023-04-29 17:23:25,590] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 0: [2023-04-29 17:23:25,590] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 0: [2023-04-29 17:23:25,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 4: [2023-04-29 17:23:25,591] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 4: [2023-04-29 17:23:25,591] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 0: [2023-04-29 17:23:25,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 29: [2023-04-29 17:23:25,593] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 29: [2023-04-29 17:23:25,593] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 29: [2023-04-29 17:23:25,593] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 31: [2023-04-29 17:23:25,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 31: [2023-04-29 17:23:25,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 4: [2023-04-29 17:23:25,596] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 4: [2023-04-29 17:23:25,596] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 4: [2023-04-29 17:23:25,596] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 4: [2023-04-29 17:23:25,596] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 31: [2023-04-29 17:23:25,598] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 31: [2023-04-29 17:23:25,598] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 31: [2023-04-29 17:23:25,598] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 9: [2023-04-29 17:23:25,606] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 9: [2023-04-29 17:23:25,606] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 9: [2023-04-29 17:23:25,606] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 9: [2023-04-29 17:23:25,606] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 29: [2023-04-29 17:23:25,606] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 9: [2023-04-29 17:23:25,609] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 9: [2023-04-29 17:23:25,609] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 9: [2023-04-29 17:23:25,609] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 9: [2023-04-29 17:23:25,609] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 29: [2023-04-29 17:23:25,612] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 29: [2023-04-29 17:23:25,615] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 23: [2023-04-29 17:23:25,615] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 18: [2023-04-29 17:23:25,616] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 18: [2023-04-29 17:23:25,616] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 18: [2023-04-29 17:23:25,616] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 18: [2023-04-29 17:23:25,617] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 18: [2023-04-29 17:23:25,617] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 18: [2023-04-29 17:23:25,617] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 18: [2023-04-29 17:23:25,617] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 18: [2023-04-29 17:23:25,617] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 28: [2023-04-29 17:23:25,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 28: [2023-04-29 17:23:25,619] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 28: [2023-04-29 17:23:25,619] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 4: [2023-04-29 17:23:25,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 29: [2023-04-29 17:23:25,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 4: [2023-04-29 17:23:25,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 29: [2023-04-29 17:23:25,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 29: [2023-04-29 17:23:25,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 18: [2023-04-29 17:23:25,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 18: [2023-04-29 17:23:25,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 23: [2023-04-29 17:23:25,629] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 18: [2023-04-29 17:23:25,628] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 4: [2023-04-29 17:23:25,630] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 9: [2023-04-29 17:23:25,631] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 18: [2023-04-29 17:23:25,631] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 18: [2023-04-29 17:23:25,631] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 18: [2023-04-29 17:23:25,632] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 9: [2023-04-29 17:23:25,632] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 18: [2023-04-29 17:23:25,632] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 4: [2023-04-29 17:23:25,632] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 4: [2023-04-29 17:23:25,633] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 4: [2023-04-29 17:23:25,633] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 18: [2023-04-29 17:23:25,633] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt... 9: [2023-04-29 17:23:25,634] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 9: [2023-04-29 17:23:25,634] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 9: [2023-04-29 17:23:25,634] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 9: [2023-04-29 17:23:25,635] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 9: [2023-04-29 17:23:25,636] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 28: [2023-04-29 17:23:25,635] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 28: [2023-04-29 17:23:25,635] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 28: [2023-04-29 17:23:25,635] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 28: [2023-04-29 17:23:25,636] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 28: [2023-04-29 17:23:25,636] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 23: [2023-04-29 17:23:25,636] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 9: [2023-04-29 17:23:25,637] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 15: [2023-04-29 17:23:25,638] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 23: [2023-04-29 17:23:25,640] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 8: [2023-04-29 17:23:25,639] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 15: [2023-04-29 17:23:25,640] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 15: [2023-04-29 17:23:25,640] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 15: [2023-04-29 17:23:25,640] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 8: [2023-04-29 17:23:25,642] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 8: [2023-04-29 17:23:25,642] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 15: [2023-04-29 17:23:25,643] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 15: [2023-04-29 17:23:25,643] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 8: [2023-04-29 17:23:25,643] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 28: [2023-04-29 17:23:25,643] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 15: [2023-04-29 17:23:25,643] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 15: [2023-04-29 17:23:25,643] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 8: [2023-04-29 17:23:25,645] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 8: [2023-04-29 17:23:25,645] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 23: [2023-04-29 17:23:25,646] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 23: [2023-04-29 17:23:25,646] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 23: [2023-04-29 17:23:25,646] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 28: [2023-04-29 17:23:25,647] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 28: [2023-04-29 17:23:25,647] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 23: [2023-04-29 17:23:25,651] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 23: [2023-04-29 17:23:25,651] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 8: [2023-04-29 17:23:25,654] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 23: [2023-04-29 17:23:25,654] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 8: [2023-04-29 17:23:25,654] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 0: [2023-04-29 17:23:25,660] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 0: [2023-04-29 17:23:25,660] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 23: [2023-04-29 17:23:25,664] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 8: [2023-04-29 17:23:25,666] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 28: [2023-04-29 17:23:25,667] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 28: [2023-04-29 17:23:25,670] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 28: [2023-04-29 17:23:25,670] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 8: [2023-04-29 17:23:25,670] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 15: [2023-04-29 17:23:25,671] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 8: [2023-04-29 17:23:25,671] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 28: [2023-04-29 17:23:25,672] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 28: [2023-04-29 17:23:25,673] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 8: [2023-04-29 17:23:25,675] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 8: [2023-04-29 17:23:25,675] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 23: [2023-04-29 17:23:25,678] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 0: [2023-04-29 17:23:25,678] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 15: [2023-04-29 17:23:25,679] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 8: [2023-04-29 17:23:25,679] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 23: [2023-04-29 17:23:25,679] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 23: [2023-04-29 17:23:25,680] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 15: [2023-04-29 17:23:25,681] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 23: [2023-04-29 17:23:25,682] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 15: [2023-04-29 17:23:25,682] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 15: [2023-04-29 17:23:25,683] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 15: [2023-04-29 17:23:25,684] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 6: [2023-04-29 17:23:25,684] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 6: [2023-04-29 17:23:25,684] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 6: [2023-04-29 17:23:25,684] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 6: [2023-04-29 17:23:25,685] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 6: [2023-04-29 17:23:25,685] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 6: [2023-04-29 17:23:25,685] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 6: [2023-04-29 17:23:25,685] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 6: [2023-04-29 17:23:25,685] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 8: [2023-04-29 17:23:25,685] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 8: [2023-04-29 17:23:25,685] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 15: [2023-04-29 17:23:25,685] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 15: [2023-04-29 17:23:25,685] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 23: [2023-04-29 17:23:25,688] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 0: [2023-04-29 17:23:25,688] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 27: [2023-04-29 17:23:25,688] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 0: [2023-04-29 17:23:25,688] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 0: [2023-04-29 17:23:25,688] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 27: [2023-04-29 17:23:25,688] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 27: [2023-04-29 17:23:25,688] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 27: [2023-04-29 17:23:25,688] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 27: [2023-04-29 17:23:25,688] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 27: [2023-04-29 17:23:25,689] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 27: [2023-04-29 17:23:25,689] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 27: [2023-04-29 17:23:25,689] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 6: [2023-04-29 17:23:25,689] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 6: [2023-04-29 17:23:25,689] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 0: [2023-04-29 17:23:25,691] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 0: [2023-04-29 17:23:25,691] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 0: [2023-04-29 17:23:25,691] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 0: [2023-04-29 17:23:25,691] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 27: [2023-04-29 17:23:25,691] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 18: [2023-04-29 17:23:25,693] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 18: [2023-04-29 17:23:25,693] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 6: [2023-04-29 17:23:25,694] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 6: [2023-04-29 17:23:25,695] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 6: [2023-04-29 17:23:25,695] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 6: [2023-04-29 17:23:25,695] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 6: [2023-04-29 17:23:25,696] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 6: [2023-04-29 17:23:25,696] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 27: [2023-04-29 17:23:25,700] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 27: [2023-04-29 17:23:25,700] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 0: [2023-04-29 17:23:25,702] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 27: [2023-04-29 17:23:25,702] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 27: [2023-04-29 17:23:25,702] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 27: [2023-04-29 17:23:25,702] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 27: [2023-04-29 17:23:25,703] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 27: [2023-04-29 17:23:25,703] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 18: [2023-04-29 17:23:25,711] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 20: [2023-04-29 17:23:25,714] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 20: [2023-04-29 17:23:25,714] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 20: [2023-04-29 17:23:25,715] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 20: [2023-04-29 17:23:25,716] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 20: [2023-04-29 17:23:25,716] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 20: [2023-04-29 17:23:25,716] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 20: [2023-04-29 17:23:25,716] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 20: [2023-04-29 17:23:25,716] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 18: [2023-04-29 17:23:25,720] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 18: [2023-04-29 17:23:25,720] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 20: [2023-04-29 17:23:25,720] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 20: [2023-04-29 17:23:25,721] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 0: [2023-04-29 17:23:25,721] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 20: [2023-04-29 17:23:25,722] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 18: [2023-04-29 17:23:25,722] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 20: [2023-04-29 17:23:25,725] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 20: [2023-04-29 17:23:25,726] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 0: [2023-04-29 17:23:25,726] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 0: [2023-04-29 17:23:25,726] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 0: [2023-04-29 17:23:25,726] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 0: [2023-04-29 17:23:25,726] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 20: [2023-04-29 17:23:25,726] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 20: [2023-04-29 17:23:25,727] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 20: [2023-04-29 17:23:25,727] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 21: [2023-04-29 17:23:25,727] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 21: [2023-04-29 17:23:25,727] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 21: [2023-04-29 17:23:25,727] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 21: [2023-04-29 17:23:25,728] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 21: [2023-04-29 17:23:25,728] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 21: [2023-04-29 17:23:25,728] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 21: [2023-04-29 17:23:25,728] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 21: [2023-04-29 17:23:25,728] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 18: [2023-04-29 17:23:25,729] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 18: [2023-04-29 17:23:25,729] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 18: [2023-04-29 17:23:25,729] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 18: [2023-04-29 17:23:25,729] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_21-model_00-model_states.pt. 21: [2023-04-29 17:23:25,732] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 21: [2023-04-29 17:23:25,733] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 21: [2023-04-29 17:23:25,733] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 16: [2023-04-29 17:23:25,733] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 16: [2023-04-29 17:23:25,733] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 16: [2023-04-29 17:23:25,733] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 21: [2023-04-29 17:23:25,734] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 16: [2023-04-29 17:23:25,734] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 16: [2023-04-29 17:23:25,734] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 16: [2023-04-29 17:23:25,734] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 16: [2023-04-29 17:23:25,734] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 21: [2023-04-29 17:23:25,734] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 16: [2023-04-29 17:23:25,734] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 21: [2023-04-29 17:23:25,734] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 21: [2023-04-29 17:23:25,735] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 21: [2023-04-29 17:23:25,735] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 16: [2023-04-29 17:23:25,738] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 16: [2023-04-29 17:23:25,740] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 16: [2023-04-29 17:23:25,740] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 16: [2023-04-29 17:23:25,740] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 6: [2023-04-29 17:23:25,740] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 18: [2023-04-29 17:23:25,740] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 16: [2023-04-29 17:23:25,740] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 16: [2023-04-29 17:23:25,741] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 16: [2023-04-29 17:23:25,741] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 16: [2023-04-29 17:23:25,741] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 6: [2023-04-29 17:23:25,741] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 27: [2023-04-29 17:23:25,742] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 26: [2023-04-29 17:23:25,746] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 26: [2023-04-29 17:23:25,746] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 26: [2023-04-29 17:23:25,746] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 26: [2023-04-29 17:23:25,746] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 26: [2023-04-29 17:23:25,746] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 26: [2023-04-29 17:23:25,746] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 26: [2023-04-29 17:23:25,746] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 24: [2023-04-29 17:23:25,746] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 26: [2023-04-29 17:23:25,746] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 24: [2023-04-29 17:23:25,747] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 24: [2023-04-29 17:23:25,747] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 24: [2023-04-29 17:23:25,747] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 24: [2023-04-29 17:23:25,747] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 24: [2023-04-29 17:23:25,747] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 24: [2023-04-29 17:23:25,747] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 24: [2023-04-29 17:23:25,748] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 24: [2023-04-29 17:23:25,750] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 26: [2023-04-29 17:23:25,752] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 26: [2023-04-29 17:23:25,752] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 26: [2023-04-29 17:23:25,754] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 18: [2023-04-29 17:23:25,754] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 26: [2023-04-29 17:23:25,754] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 26: [2023-04-29 17:23:25,754] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 26: [2023-04-29 17:23:25,754] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 26: [2023-04-29 17:23:25,755] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 26: [2023-04-29 17:23:25,756] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 24: [2023-04-29 17:23:25,756] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 24: [2023-04-29 17:23:25,758] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 24: [2023-04-29 17:23:25,759] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 24: [2023-04-29 17:23:25,759] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 24: [2023-04-29 17:23:25,759] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 27: [2023-04-29 17:23:25,760] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 24: [2023-04-29 17:23:25,760] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 24: [2023-04-29 17:23:25,760] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 6: [2023-04-29 17:23:25,761] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 18: [2023-04-29 17:23:25,761] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 6: [2023-04-29 17:23:25,762] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 18: [2023-04-29 17:23:25,762] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 18: [2023-04-29 17:23:25,763] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 18: [2023-04-29 17:23:25,764] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 6: [2023-04-29 17:23:25,764] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 6: [2023-04-29 17:23:25,770] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 6: [2023-04-29 17:23:25,770] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 6: [2023-04-29 17:23:25,770] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 6: [2023-04-29 17:23:25,770] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 6: [2023-04-29 17:23:25,770] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 27: [2023-04-29 17:23:25,775] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 27: [2023-04-29 17:23:25,775] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 20: [2023-04-29 17:23:25,776] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 20: [2023-04-29 17:23:25,776] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 20: [2023-04-29 17:23:25,779] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 27: [2023-04-29 17:23:25,779] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 27: [2023-04-29 17:23:25,779] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 27: [2023-04-29 17:23:25,779] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 27: [2023-04-29 17:23:25,779] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 27: [2023-04-29 17:23:25,779] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 16: [2023-04-29 17:23:25,785] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 21: [2023-04-29 17:23:25,788] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 21: [2023-04-29 17:23:25,788] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 21: [2023-04-29 17:23:25,788] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 6: [2023-04-29 17:23:25,790] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 20: [2023-04-29 17:23:25,791] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 20: [2023-04-29 17:23:25,791] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 20: [2023-04-29 17:23:25,791] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 20: [2023-04-29 17:23:25,792] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 20: [2023-04-29 17:23:25,792] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 21: [2023-04-29 17:23:25,792] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 16: [2023-04-29 17:23:25,797] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 16: [2023-04-29 17:23:25,799] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 24: [2023-04-29 17:23:25,800] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 6: [2023-04-29 17:23:25,801] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 6: [2023-04-29 17:23:25,802] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 6: [2023-04-29 17:23:25,803] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 21: [2023-04-29 17:23:25,803] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 21: [2023-04-29 17:23:25,803] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 21: [2023-04-29 17:23:25,803] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 21: [2023-04-29 17:23:25,803] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 20: [2023-04-29 17:23:25,804] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 6: [2023-04-29 17:23:25,804] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 1: [2023-04-29 17:23:25,804] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 1: [2023-04-29 17:23:25,804] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 1: [2023-04-29 17:23:25,804] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 1: [2023-04-29 17:23:25,804] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 1: [2023-04-29 17:23:25,804] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 1: [2023-04-29 17:23:25,804] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 1: [2023-04-29 17:23:25,804] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 1: [2023-04-29 17:23:25,805] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 6: [2023-04-29 17:23:25,805] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 20: [2023-04-29 17:23:25,806] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 26: [2023-04-29 17:23:25,807] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 26: [2023-04-29 17:23:25,807] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 16: [2023-04-29 17:23:25,807] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 27: [2023-04-29 17:23:25,807] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 1: [2023-04-29 17:23:25,809] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 20: [2023-04-29 17:23:25,809] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 1: [2023-04-29 17:23:25,809] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 1: [2023-04-29 17:23:25,810] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 26: [2023-04-29 17:23:25,809] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 1: [2023-04-29 17:23:25,810] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 16: [2023-04-29 17:23:25,810] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 16: [2023-04-29 17:23:25,810] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 16: [2023-04-29 17:23:25,810] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 16: [2023-04-29 17:23:25,810] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 16: [2023-04-29 17:23:25,810] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 27: [2023-04-29 17:23:25,810] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 1: [2023-04-29 17:23:25,811] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 21: [2023-04-29 17:23:25,812] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 21: [2023-04-29 17:23:25,812] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 1: [2023-04-29 17:23:25,812] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 21: [2023-04-29 17:23:25,813] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 1: [2023-04-29 17:23:25,813] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 1: [2023-04-29 17:23:25,813] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 27: [2023-04-29 17:23:25,813] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 27: [2023-04-29 17:23:25,816] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 27: [2023-04-29 17:23:25,816] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 21: [2023-04-29 17:23:25,816] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 27: [2023-04-29 17:23:25,817] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 26: [2023-04-29 17:23:25,817] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 27: [2023-04-29 17:23:25,819] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 26: [2023-04-29 17:23:25,819] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 26: [2023-04-29 17:23:25,819] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 26: [2023-04-29 17:23:25,819] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 26: [2023-04-29 17:23:25,819] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 20: [2023-04-29 17:23:25,820] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 20: [2023-04-29 17:23:25,821] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 20: [2023-04-29 17:23:25,821] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 24: [2023-04-29 17:23:25,821] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 20: [2023-04-29 17:23:25,822] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 20: [2023-04-29 17:23:25,823] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 16: [2023-04-29 17:23:25,823] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 24: [2023-04-29 17:23:25,825] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 22: [2023-04-29 17:23:25,827] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 22: [2023-04-29 17:23:25,827] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 16: [2023-04-29 17:23:25,827] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 22: [2023-04-29 17:23:25,828] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 22: [2023-04-29 17:23:25,828] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 22: [2023-04-29 17:23:25,828] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 22: [2023-04-29 17:23:25,829] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 22: [2023-04-29 17:23:25,829] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 22: [2023-04-29 17:23:25,829] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 24: [2023-04-29 17:23:25,829] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 21: [2023-04-29 17:23:25,829] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 21: [2023-04-29 17:23:25,830] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 22: [2023-04-29 17:23:25,831] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 22: [2023-04-29 17:23:25,832] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 26: [2023-04-29 17:23:25,832] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 26: [2023-04-29 17:23:25,832] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 21: [2023-04-29 17:23:25,833] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 21: [2023-04-29 17:23:25,833] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 26: [2023-04-29 17:23:25,836] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 22: [2023-04-29 17:23:25,836] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 16: [2023-04-29 17:23:25,839] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 22: [2023-04-29 17:23:25,838] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 22: [2023-04-29 17:23:25,838] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 22: [2023-04-29 17:23:25,839] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 22: [2023-04-29 17:23:25,839] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 16: [2023-04-29 17:23:25,840] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 22: [2023-04-29 17:23:25,840] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 16: [2023-04-29 17:23:25,840] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 26: [2023-04-29 17:23:25,842] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 24: [2023-04-29 17:23:25,843] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 16: [2023-04-29 17:23:25,843] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 16: [2023-04-29 17:23:25,843] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 24: [2023-04-29 17:23:25,844] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 24: [2023-04-29 17:23:25,844] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 24: [2023-04-29 17:23:25,844] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 26: [2023-04-29 17:23:25,846] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 26: [2023-04-29 17:23:25,847] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 26: [2023-04-29 17:23:25,848] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 26: [2023-04-29 17:23:25,850] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 1: [2023-04-29 17:23:25,861] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 1: [2023-04-29 17:23:25,867] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 1: [2023-04-29 17:23:25,867] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 1: [2023-04-29 17:23:25,867] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 1: [2023-04-29 17:23:25,872] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 1: [2023-04-29 17:23:25,872] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 1: [2023-04-29 17:23:25,872] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 1: [2023-04-29 17:23:25,873] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 22: [2023-04-29 17:23:25,875] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 7: [2023-04-29 17:23:25,880] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 25: [2023-04-29 17:23:25,880] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 25: [2023-04-29 17:23:25,880] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 7: [2023-04-29 17:23:25,880] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 7: [2023-04-29 17:23:25,880] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 7: [2023-04-29 17:23:25,881] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 7: [2023-04-29 17:23:25,881] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 7: [2023-04-29 17:23:25,881] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 7: [2023-04-29 17:23:25,881] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 12: [2023-04-29 17:23:25,881] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 12: [2023-04-29 17:23:25,881] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 12: [2023-04-29 17:23:25,881] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 12: [2023-04-29 17:23:25,881] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 12: [2023-04-29 17:23:25,881] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 12: [2023-04-29 17:23:25,881] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 25: [2023-04-29 17:23:25,881] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 25: [2023-04-29 17:23:25,881] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 25: [2023-04-29 17:23:25,881] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 7: [2023-04-29 17:23:25,881] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 12: [2023-04-29 17:23:25,881] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 25: [2023-04-29 17:23:25,881] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 1: [2023-04-29 17:23:25,881] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 25: [2023-04-29 17:23:25,881] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 12: [2023-04-29 17:23:25,881] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 25: [2023-04-29 17:23:25,881] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 5: [2023-04-29 17:23:25,883] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 5: [2023-04-29 17:23:25,884] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 5: [2023-04-29 17:23:25,884] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 5: [2023-04-29 17:23:25,884] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 5: [2023-04-29 17:23:25,884] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 5: [2023-04-29 17:23:25,884] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 5: [2023-04-29 17:23:25,884] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 25: [2023-04-29 17:23:25,884] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 5: [2023-04-29 17:23:25,885] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 25: [2023-04-29 17:23:25,885] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 12: [2023-04-29 17:23:25,885] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 7: [2023-04-29 17:23:25,885] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 7: [2023-04-29 17:23:25,886] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 7: [2023-04-29 17:23:25,886] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 7: [2023-04-29 17:23:25,886] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 22: [2023-04-29 17:23:25,886] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 7: [2023-04-29 17:23:25,886] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 7: [2023-04-29 17:23:25,887] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 24: [2023-04-29 17:23:25,846] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 24: [2023-04-29 17:23:25,850] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 7: [2023-04-29 17:23:25,887] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 12: [2023-04-29 17:23:25,887] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 24: [2023-04-29 17:23:25,853] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 24: [2023-04-29 17:23:25,875] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 24: [2023-04-29 17:23:25,875] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 24: [2023-04-29 17:23:25,876] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 24: [2023-04-29 17:23:25,876] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 24: [2023-04-29 17:23:25,879] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 7: [2023-04-29 17:23:25,887] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 5: [2023-04-29 17:23:25,888] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 5: [2023-04-29 17:23:25,888] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 12: [2023-04-29 17:23:25,888] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 12: [2023-04-29 17:23:25,888] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 12: [2023-04-29 17:23:25,889] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 12: [2023-04-29 17:23:25,889] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 12: [2023-04-29 17:23:25,890] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 1: [2023-04-29 17:23:25,891] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 1: [2023-04-29 17:23:25,891] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 12: [2023-04-29 17:23:25,891] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 25: [2023-04-29 17:23:25,891] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 25: [2023-04-29 17:23:25,891] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 25: [2023-04-29 17:23:25,892] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 5: [2023-04-29 17:23:25,892] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 25: [2023-04-29 17:23:25,892] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 25: [2023-04-29 17:23:25,892] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 25: [2023-04-29 17:23:25,893] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 5: [2023-04-29 17:23:25,894] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 5: [2023-04-29 17:23:25,894] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 1: [2023-04-29 17:23:25,895] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 5: [2023-04-29 17:23:25,895] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 5: [2023-04-29 17:23:25,896] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 5: [2023-04-29 17:23:25,896] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 22: [2023-04-29 17:23:25,896] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 22: [2023-04-29 17:23:25,897] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 1: [2023-04-29 17:23:25,899] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 1: [2023-04-29 17:23:25,899] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 1: [2023-04-29 17:23:25,900] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 1: [2023-04-29 17:23:25,902] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 22: [2023-04-29 17:23:25,909] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 22: [2023-04-29 17:23:25,914] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 22: [2023-04-29 17:23:25,915] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 22: [2023-04-29 17:23:25,915] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 22: [2023-04-29 17:23:25,915] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 22: [2023-04-29 17:23:25,915] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 22: [2023-04-29 17:23:25,921] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 25: [2023-04-29 17:23:25,936] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 25: [2023-04-29 17:23:25,936] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 30: [2023-04-29 17:23:25,938] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 13: [2023-04-29 17:23:25,939] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 13: [2023-04-29 17:23:25,939] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 13: [2023-04-29 17:23:25,939] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 10: [2023-04-29 17:23:25,939] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 10: [2023-04-29 17:23:25,939] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 10: [2023-04-29 17:23:25,939] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 13: [2023-04-29 17:23:25,939] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 30: [2023-04-29 17:23:25,939] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 30: [2023-04-29 17:23:25,939] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 30: [2023-04-29 17:23:25,939] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 30: [2023-04-29 17:23:25,939] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 30: [2023-04-29 17:23:25,939] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 10: [2023-04-29 17:23:25,939] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 30: [2023-04-29 17:23:25,939] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 10: [2023-04-29 17:23:25,939] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 10: [2023-04-29 17:23:25,939] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 10: [2023-04-29 17:23:25,939] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 13: [2023-04-29 17:23:25,939] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 30: [2023-04-29 17:23:25,939] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 13: [2023-04-29 17:23:25,939] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 13: [2023-04-29 17:23:25,939] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 3: [2023-04-29 17:23:25,939] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 3: [2023-04-29 17:23:25,939] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 3: [2023-04-29 17:23:25,939] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 3: [2023-04-29 17:23:25,939] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 3: [2023-04-29 17:23:25,939] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 17: [2023-04-29 17:23:25,939] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 17: [2023-04-29 17:23:25,939] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 17: [2023-04-29 17:23:25,939] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 10: [2023-04-29 17:23:25,940] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 3: [2023-04-29 17:23:25,939] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 3: [2023-04-29 17:23:25,939] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 5: [2023-04-29 17:23:25,939] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 17: [2023-04-29 17:23:25,940] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 13: [2023-04-29 17:23:25,940] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 3: [2023-04-29 17:23:25,940] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 17: [2023-04-29 17:23:25,940] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 17: [2023-04-29 17:23:25,940] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 17: [2023-04-29 17:23:25,940] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 12: [2023-04-29 17:23:25,940] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 12: [2023-04-29 17:23:25,940] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 17: [2023-04-29 17:23:25,940] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 7: [2023-04-29 17:23:25,941] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 7: [2023-04-29 17:23:25,941] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 7: [2023-04-29 17:23:25,941] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 5: [2023-04-29 17:23:25,943] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 17: [2023-04-29 17:23:25,943] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 7: [2023-04-29 17:23:25,944] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 7: [2023-04-29 17:23:25,944] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 10: [2023-04-29 17:23:25,944] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 3: [2023-04-29 17:23:25,944] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 3: [2023-04-29 17:23:25,944] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 10: [2023-04-29 17:23:25,944] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 17: [2023-04-29 17:23:25,945] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 10: [2023-04-29 17:23:25,945] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 10: [2023-04-29 17:23:25,945] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 3: [2023-04-29 17:23:25,945] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 13: [2023-04-29 17:23:25,946] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 22: [2023-04-29 17:23:25,946] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 3: [2023-04-29 17:23:25,946] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 13: [2023-04-29 17:23:25,946] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 3: [2023-04-29 17:23:25,947] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 3: [2023-04-29 17:23:25,947] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 12: [2023-04-29 17:23:25,947] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 12: [2023-04-29 17:23:25,947] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 22: [2023-04-29 17:23:25,947] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 3: [2023-04-29 17:23:25,947] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 3: [2023-04-29 17:23:25,948] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 17: [2023-04-29 17:23:25,947] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 10: [2023-04-29 17:23:25,948] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 10: [2023-04-29 17:23:25,948] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 22: [2023-04-29 17:23:25,948] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 22: [2023-04-29 17:23:25,948] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 17: [2023-04-29 17:23:25,949] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 10: [2023-04-29 17:23:25,949] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 13: [2023-04-29 17:23:25,949] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 17: [2023-04-29 17:23:25,949] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 13: [2023-04-29 17:23:25,949] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 10: [2023-04-29 17:23:25,950] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 17: [2023-04-29 17:23:25,950] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 30: [2023-04-29 17:23:25,950] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 30: [2023-04-29 17:23:25,950] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 30: [2023-04-29 17:23:25,950] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 17: [2023-04-29 17:23:25,951] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 25: [2023-04-29 17:23:25,951] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 13: [2023-04-29 17:23:25,951] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 17: [2023-04-29 17:23:25,951] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 30: [2023-04-29 17:23:25,951] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 22: [2023-04-29 17:23:25,951] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 30: [2023-04-29 17:23:25,951] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 13: [2023-04-29 17:23:25,951] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 30: [2023-04-29 17:23:25,951] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 13: [2023-04-29 17:23:25,951] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 30: [2023-04-29 17:23:25,952] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 13: [2023-04-29 17:23:25,952] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 30: [2023-04-29 17:23:25,953] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 5: [2023-04-29 17:23:25,956] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 25: [2023-04-29 17:23:25,956] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 25: [2023-04-29 17:23:25,957] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 7: [2023-04-29 17:23:25,958] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 7: [2023-04-29 17:23:25,958] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 7: [2023-04-29 17:23:25,958] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 12: [2023-04-29 17:23:25,960] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 5: [2023-04-29 17:23:25,960] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 12: [2023-04-29 17:23:25,960] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 12: [2023-04-29 17:23:25,960] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 12: [2023-04-29 17:23:25,960] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 12: [2023-04-29 17:23:25,962] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 5: [2023-04-29 17:23:25,962] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 12: [2023-04-29 17:23:25,964] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 7: [2023-04-29 17:23:25,965] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 7: [2023-04-29 17:23:25,966] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 7: [2023-04-29 17:23:25,966] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 5: [2023-04-29 17:23:25,967] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 5: [2023-04-29 17:23:25,968] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 25: [2023-04-29 17:23:25,968] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 5: [2023-04-29 17:23:25,969] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 5: [2023-04-29 17:23:25,969] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 5: [2023-04-29 17:23:25,969] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 7: [2023-04-29 17:23:25,969] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 25: [2023-04-29 17:23:25,969] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 25: [2023-04-29 17:23:25,969] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 25: [2023-04-29 17:23:25,969] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 25: [2023-04-29 17:23:25,969] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 7: [2023-04-29 17:23:25,971] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 12: [2023-04-29 17:23:25,972] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 8: [2023-04-29 17:23:25,972] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 8: [2023-04-29 17:23:25,972] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 8: [2023-04-29 17:23:25,972] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 8: [2023-04-29 17:23:25,973] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 8: [2023-04-29 17:23:25,973] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 8: [2023-04-29 17:23:25,973] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 8: [2023-04-29 17:23:25,973] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 8: [2023-04-29 17:23:25,973] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 25: [2023-04-29 17:23:25,973] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 12: [2023-04-29 17:23:25,974] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 8: [2023-04-29 17:23:25,977] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 8: [2023-04-29 17:23:25,978] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 5: [2023-04-29 17:23:25,979] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 8: [2023-04-29 17:23:25,980] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 8: [2023-04-29 17:23:25,980] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 8: [2023-04-29 17:23:25,981] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 8: [2023-04-29 17:23:25,981] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 8: [2023-04-29 17:23:25,982] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 8: [2023-04-29 17:23:25,983] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 7: [2023-04-29 17:23:25,984] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 11: [2023-04-29 17:23:25,986] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 11: [2023-04-29 17:23:25,986] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 11: [2023-04-29 17:23:25,986] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 11: [2023-04-29 17:23:25,986] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 11: [2023-04-29 17:23:25,986] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 11: [2023-04-29 17:23:25,986] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 11: [2023-04-29 17:23:25,986] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 11: [2023-04-29 17:23:25,987] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 7: [2023-04-29 17:23:25,987] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 7: [2023-04-29 17:23:25,987] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 12: [2023-04-29 17:23:25,988] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 17: [2023-04-29 17:23:25,988] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 12: [2023-04-29 17:23:25,990] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 12: [2023-04-29 17:23:25,991] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 12: [2023-04-29 17:23:25,991] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 11: [2023-04-29 17:23:25,990] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 11: [2023-04-29 17:23:25,991] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 11: [2023-04-29 17:23:25,991] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 23: [2023-04-29 17:23:25,992] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 23: [2023-04-29 17:23:25,993] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 23: [2023-04-29 17:23:25,993] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 11: [2023-04-29 17:23:25,993] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 23: [2023-04-29 17:23:25,993] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 23: [2023-04-29 17:23:25,993] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 23: [2023-04-29 17:23:25,993] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 23: [2023-04-29 17:23:25,993] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 23: [2023-04-29 17:23:25,994] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 10: [2023-04-29 17:23:25,994] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 11: [2023-04-29 17:23:25,996] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 14: [2023-04-29 17:23:25,995] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 14: [2023-04-29 17:23:25,995] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 14: [2023-04-29 17:23:25,996] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 14: [2023-04-29 17:23:25,996] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 5: [2023-04-29 17:23:25,996] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 11: [2023-04-29 17:23:25,996] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 14: [2023-04-29 17:23:25,996] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 14: [2023-04-29 17:23:25,996] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 14: [2023-04-29 17:23:25,996] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 14: [2023-04-29 17:23:25,996] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 11: [2023-04-29 17:23:25,996] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 31: [2023-04-29 17:23:25,996] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 31: [2023-04-29 17:23:25,996] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 31: [2023-04-29 17:23:25,996] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 11: [2023-04-29 17:23:25,997] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 31: [2023-04-29 17:23:25,997] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 31: [2023-04-29 17:23:25,997] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 31: [2023-04-29 17:23:25,997] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 31: [2023-04-29 17:23:25,997] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 31: [2023-04-29 17:23:25,997] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 23: [2023-04-29 17:23:25,997] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 14: [2023-04-29 17:23:25,999] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 3: [2023-04-29 17:23:25,999] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 3: [2023-04-29 17:23:25,999] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 25: [2023-04-29 17:23:25,999] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 14: [2023-04-29 17:23:25,999] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 13: [2023-04-29 17:23:25,999] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 23: [2023-04-29 17:23:25,999] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 25: [2023-04-29 17:23:26,000] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 25: [2023-04-29 17:23:26,000] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 13: [2023-04-29 17:23:26,001] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 17: [2023-04-29 17:23:26,002] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 31: [2023-04-29 17:23:26,001] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 31: [2023-04-29 17:23:26,002] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 31: [2023-04-29 17:23:26,002] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 5: [2023-04-29 17:23:26,002] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 5: [2023-04-29 17:23:26,003] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 25: [2023-04-29 17:23:26,003] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 25: [2023-04-29 17:23:26,003] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 31: [2023-04-29 17:23:26,003] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 23: [2023-04-29 17:23:26,003] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 31: [2023-04-29 17:23:26,004] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 31: [2023-04-29 17:23:26,004] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 10: [2023-04-29 17:23:26,004] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 10: [2023-04-29 17:23:26,004] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 10: [2023-04-29 17:23:26,004] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 31: [2023-04-29 17:23:26,004] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 23: [2023-04-29 17:23:26,004] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 31: [2023-04-29 17:23:26,005] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 23: [2023-04-29 17:23:26,005] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 5: [2023-04-29 17:23:26,005] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 23: [2023-04-29 17:23:26,006] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 17: [2023-04-29 17:23:26,006] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 23: [2023-04-29 17:23:26,006] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 5: [2023-04-29 17:23:26,006] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 14: [2023-04-29 17:23:26,006] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 14: [2023-04-29 17:23:26,006] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 23: [2023-04-29 17:23:26,007] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 14: [2023-04-29 17:23:26,007] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 14: [2023-04-29 17:23:26,007] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 14: [2023-04-29 17:23:26,008] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 17: [2023-04-29 17:23:26,008] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 14: [2023-04-29 17:23:26,008] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 10: [2023-04-29 17:23:26,010] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 10: [2023-04-29 17:23:26,010] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 10: [2023-04-29 17:23:26,010] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 10: [2023-04-29 17:23:26,010] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 10: [2023-04-29 17:23:26,015] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 3: [2023-04-29 17:23:26,016] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 3: [2023-04-29 17:23:26,018] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 13: [2023-04-29 17:23:26,019] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 13: [2023-04-29 17:23:26,019] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 13: [2023-04-29 17:23:26,019] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 3: [2023-04-29 17:23:26,021] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 13: [2023-04-29 17:23:26,021] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 13: [2023-04-29 17:23:26,021] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 13: [2023-04-29 17:23:26,022] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 3: [2023-04-29 17:23:26,022] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 3: [2023-04-29 17:23:26,022] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 3: [2023-04-29 17:23:26,022] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 3: [2023-04-29 17:23:26,022] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 3: [2023-04-29 17:23:26,022] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 17: [2023-04-29 17:23:26,023] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 30: [2023-04-29 17:23:26,023] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 13: [2023-04-29 17:23:26,023] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 13: [2023-04-29 17:23:26,024] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 17: [2023-04-29 17:23:26,025] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 8: [2023-04-29 17:23:26,025] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 17: [2023-04-29 17:23:26,028] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 17: [2023-04-29 17:23:26,028] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 10: [2023-04-29 17:23:26,029] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 10: [2023-04-29 17:23:26,029] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 10: [2023-04-29 17:23:26,030] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 17: [2023-04-29 17:23:26,031] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 17: [2023-04-29 17:23:26,031] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 8: [2023-04-29 17:23:26,033] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 19: [2023-04-29 17:23:26,035] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 19: [2023-04-29 17:23:26,035] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 2: [2023-04-29 17:23:26,035] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 2: [2023-04-29 17:23:26,035] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 17: [2023-04-29 17:23:26,036] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 8: [2023-04-29 17:23:26,037] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 10: [2023-04-29 17:23:26,038] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 9: [2023-04-29 17:23:26,037] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 9: [2023-04-29 17:23:26,037] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 9: [2023-04-29 17:23:26,037] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 9: [2023-04-29 17:23:26,037] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 9: [2023-04-29 17:23:26,037] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 9: [2023-04-29 17:23:26,037] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 9: [2023-04-29 17:23:26,037] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 19: [2023-04-29 17:23:26,038] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 19: [2023-04-29 17:23:26,038] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 19: [2023-04-29 17:23:26,038] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 19: [2023-04-29 17:23:26,038] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 19: [2023-04-29 17:23:26,038] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 9: [2023-04-29 17:23:26,038] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 19: [2023-04-29 17:23:26,038] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 10: [2023-04-29 17:23:26,039] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 10: [2023-04-29 17:23:26,039] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 10: [2023-04-29 17:23:26,039] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 3: [2023-04-29 17:23:26,039] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 19: [2023-04-29 17:23:26,040] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 8: [2023-04-29 17:23:26,040] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 2: [2023-04-29 17:23:26,040] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 19: [2023-04-29 17:23:26,040] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 2: [2023-04-29 17:23:26,040] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 2: [2023-04-29 17:23:26,040] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 2: [2023-04-29 17:23:26,040] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 2: [2023-04-29 17:23:26,040] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 2: [2023-04-29 17:23:26,041] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 2: [2023-04-29 17:23:26,041] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 2: [2023-04-29 17:23:26,041] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 29: [2023-04-29 17:23:26,041] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 29: [2023-04-29 17:23:26,041] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 29: [2023-04-29 17:23:26,041] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 29: [2023-04-29 17:23:26,042] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 29: [2023-04-29 17:23:26,042] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 29: [2023-04-29 17:23:26,042] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 29: [2023-04-29 17:23:26,042] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 30: [2023-04-29 17:23:26,042] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 30: [2023-04-29 17:23:26,042] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 30: [2023-04-29 17:23:26,042] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 30: [2023-04-29 17:23:26,042] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 30: [2023-04-29 17:23:26,042] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 30: [2023-04-29 17:23:26,042] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 30: [2023-04-29 17:23:26,042] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 29: [2023-04-29 17:23:26,042] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 19: [2023-04-29 17:23:26,042] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 9: [2023-04-29 17:23:26,043] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 9: [2023-04-29 17:23:26,043] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 8: [2023-04-29 17:23:26,043] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 9: [2023-04-29 17:23:26,043] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 9: [2023-04-29 17:23:26,043] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 9: [2023-04-29 17:23:26,043] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 9: [2023-04-29 17:23:26,043] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 9: [2023-04-29 17:23:26,044] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 19: [2023-04-29 17:23:26,044] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 9: [2023-04-29 17:23:26,044] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 2: [2023-04-29 17:23:26,044] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 11: [2023-04-29 17:23:26,044] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 11: [2023-04-29 17:23:26,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 11: [2023-04-29 17:23:26,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 11: [2023-04-29 17:23:26,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 29: [2023-04-29 17:23:26,045] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 29: [2023-04-29 17:23:26,045] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 0: [2023-04-29 17:23:26,046] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 0: [2023-04-29 17:23:26,046] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 0: [2023-04-29 17:23:26,046] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 0: [2023-04-29 17:23:26,046] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 0: [2023-04-29 17:23:26,046] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 0: [2023-04-29 17:23:26,046] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 0: [2023-04-29 17:23:26,046] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 19: [2023-04-29 17:23:26,046] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 19: [2023-04-29 17:23:26,046] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 0: [2023-04-29 17:23:26,046] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 19: [2023-04-29 17:23:26,046] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 30: [2023-04-29 17:23:26,047] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 8: [2023-04-29 17:23:26,047] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 19: [2023-04-29 17:23:26,048] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 2: [2023-04-29 17:23:26,049] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 13: [2023-04-29 17:23:26,049] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 2: [2023-04-29 17:23:26,050] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 13: [2023-04-29 17:23:26,050] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 17: [2023-04-29 17:23:26,050] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 2: [2023-04-29 17:23:26,050] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 13: [2023-04-29 17:23:26,050] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 3: [2023-04-29 17:23:26,050] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 23: [2023-04-29 17:23:26,051] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 2: [2023-04-29 17:23:26,051] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 2: [2023-04-29 17:23:26,051] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 29: [2023-04-29 17:23:26,052] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 29: [2023-04-29 17:23:26,052] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 14: [2023-04-29 17:23:26,052] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 29: [2023-04-29 17:23:26,053] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 13: [2023-04-29 17:23:26,053] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 29: [2023-04-29 17:23:26,053] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 29: [2023-04-29 17:23:26,053] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 14: [2023-04-29 17:23:26,054] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 29: [2023-04-29 17:23:26,054] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 23: [2023-04-29 17:23:26,054] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 17: [2023-04-29 17:23:26,054] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 13: [2023-04-29 17:23:26,054] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 13: [2023-04-29 17:23:26,054] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 3: [2023-04-29 17:23:26,055] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 3: [2023-04-29 17:23:26,055] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 8: [2023-04-29 17:23:26,055] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 31: [2023-04-29 17:23:26,055] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 31: [2023-04-29 17:23:26,055] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 31: [2023-04-29 17:23:26,055] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 8: [2023-04-29 17:23:26,055] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 8: [2023-04-29 17:23:26,055] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 0: [2023-04-29 17:23:26,056] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 0: [2023-04-29 17:23:26,057] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 8: [2023-04-29 17:23:26,057] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 3: [2023-04-29 17:23:26,058] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 17: [2023-04-29 17:23:26,059] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 17: [2023-04-29 17:23:26,059] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 0: [2023-04-29 17:23:26,059] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 0: [2023-04-29 17:23:26,059] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 0: [2023-04-29 17:23:26,059] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 3: [2023-04-29 17:23:26,060] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 8: [2023-04-29 17:23:26,062] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 0: [2023-04-29 17:23:26,062] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 0: [2023-04-29 17:23:26,062] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 17: [2023-04-29 17:23:26,062] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 0: [2023-04-29 17:23:26,063] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 11: [2023-04-29 17:23:26,064] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 11: [2023-04-29 17:23:26,064] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 11: [2023-04-29 17:23:26,064] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 8: [2023-04-29 17:23:26,065] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 11: [2023-04-29 17:23:26,066] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 8: [2023-04-29 17:23:26,067] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 31: [2023-04-29 17:23:26,069] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 31: [2023-04-29 17:23:26,069] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 31: [2023-04-29 17:23:26,069] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 31: [2023-04-29 17:23:26,069] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 31: [2023-04-29 17:23:26,069] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 14: [2023-04-29 17:23:26,072] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 14: [2023-04-29 17:23:26,073] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 11: [2023-04-29 17:23:26,073] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 23: [2023-04-29 17:23:26,075] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 23: [2023-04-29 17:23:26,076] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 23: [2023-04-29 17:23:26,076] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 11: [2023-04-29 17:23:26,076] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 11: [2023-04-29 17:23:26,076] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 23: [2023-04-29 17:23:26,076] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 23: [2023-04-29 17:23:26,077] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 23: [2023-04-29 17:23:26,077] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 23: [2023-04-29 17:23:26,077] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 30: [2023-04-29 17:23:26,078] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 11: [2023-04-29 17:23:26,078] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 30: [2023-04-29 17:23:26,078] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 14: [2023-04-29 17:23:26,079] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 23: [2023-04-29 17:23:26,079] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 14: [2023-04-29 17:23:26,079] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 6: [2023-04-29 17:23:26,080] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 6: [2023-04-29 17:23:26,080] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 6: [2023-04-29 17:23:26,080] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 31: [2023-04-29 17:23:26,080] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 8: [2023-04-29 17:23:26,080] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 6: [2023-04-29 17:23:26,080] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 6: [2023-04-29 17:23:26,080] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 6: [2023-04-29 17:23:26,080] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 6: [2023-04-29 17:23:26,080] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 31: [2023-04-29 17:23:26,080] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 6: [2023-04-29 17:23:26,081] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 8: [2023-04-29 17:23:26,081] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 30: [2023-04-29 17:23:26,081] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 30: [2023-04-29 17:23:26,081] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 30: [2023-04-29 17:23:26,081] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 31: [2023-04-29 17:23:26,081] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 8: [2023-04-29 17:23:26,081] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 30: [2023-04-29 17:23:26,082] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 30: [2023-04-29 17:23:26,083] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 14: [2023-04-29 17:23:26,082] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 14: [2023-04-29 17:23:26,082] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 14: [2023-04-29 17:23:26,083] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 14: [2023-04-29 17:23:26,083] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 6: [2023-04-29 17:23:26,083] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 6: [2023-04-29 17:23:26,084] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 18: [2023-04-29 17:23:26,085] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 18: [2023-04-29 17:23:26,085] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 18: [2023-04-29 17:23:26,085] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 18: [2023-04-29 17:23:26,086] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 18: [2023-04-29 17:23:26,086] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 18: [2023-04-29 17:23:26,086] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 18: [2023-04-29 17:23:26,086] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 18: [2023-04-29 17:23:26,086] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 6: [2023-04-29 17:23:26,089] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 6: [2023-04-29 17:23:26,090] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 6: [2023-04-29 17:23:26,090] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 6: [2023-04-29 17:23:26,091] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 6: [2023-04-29 17:23:26,091] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 6: [2023-04-29 17:23:26,091] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 15: [2023-04-29 17:23:26,091] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 15: [2023-04-29 17:23:26,091] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 15: [2023-04-29 17:23:26,091] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 15: [2023-04-29 17:23:26,091] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 15: [2023-04-29 17:23:26,091] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 15: [2023-04-29 17:23:26,091] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 15: [2023-04-29 17:23:26,091] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 15: [2023-04-29 17:23:26,092] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 11: [2023-04-29 17:23:26,093] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 19: [2023-04-29 17:23:26,095] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 19: [2023-04-29 17:23:26,095] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 19: [2023-04-29 17:23:26,095] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 2: [2023-04-29 17:23:26,095] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 2: [2023-04-29 17:23:26,095] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 2: [2023-04-29 17:23:26,095] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 11: [2023-04-29 17:23:26,097] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 11: [2023-04-29 17:23:26,097] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 29: [2023-04-29 17:23:26,097] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 29: [2023-04-29 17:23:26,097] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 31: [2023-04-29 17:23:26,097] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 18: [2023-04-29 17:23:26,097] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 11: [2023-04-29 17:23:26,097] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 31: [2023-04-29 17:23:26,097] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 31: [2023-04-29 17:23:26,098] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 31: [2023-04-29 17:23:26,098] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 31: [2023-04-29 17:23:26,099] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 18: [2023-04-29 17:23:26,099] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 18: [2023-04-29 17:23:26,099] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 18: [2023-04-29 17:23:26,100] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 18: [2023-04-29 17:23:26,100] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 18: [2023-04-29 17:23:26,100] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 18: [2023-04-29 17:23:26,101] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 19: [2023-04-29 17:23:26,101] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 23: [2023-04-29 17:23:26,102] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 9: [2023-04-29 17:23:26,102] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 18: [2023-04-29 17:23:26,102] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 9: [2023-04-29 17:23:26,103] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 9: [2023-04-29 17:23:26,103] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 9: [2023-04-29 17:23:26,103] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 9: [2023-04-29 17:23:26,103] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 9: [2023-04-29 17:23:26,103] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 9: [2023-04-29 17:23:26,103] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 9: [2023-04-29 17:23:26,103] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 15: [2023-04-29 17:23:26,105] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 15: [2023-04-29 17:23:26,105] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 15: [2023-04-29 17:23:26,106] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 2: [2023-04-29 17:23:26,106] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 15: [2023-04-29 17:23:26,107] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 15: [2023-04-29 17:23:26,107] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 15: [2023-04-29 17:23:26,107] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 15: [2023-04-29 17:23:26,108] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 2: [2023-04-29 17:23:26,108] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 15: [2023-04-29 17:23:26,108] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 23: [2023-04-29 17:23:26,108] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 14: [2023-04-29 17:23:26,109] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 14: [2023-04-29 17:23:26,112] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 23: [2023-04-29 17:23:26,113] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 23: [2023-04-29 17:23:26,113] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 23: [2023-04-29 17:23:26,113] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 14: [2023-04-29 17:23:26,114] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 14: [2023-04-29 17:23:26,115] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 19: [2023-04-29 17:23:26,115] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 19: [2023-04-29 17:23:26,115] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 19: [2023-04-29 17:23:26,115] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 27: [2023-04-29 17:23:26,115] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 27: [2023-04-29 17:23:26,115] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 27: [2023-04-29 17:23:26,116] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 27: [2023-04-29 17:23:26,116] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 27: [2023-04-29 17:23:26,116] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 23: [2023-04-29 17:23:26,116] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 27: [2023-04-29 17:23:26,116] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 27: [2023-04-29 17:23:26,116] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 27: [2023-04-29 17:23:26,116] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 19: [2023-04-29 17:23:26,116] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 29: [2023-04-29 17:23:26,117] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 29: [2023-04-29 17:23:26,117] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 14: [2023-04-29 17:23:26,117] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 2: [2023-04-29 17:23:26,117] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 27: [2023-04-29 17:23:26,118] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 4: [2023-04-29 17:23:26,118] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 4: [2023-04-29 17:23:26,118] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 26: [2023-04-29 17:23:26,118] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 26: [2023-04-29 17:23:26,118] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 14: [2023-04-29 17:23:26,119] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 24: [2023-04-29 17:23:26,119] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 26: [2023-04-29 17:23:26,119] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 26: [2023-04-29 17:23:26,119] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 2: [2023-04-29 17:23:26,119] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 26: [2023-04-29 17:23:26,119] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 26: [2023-04-29 17:23:26,120] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 26: [2023-04-29 17:23:26,120] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 26: [2023-04-29 17:23:26,120] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 2: [2023-04-29 17:23:26,120] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 24: [2023-04-29 17:23:26,120] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 24: [2023-04-29 17:23:26,120] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 24: [2023-04-29 17:23:26,120] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 24: [2023-04-29 17:23:26,120] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 24: [2023-04-29 17:23:26,120] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 24: [2023-04-29 17:23:26,120] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 24: [2023-04-29 17:23:26,120] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 19: [2023-04-29 17:23:26,121] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 2: [2023-04-29 17:23:26,121] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 2: [2023-04-29 17:23:26,121] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 28: [2023-04-29 17:23:26,121] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 28: [2023-04-29 17:23:26,121] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 28: [2023-04-29 17:23:26,122] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 28: [2023-04-29 17:23:26,122] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 28: [2023-04-29 17:23:26,122] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 28: [2023-04-29 17:23:26,122] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 28: [2023-04-29 17:23:26,122] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 4: [2023-04-29 17:23:26,122] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 4: [2023-04-29 17:23:26,122] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 4: [2023-04-29 17:23:26,122] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 4: [2023-04-29 17:23:26,122] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 4: [2023-04-29 17:23:26,122] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 4: [2023-04-29 17:23:26,122] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 4: [2023-04-29 17:23:26,122] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 28: [2023-04-29 17:23:26,122] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 24: [2023-04-29 17:23:26,123] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 29: [2023-04-29 17:23:26,123] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 29: [2023-04-29 17:23:26,123] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 4: [2023-04-29 17:23:26,123] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 19: [2023-04-29 17:23:26,123] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 19: [2023-04-29 17:23:26,124] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 26: [2023-04-29 17:23:26,125] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 2: [2023-04-29 17:23:26,126] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 26: [2023-04-29 17:23:26,126] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 19: [2023-04-29 17:23:26,126] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 26: [2023-04-29 17:23:26,126] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 6: [2023-04-29 17:23:26,126] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 29: [2023-04-29 17:23:26,127] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 29: [2023-04-29 17:23:26,127] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 29: [2023-04-29 17:23:26,127] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 29: [2023-04-29 17:23:26,127] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 27: [2023-04-29 17:23:26,127] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 26: [2023-04-29 17:23:26,127] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 27: [2023-04-29 17:23:26,127] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 26: [2023-04-29 17:23:26,127] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 24: [2023-04-29 17:23:26,127] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 9: [2023-04-29 17:23:26,127] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 26: [2023-04-29 17:23:26,127] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 26: [2023-04-29 17:23:26,128] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 26: [2023-04-29 17:23:26,128] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 27: [2023-04-29 17:23:26,128] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 27: [2023-04-29 17:23:26,128] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 27: [2023-04-29 17:23:26,129] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 9: [2023-04-29 17:23:26,129] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 27: [2023-04-29 17:23:26,129] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 27: [2023-04-29 17:23:26,129] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 9: [2023-04-29 17:23:26,130] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 9: [2023-04-29 17:23:26,130] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 0: [2023-04-29 17:23:26,130] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 9: [2023-04-29 17:23:26,130] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 24: [2023-04-29 17:23:26,130] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 9: [2023-04-29 17:23:26,131] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 9: [2023-04-29 17:23:26,131] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 24: [2023-04-29 17:23:26,131] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 4: [2023-04-29 17:23:26,131] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 9: [2023-04-29 17:23:26,131] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 2: [2023-04-29 17:23:26,131] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 24: [2023-04-29 17:23:26,132] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 24: [2023-04-29 17:23:26,132] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 24: [2023-04-29 17:23:26,132] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 4: [2023-04-29 17:23:26,132] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 4: [2023-04-29 17:23:26,134] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 4: [2023-04-29 17:23:26,134] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 28: [2023-04-29 17:23:26,133] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 24: [2023-04-29 17:23:26,134] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 28: [2023-04-29 17:23:26,135] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 4: [2023-04-29 17:23:26,135] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 2: [2023-04-29 17:23:26,135] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 4: [2023-04-29 17:23:26,135] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 28: [2023-04-29 17:23:26,135] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 28: [2023-04-29 17:23:26,136] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 6: [2023-04-29 17:23:26,137] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 28: [2023-04-29 17:23:26,137] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 28: [2023-04-29 17:23:26,137] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 28: [2023-04-29 17:23:26,138] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 0: [2023-04-29 17:23:26,138] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 0: [2023-04-29 17:23:26,138] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 28: [2023-04-29 17:23:26,139] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt... 19: [2023-04-29 17:23:26,141] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 19: [2023-04-29 17:23:26,143] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 19: [2023-04-29 17:23:26,144] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 6: [2023-04-29 17:23:26,147] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 19: [2023-04-29 17:23:26,147] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 0: [2023-04-29 17:23:26,147] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 0: [2023-04-29 17:23:26,147] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 2: [2023-04-29 17:23:26,149] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 2: [2023-04-29 17:23:26,150] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 2: [2023-04-29 17:23:26,151] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 29: [2023-04-29 17:23:26,153] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 29: [2023-04-29 17:23:26,155] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 29: [2023-04-29 17:23:26,156] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 0: [2023-04-29 17:23:26,157] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 6: [2023-04-29 17:23:26,157] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 27: [2023-04-29 17:23:26,159] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 29: [2023-04-29 17:23:26,160] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 29: [2023-04-29 17:23:26,160] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 6: [2023-04-29 17:23:26,161] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 29: [2023-04-29 17:23:26,162] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 6: [2023-04-29 17:23:26,164] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 6: [2023-04-29 17:23:26,164] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 6: [2023-04-29 17:23:26,164] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 6: [2023-04-29 17:23:26,164] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 6: [2023-04-29 17:23:26,164] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 4: [2023-04-29 17:23:26,165] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 0: [2023-04-29 17:23:26,170] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 0: [2023-04-29 17:23:26,170] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 0: [2023-04-29 17:23:26,170] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 24: [2023-04-29 17:23:26,173] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 0: [2023-04-29 17:23:26,175] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 0: [2023-04-29 17:23:26,175] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 18: [2023-04-29 17:23:26,177] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 18: [2023-04-29 17:23:26,177] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 18: [2023-04-29 17:23:26,177] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 27: [2023-04-29 17:23:26,179] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 0: [2023-04-29 17:23:26,179] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 0: [2023-04-29 17:23:26,179] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 4: [2023-04-29 17:23:26,181] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 15: [2023-04-29 17:23:26,186] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 15: [2023-04-29 17:23:26,186] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 15: [2023-04-29 17:23:26,186] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 26: [2023-04-29 17:23:26,186] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 26: [2023-04-29 17:23:26,186] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 15: [2023-04-29 17:23:26,186] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 26: [2023-04-29 17:23:26,187] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 26: [2023-04-29 17:23:26,187] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 4: [2023-04-29 17:23:26,188] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 18: [2023-04-29 17:23:26,189] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 26: [2023-04-29 17:23:26,189] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 26: [2023-04-29 17:23:26,189] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 26: [2023-04-29 17:23:26,189] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 26: [2023-04-29 17:23:26,189] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 15: [2023-04-29 17:23:26,189] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 15: [2023-04-29 17:23:26,189] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 15: [2023-04-29 17:23:26,189] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 15: [2023-04-29 17:23:26,189] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 18: [2023-04-29 17:23:26,190] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 18: [2023-04-29 17:23:26,190] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 18: [2023-04-29 17:23:26,190] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 18: [2023-04-29 17:23:26,190] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 24: [2023-04-29 17:23:26,193] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 4: [2023-04-29 17:23:26,195] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 6: [2023-04-29 17:23:26,195] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 6: [2023-04-29 17:23:26,196] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 6: [2023-04-29 17:23:26,196] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 6: [2023-04-29 17:23:26,197] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 6: [2023-04-29 17:23:26,198] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 24: [2023-04-29 17:23:26,199] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 24: [2023-04-29 17:23:26,200] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 24: [2023-04-29 17:23:26,200] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 0: [2023-04-29 17:23:26,200] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 0: [2023-04-29 17:23:26,200] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 6: [2023-04-29 17:23:26,201] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 18: [2023-04-29 17:23:26,202] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 27: [2023-04-29 17:23:26,202] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 27: [2023-04-29 17:23:26,202] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 27: [2023-04-29 17:23:26,202] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 0: [2023-04-29 17:23:26,203] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 4: [2023-04-29 17:23:26,203] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 18: [2023-04-29 17:23:26,203] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 27: [2023-04-29 17:23:26,205] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 27: [2023-04-29 17:23:26,206] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 27: [2023-04-29 17:23:26,206] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 27: [2023-04-29 17:23:26,206] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 18: [2023-04-29 17:23:26,207] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 28: [2023-04-29 17:23:26,209] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 4: [2023-04-29 17:23:26,210] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 4: [2023-04-29 17:23:26,210] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 4: [2023-04-29 17:23:26,212] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 4: [2023-04-29 17:23:26,212] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 28: [2023-04-29 17:23:26,212] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 4: [2023-04-29 17:23:26,213] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 20: [2023-04-29 17:23:26,213] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 20: [2023-04-29 17:23:26,214] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 20: [2023-04-29 17:23:26,214] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 28: [2023-04-29 17:23:26,214] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 20: [2023-04-29 17:23:26,214] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 20: [2023-04-29 17:23:26,214] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 20: [2023-04-29 17:23:26,214] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 20: [2023-04-29 17:23:26,214] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 20: [2023-04-29 17:23:26,214] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 28: [2023-04-29 17:23:26,215] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 24: [2023-04-29 17:23:26,217] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 24: [2023-04-29 17:23:26,217] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 24: [2023-04-29 17:23:26,217] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 22: [2023-04-29 17:23:26,217] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 22: [2023-04-29 17:23:26,217] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 22: [2023-04-29 17:23:26,219] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 22: [2023-04-29 17:23:26,219] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 22: [2023-04-29 17:23:26,219] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 26: [2023-04-29 17:23:26,219] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 22: [2023-04-29 17:23:26,219] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 22: [2023-04-29 17:23:26,219] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 22: [2023-04-29 17:23:26,220] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 26: [2023-04-29 17:23:26,220] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 20: [2023-04-29 17:23:26,220] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 20: [2023-04-29 17:23:26,221] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 20: [2023-04-29 17:23:26,221] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 15: [2023-04-29 17:23:26,221] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 20: [2023-04-29 17:23:26,221] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 22: [2023-04-29 17:23:26,222] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 4: [2023-04-29 17:23:26,222] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 22: [2023-04-29 17:23:26,222] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 18: [2023-04-29 17:23:26,222] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 26: [2023-04-29 17:23:26,223] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 18: [2023-04-29 17:23:26,223] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 26: [2023-04-29 17:23:26,223] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 15: [2023-04-29 17:23:26,223] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 18: [2023-04-29 17:23:26,223] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 20: [2023-04-29 17:23:26,223] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 20: [2023-04-29 17:23:26,224] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 20: [2023-04-29 17:23:26,225] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 20: [2023-04-29 17:23:26,225] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 18: [2023-04-29 17:23:26,226] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 18: [2023-04-29 17:23:26,226] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 26: [2023-04-29 17:23:26,226] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 26: [2023-04-29 17:23:26,227] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 22: [2023-04-29 17:23:26,227] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 26: [2023-04-29 17:23:26,228] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 26: [2023-04-29 17:23:26,228] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 22: [2023-04-29 17:23:26,229] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 22: [2023-04-29 17:23:26,229] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 22: [2023-04-29 17:23:26,230] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 22: [2023-04-29 17:23:26,230] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 15: [2023-04-29 17:23:26,231] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 22: [2023-04-29 17:23:26,231] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 27: [2023-04-29 17:23:26,232] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 15: [2023-04-29 17:23:26,231] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 15: [2023-04-29 17:23:26,231] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 15: [2023-04-29 17:23:26,231] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 15: [2023-04-29 17:23:26,231] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 15: [2023-04-29 17:23:26,232] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 27: [2023-04-29 17:23:26,235] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 27: [2023-04-29 17:23:26,239] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 28: [2023-04-29 17:23:26,239] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 28: [2023-04-29 17:23:26,239] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 28: [2023-04-29 17:23:26,239] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 28: [2023-04-29 17:23:26,239] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_22-model_00-model_states.pt. 27: [2023-04-29 17:23:26,240] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 4: [2023-04-29 17:23:26,243] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 28: [2023-04-29 17:23:26,242] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 28: [2023-04-29 17:23:26,242] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 27: [2023-04-29 17:23:26,243] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 27: [2023-04-29 17:23:26,244] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 28: [2023-04-29 17:23:26,244] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 27: [2023-04-29 17:23:26,245] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 28: [2023-04-29 17:23:26,246] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 4: [2023-04-29 17:23:26,246] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 4: [2023-04-29 17:23:26,246] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 4: [2023-04-29 17:23:26,248] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 4: [2023-04-29 17:23:26,249] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 16: [2023-04-29 17:23:26,251] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 16: [2023-04-29 17:23:26,251] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 16: [2023-04-29 17:23:26,251] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 16: [2023-04-29 17:23:26,252] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 16: [2023-04-29 17:23:26,252] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 16: [2023-04-29 17:23:26,252] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 16: [2023-04-29 17:23:26,252] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 16: [2023-04-29 17:23:26,252] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 21: [2023-04-29 17:23:26,254] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 21: [2023-04-29 17:23:26,254] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 21: [2023-04-29 17:23:26,254] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 21: [2023-04-29 17:23:26,254] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 21: [2023-04-29 17:23:26,254] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 21: [2023-04-29 17:23:26,254] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 21: [2023-04-29 17:23:26,254] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 21: [2023-04-29 17:23:26,255] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 16: [2023-04-29 17:23:26,255] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 16: [2023-04-29 17:23:26,257] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 21: [2023-04-29 17:23:26,258] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 16: [2023-04-29 17:23:26,258] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 16: [2023-04-29 17:23:26,258] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 16: [2023-04-29 17:23:26,258] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 24: [2023-04-29 17:23:26,228] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 24: [2023-04-29 17:23:26,229] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 24: [2023-04-29 17:23:26,229] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 24: [2023-04-29 17:23:26,231] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 24: [2023-04-29 17:23:26,244] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 24: [2023-04-29 17:23:26,246] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 24: [2023-04-29 17:23:26,248] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 16: [2023-04-29 17:23:26,259] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 16: [2023-04-29 17:23:26,259] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 16: [2023-04-29 17:23:26,259] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 21: [2023-04-29 17:23:26,259] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 21: [2023-04-29 17:23:26,259] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 21: [2023-04-29 17:23:26,260] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 21: [2023-04-29 17:23:26,260] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 21: [2023-04-29 17:23:26,261] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 21: [2023-04-29 17:23:26,261] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 21: [2023-04-29 17:23:26,262] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 28: [2023-04-29 17:23:26,269] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 28: [2023-04-29 17:23:26,273] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 28: [2023-04-29 17:23:26,274] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 28: [2023-04-29 17:23:26,274] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 22: [2023-04-29 17:23:26,275] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 22: [2023-04-29 17:23:26,275] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 20: [2023-04-29 17:23:26,276] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 20: [2023-04-29 17:23:26,276] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 20: [2023-04-29 17:23:26,276] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 20: [2023-04-29 17:23:26,277] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 17: [2023-04-29 17:23:26,281] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 17: [2023-04-29 17:23:26,281] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 17: [2023-04-29 17:23:26,282] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 17: [2023-04-29 17:23:26,282] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 17: [2023-04-29 17:23:26,282] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 17: [2023-04-29 17:23:26,282] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 17: [2023-04-29 17:23:26,282] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 17: [2023-04-29 17:23:26,283] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 17: [2023-04-29 17:23:26,287] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 17: [2023-04-29 17:23:26,288] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 17: [2023-04-29 17:23:26,289] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 17: [2023-04-29 17:23:26,291] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 17: [2023-04-29 17:23:26,292] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 1: [2023-04-29 17:23:26,293] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 1: [2023-04-29 17:23:26,293] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 17: [2023-04-29 17:23:26,293] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 20: [2023-04-29 17:23:26,293] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 20: [2023-04-29 17:23:26,293] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 17: [2023-04-29 17:23:26,293] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 20: [2023-04-29 17:23:26,293] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 20: [2023-04-29 17:23:26,293] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 17: [2023-04-29 17:23:26,293] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 1: [2023-04-29 17:23:26,293] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 1: [2023-04-29 17:23:26,293] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 1: [2023-04-29 17:23:26,294] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 1: [2023-04-29 17:23:26,294] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 1: [2023-04-29 17:23:26,294] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 1: [2023-04-29 17:23:26,294] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 22: [2023-04-29 17:23:26,295] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 22: [2023-04-29 17:23:26,296] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 22: [2023-04-29 17:23:26,296] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 1: [2023-04-29 17:23:26,299] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 1: [2023-04-29 17:23:26,299] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 22: [2023-04-29 17:23:26,299] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 1: [2023-04-29 17:23:26,299] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 1: [2023-04-29 17:23:26,300] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 1: [2023-04-29 17:23:26,300] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 1: [2023-04-29 17:23:26,300] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 1: [2023-04-29 17:23:26,300] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 22: [2023-04-29 17:23:26,300] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 22: [2023-04-29 17:23:26,300] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 22: [2023-04-29 17:23:26,300] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 1: [2023-04-29 17:23:26,301] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 20: [2023-04-29 17:23:26,301] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 20: [2023-04-29 17:23:26,303] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 24: [2023-04-29 17:23:26,259] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 20: [2023-04-29 17:23:26,304] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 20: [2023-04-29 17:23:26,304] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 16: [2023-04-29 17:23:26,304] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 21: [2023-04-29 17:23:26,305] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 22: [2023-04-29 17:23:26,305] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 16: [2023-04-29 17:23:26,312] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 21: [2023-04-29 17:23:26,315] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 16: [2023-04-29 17:23:26,318] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 21: [2023-04-29 17:23:26,318] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 20: [2023-04-29 17:23:26,322] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 22: [2023-04-29 17:23:26,324] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 20: [2023-04-29 17:23:26,325] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 21: [2023-04-29 17:23:26,325] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 20: [2023-04-29 17:23:26,325] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 20: [2023-04-29 17:23:26,325] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 16: [2023-04-29 17:23:26,326] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 16: [2023-04-29 17:23:26,326] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 16: [2023-04-29 17:23:26,326] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 16: [2023-04-29 17:23:26,326] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 16: [2023-04-29 17:23:26,326] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 16: [2023-04-29 17:23:26,329] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 21: [2023-04-29 17:23:26,329] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 21: [2023-04-29 17:23:26,329] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 21: [2023-04-29 17:23:26,329] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 21: [2023-04-29 17:23:26,329] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 21: [2023-04-29 17:23:26,329] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 22: [2023-04-29 17:23:26,331] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 10: [2023-04-29 17:23:26,333] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 10: [2023-04-29 17:23:26,333] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 10: [2023-04-29 17:23:26,334] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 10: [2023-04-29 17:23:26,334] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 22: [2023-04-29 17:23:26,334] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 10: [2023-04-29 17:23:26,334] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 10: [2023-04-29 17:23:26,334] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 10: [2023-04-29 17:23:26,334] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 10: [2023-04-29 17:23:26,335] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 22: [2023-04-29 17:23:26,336] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 16: [2023-04-29 17:23:26,336] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 10: [2023-04-29 17:23:26,338] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 22: [2023-04-29 17:23:26,338] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 22: [2023-04-29 17:23:26,338] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 10: [2023-04-29 17:23:26,339] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 10: [2023-04-29 17:23:26,339] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 10: [2023-04-29 17:23:26,340] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 10: [2023-04-29 17:23:26,342] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 10: [2023-04-29 17:23:26,343] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 10: [2023-04-29 17:23:26,344] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 10: [2023-04-29 17:23:26,344] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 16: [2023-04-29 17:23:26,344] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 17: [2023-04-29 17:23:26,345] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 17: [2023-04-29 17:23:26,346] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 1: [2023-04-29 17:23:26,347] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 7: [2023-04-29 17:23:26,350] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 7: [2023-04-29 17:23:26,350] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 7: [2023-04-29 17:23:26,350] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 7: [2023-04-29 17:23:26,350] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 7: [2023-04-29 17:23:26,350] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 7: [2023-04-29 17:23:26,350] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 7: [2023-04-29 17:23:26,350] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 7: [2023-04-29 17:23:26,350] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 17: [2023-04-29 17:23:26,351] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 16: [2023-04-29 17:23:26,355] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 16: [2023-04-29 17:23:26,355] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 7: [2023-04-29 17:23:26,355] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 7: [2023-04-29 17:23:26,355] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 7: [2023-04-29 17:23:26,355] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 14: [2023-04-29 17:23:26,355] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 16: [2023-04-29 17:23:26,355] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 14: [2023-04-29 17:23:26,355] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 14: [2023-04-29 17:23:26,356] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 14: [2023-04-29 17:23:26,356] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 14: [2023-04-29 17:23:26,356] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 14: [2023-04-29 17:23:26,356] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 14: [2023-04-29 17:23:26,356] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 14: [2023-04-29 17:23:26,356] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 7: [2023-04-29 17:23:26,357] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 7: [2023-04-29 17:23:26,357] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 16: [2023-04-29 17:23:26,357] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 7: [2023-04-29 17:23:26,357] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 7: [2023-04-29 17:23:26,357] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 17: [2023-04-29 17:23:26,358] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 7: [2023-04-29 17:23:26,358] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 16: [2023-04-29 17:23:26,358] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 1: [2023-04-29 17:23:26,360] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 1: [2023-04-29 17:23:26,360] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 1: [2023-04-29 17:23:26,360] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 1: [2023-04-29 17:23:26,360] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 14: [2023-04-29 17:23:26,359] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 14: [2023-04-29 17:23:26,360] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 14: [2023-04-29 17:23:26,362] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 1: [2023-04-29 17:23:26,363] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 1: [2023-04-29 17:23:26,363] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 1: [2023-04-29 17:23:26,363] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 14: [2023-04-29 17:23:26,366] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 14: [2023-04-29 17:23:26,367] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 17: [2023-04-29 17:23:26,367] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 14: [2023-04-29 17:23:26,367] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 1: [2023-04-29 17:23:26,368] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 8: [2023-04-29 17:23:26,368] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 8: [2023-04-29 17:23:26,368] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 8: [2023-04-29 17:23:26,368] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 14: [2023-04-29 17:23:26,368] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 8: [2023-04-29 17:23:26,368] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 17: [2023-04-29 17:23:26,368] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 17: [2023-04-29 17:23:26,368] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 8: [2023-04-29 17:23:26,368] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 8: [2023-04-29 17:23:26,368] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 8: [2023-04-29 17:23:26,368] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 8: [2023-04-29 17:23:26,368] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 14: [2023-04-29 17:23:26,369] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 25: [2023-04-29 17:23:26,371] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 25: [2023-04-29 17:23:26,371] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 21: [2023-04-29 17:23:26,340] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 21: [2023-04-29 17:23:26,341] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 21: [2023-04-29 17:23:26,353] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 21: [2023-04-29 17:23:26,354] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 21: [2023-04-29 17:23:26,356] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 21: [2023-04-29 17:23:26,359] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 21: [2023-04-29 17:23:26,359] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 17: [2023-04-29 17:23:26,371] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 8: [2023-04-29 17:23:26,374] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 25: [2023-04-29 17:23:26,374] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 8: [2023-04-29 17:23:26,375] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 29: [2023-04-29 17:23:26,374] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 25: [2023-04-29 17:23:26,375] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 25: [2023-04-29 17:23:26,375] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 25: [2023-04-29 17:23:26,375] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 25: [2023-04-29 17:23:26,375] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 25: [2023-04-29 17:23:26,375] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 25: [2023-04-29 17:23:26,375] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 25: [2023-04-29 17:23:26,375] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 29: [2023-04-29 17:23:26,375] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 8: [2023-04-29 17:23:26,375] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 8: [2023-04-29 17:23:26,376] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 8: [2023-04-29 17:23:26,377] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 17: [2023-04-29 17:23:26,377] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 8: [2023-04-29 17:23:26,377] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 17: [2023-04-29 17:23:26,377] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 8: [2023-04-29 17:23:26,378] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 8: [2023-04-29 17:23:26,378] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 29: [2023-04-29 17:23:26,379] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 29: [2023-04-29 17:23:26,379] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 29: [2023-04-29 17:23:26,380] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 29: [2023-04-29 17:23:26,380] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 29: [2023-04-29 17:23:26,380] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 29: [2023-04-29 17:23:26,380] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 29: [2023-04-29 17:23:26,380] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 5: [2023-04-29 17:23:26,380] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 5: [2023-04-29 17:23:26,380] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 5: [2023-04-29 17:23:26,380] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 5: [2023-04-29 17:23:26,380] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 5: [2023-04-29 17:23:26,381] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 5: [2023-04-29 17:23:26,381] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 5: [2023-04-29 17:23:26,381] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 5: [2023-04-29 17:23:26,381] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 17: [2023-04-29 17:23:26,382] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 29: [2023-04-29 17:23:26,383] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 29: [2023-04-29 17:23:26,384] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 5: [2023-04-29 17:23:26,383] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 5: [2023-04-29 17:23:26,384] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 25: [2023-04-29 17:23:26,385] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 25: [2023-04-29 17:23:26,386] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 5: [2023-04-29 17:23:26,386] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 1: [2023-04-29 17:23:26,386] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 25: [2023-04-29 17:23:26,386] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 25: [2023-04-29 17:23:26,386] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 1: [2023-04-29 17:23:26,386] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 1: [2023-04-29 17:23:26,386] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 1: [2023-04-29 17:23:26,387] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 17: [2023-04-29 17:23:26,387] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 29: [2023-04-29 17:23:26,386] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 25: [2023-04-29 17:23:26,387] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 25: [2023-04-29 17:23:26,387] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 6: [2023-04-29 17:23:26,387] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 6: [2023-04-29 17:23:26,387] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 6: [2023-04-29 17:23:26,388] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 6: [2023-04-29 17:23:26,388] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 6: [2023-04-29 17:23:26,388] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 6: [2023-04-29 17:23:26,388] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 6: [2023-04-29 17:23:26,388] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 6: [2023-04-29 17:23:26,388] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 29: [2023-04-29 17:23:26,389] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 10: [2023-04-29 17:23:26,389] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 10: [2023-04-29 17:23:26,389] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 5: [2023-04-29 17:23:26,389] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 29: [2023-04-29 17:23:26,390] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 29: [2023-04-29 17:23:26,390] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 5: [2023-04-29 17:23:26,391] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 5: [2023-04-29 17:23:26,391] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 29: [2023-04-29 17:23:26,391] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 5: [2023-04-29 17:23:26,391] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 6: [2023-04-29 17:23:26,392] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 6: [2023-04-29 17:23:26,392] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 1: [2023-04-29 17:23:26,393] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 1: [2023-04-29 17:23:26,393] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 1: [2023-04-29 17:23:26,393] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 5: [2023-04-29 17:23:26,393] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 19: [2023-04-29 17:23:26,393] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 19: [2023-04-29 17:23:26,393] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 19: [2023-04-29 17:23:26,394] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 19: [2023-04-29 17:23:26,395] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 19: [2023-04-29 17:23:26,395] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 19: [2023-04-29 17:23:26,395] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 19: [2023-04-29 17:23:26,395] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 19: [2023-04-29 17:23:26,395] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 6: [2023-04-29 17:23:26,396] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 17: [2023-04-29 17:23:26,397] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 6: [2023-04-29 17:23:26,397] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 17: [2023-04-29 17:23:26,398] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 6: [2023-04-29 17:23:26,398] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 19: [2023-04-29 17:23:26,398] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 19: [2023-04-29 17:23:26,398] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 19: [2023-04-29 17:23:26,398] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 6: [2023-04-29 17:23:26,398] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 6: [2023-04-29 17:23:26,399] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 10: [2023-04-29 17:23:26,399] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 10: [2023-04-29 17:23:26,399] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 6: [2023-04-29 17:23:26,399] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 7: [2023-04-29 17:23:26,400] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 10: [2023-04-29 17:23:26,402] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 10: [2023-04-29 17:23:26,402] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 19: [2023-04-29 17:23:26,403] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 19: [2023-04-29 17:23:26,404] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 19: [2023-04-29 17:23:26,404] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 19: [2023-04-29 17:23:26,405] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 19: [2023-04-29 17:23:26,405] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 10: [2023-04-29 17:23:26,406] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 10: [2023-04-29 17:23:26,406] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 17: [2023-04-29 17:23:26,408] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 7: [2023-04-29 17:23:26,409] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 7: [2023-04-29 17:23:26,410] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 17: [2023-04-29 17:23:26,411] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 14: [2023-04-29 17:23:26,412] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 10: [2023-04-29 17:23:26,413] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 14: [2023-04-29 17:23:26,413] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 10: [2023-04-29 17:23:26,413] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 25: [2023-04-29 17:23:26,417] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 14: [2023-04-29 17:23:26,420] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 7: [2023-04-29 17:23:26,421] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 7: [2023-04-29 17:23:26,424] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 7: [2023-04-29 17:23:26,424] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 7: [2023-04-29 17:23:26,424] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 7: [2023-04-29 17:23:26,424] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 7: [2023-04-29 17:23:26,424] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 12: [2023-04-29 17:23:26,424] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 12: [2023-04-29 17:23:26,424] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 10: [2023-04-29 17:23:26,426] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 10: [2023-04-29 17:23:26,426] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 8: [2023-04-29 17:23:26,427] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 12: [2023-04-29 17:23:26,426] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 12: [2023-04-29 17:23:26,426] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 12: [2023-04-29 17:23:26,426] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 12: [2023-04-29 17:23:26,426] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 12: [2023-04-29 17:23:26,426] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 12: [2023-04-29 17:23:26,426] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 25: [2023-04-29 17:23:26,430] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 8: [2023-04-29 17:23:26,430] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 8: [2023-04-29 17:23:26,431] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 8: [2023-04-29 17:23:26,431] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 12: [2023-04-29 17:23:26,430] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 5: [2023-04-29 17:23:26,430] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 7: [2023-04-29 17:23:26,431] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 10: [2023-04-29 17:23:26,431] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 12: [2023-04-29 17:23:26,431] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 12: [2023-04-29 17:23:26,431] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 12: [2023-04-29 17:23:26,432] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 14: [2023-04-29 17:23:26,432] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 14: [2023-04-29 17:23:26,432] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 10: [2023-04-29 17:23:26,433] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 12: [2023-04-29 17:23:26,433] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 12: [2023-04-29 17:23:26,433] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 10: [2023-04-29 17:23:26,433] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 12: [2023-04-29 17:23:26,433] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 7: [2023-04-29 17:23:26,433] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 29: [2023-04-29 17:23:26,433] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 29: [2023-04-29 17:23:26,433] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 10: [2023-04-29 17:23:26,434] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 12: [2023-04-29 17:23:26,435] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 25: [2023-04-29 17:23:26,437] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 5: [2023-04-29 17:23:26,440] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 3: [2023-04-29 17:23:26,440] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 3: [2023-04-29 17:23:26,440] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 8: [2023-04-29 17:23:26,444] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 8: [2023-04-29 17:23:26,444] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 3: [2023-04-29 17:23:26,444] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 3: [2023-04-29 17:23:26,445] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 8: [2023-04-29 17:23:26,445] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 19: [2023-04-29 17:23:26,445] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 6: [2023-04-29 17:23:26,445] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 14: [2023-04-29 17:23:26,445] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 3: [2023-04-29 17:23:26,445] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 3: [2023-04-29 17:23:26,445] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 3: [2023-04-29 17:23:26,445] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 3: [2023-04-29 17:23:26,446] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 3: [2023-04-29 17:23:26,446] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 3: [2023-04-29 17:23:26,446] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 14: [2023-04-29 17:23:26,447] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 8: [2023-04-29 17:23:26,447] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 6: [2023-04-29 17:23:26,446] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 13: [2023-04-29 17:23:26,448] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 13: [2023-04-29 17:23:26,448] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 14: [2023-04-29 17:23:26,448] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 14: [2023-04-29 17:23:26,448] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 14: [2023-04-29 17:23:26,449] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 14: [2023-04-29 17:23:26,449] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 13: [2023-04-29 17:23:26,449] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 13: [2023-04-29 17:23:26,449] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 7: [2023-04-29 17:23:26,449] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 13: [2023-04-29 17:23:26,449] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 5: [2023-04-29 17:23:26,449] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 13: [2023-04-29 17:23:26,450] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 13: [2023-04-29 17:23:26,450] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 25: [2023-04-29 17:23:26,450] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 13: [2023-04-29 17:23:26,450] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 5: [2023-04-29 17:23:26,450] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 5: [2023-04-29 17:23:26,451] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 7: [2023-04-29 17:23:26,452] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 7: [2023-04-29 17:23:26,452] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 30: [2023-04-29 17:23:26,453] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 29: [2023-04-29 17:23:26,453] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 30: [2023-04-29 17:23:26,454] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 30: [2023-04-29 17:23:26,454] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 30: [2023-04-29 17:23:26,454] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 30: [2023-04-29 17:23:26,454] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 30: [2023-04-29 17:23:26,454] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 30: [2023-04-29 17:23:26,454] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 7: [2023-04-29 17:23:26,454] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 7: [2023-04-29 17:23:26,454] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 30: [2023-04-29 17:23:26,454] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 29: [2023-04-29 17:23:26,454] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 3: [2023-04-29 17:23:26,454] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 3: [2023-04-29 17:23:26,454] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 3: [2023-04-29 17:23:26,455] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 13: [2023-04-29 17:23:26,455] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 8: [2023-04-29 17:23:26,455] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 3: [2023-04-29 17:23:26,455] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 3: [2023-04-29 17:23:26,456] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 3: [2023-04-29 17:23:26,456] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 13: [2023-04-29 17:23:26,456] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 23: [2023-04-29 17:23:26,456] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 23: [2023-04-29 17:23:26,456] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 8: [2023-04-29 17:23:26,457] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 8: [2023-04-29 17:23:26,457] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 8: [2023-04-29 17:23:26,457] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 25: [2023-04-29 17:23:26,457] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 25: [2023-04-29 17:23:26,457] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 25: [2023-04-29 17:23:26,457] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 25: [2023-04-29 17:23:26,457] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 25: [2023-04-29 17:23:26,457] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 25: [2023-04-29 17:23:26,458] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 13: [2023-04-29 17:23:26,457] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 13: [2023-04-29 17:23:26,458] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 23: [2023-04-29 17:23:26,458] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 13: [2023-04-29 17:23:26,458] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 23: [2023-04-29 17:23:26,458] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 29: [2023-04-29 17:23:26,458] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 23: [2023-04-29 17:23:26,458] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 19: [2023-04-29 17:23:26,458] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 19: [2023-04-29 17:23:26,458] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 23: [2023-04-29 17:23:26,459] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 23: [2023-04-29 17:23:26,459] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 23: [2023-04-29 17:23:26,459] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 13: [2023-04-29 17:23:26,460] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 13: [2023-04-29 17:23:26,460] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 13: [2023-04-29 17:23:26,461] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 5: [2023-04-29 17:23:26,461] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 29: [2023-04-29 17:23:26,461] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 29: [2023-04-29 17:23:26,462] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 6: [2023-04-29 17:23:26,462] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 0: [2023-04-29 17:23:26,462] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 0: [2023-04-29 17:23:26,462] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 0: [2023-04-29 17:23:26,462] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 0: [2023-04-29 17:23:26,463] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 0: [2023-04-29 17:23:26,463] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 0: [2023-04-29 17:23:26,463] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 0: [2023-04-29 17:23:26,463] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 0: [2023-04-29 17:23:26,463] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 30: [2023-04-29 17:23:26,463] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 30: [2023-04-29 17:23:26,463] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 23: [2023-04-29 17:23:26,463] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 19: [2023-04-29 17:23:26,464] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 23: [2023-04-29 17:23:26,464] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 30: [2023-04-29 17:23:26,464] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 23: [2023-04-29 17:23:26,465] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 23: [2023-04-29 17:23:26,465] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 30: [2023-04-29 17:23:26,465] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 19: [2023-04-29 17:23:26,465] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 30: [2023-04-29 17:23:26,465] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 29: [2023-04-29 17:23:26,465] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 30: [2023-04-29 17:23:26,466] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 30: [2023-04-29 17:23:26,467] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 29: [2023-04-29 17:23:26,467] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 30: [2023-04-29 17:23:26,467] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 29: [2023-04-29 17:23:26,468] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 23: [2023-04-29 17:23:26,468] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 6: [2023-04-29 17:23:26,468] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 6: [2023-04-29 17:23:26,468] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 23: [2023-04-29 17:23:26,469] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 23: [2023-04-29 17:23:26,469] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 6: [2023-04-29 17:23:26,469] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 23: [2023-04-29 17:23:26,469] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 0: [2023-04-29 17:23:26,470] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 8: [2023-04-29 17:23:26,471] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 8: [2023-04-29 17:23:26,471] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 5: [2023-04-29 17:23:26,472] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 8: [2023-04-29 17:23:26,473] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 19: [2023-04-29 17:23:26,473] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 5: [2023-04-29 17:23:26,473] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 5: [2023-04-29 17:23:26,473] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 5: [2023-04-29 17:23:26,473] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 0: [2023-04-29 17:23:26,475] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 8: [2023-04-29 17:23:26,476] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 18: [2023-04-29 17:23:26,475] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 18: [2023-04-29 17:23:26,475] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 18: [2023-04-29 17:23:26,475] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 18: [2023-04-29 17:23:26,476] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 18: [2023-04-29 17:23:26,476] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 18: [2023-04-29 17:23:26,476] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 18: [2023-04-29 17:23:26,476] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 0: [2023-04-29 17:23:26,476] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 18: [2023-04-29 17:23:26,476] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 0: [2023-04-29 17:23:26,476] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 2: [2023-04-29 17:23:26,476] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 2: [2023-04-29 17:23:26,476] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 0: [2023-04-29 17:23:26,476] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 5: [2023-04-29 17:23:26,476] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 14: [2023-04-29 17:23:26,476] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 27: [2023-04-29 17:23:26,476] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 19: [2023-04-29 17:23:26,477] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 19: [2023-04-29 17:23:26,477] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 19: [2023-04-29 17:23:26,477] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 0: [2023-04-29 17:23:26,477] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 27: [2023-04-29 17:23:26,477] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 0: [2023-04-29 17:23:26,477] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 27: [2023-04-29 17:23:26,477] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 27: [2023-04-29 17:23:26,477] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 27: [2023-04-29 17:23:26,477] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 27: [2023-04-29 17:23:26,477] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 27: [2023-04-29 17:23:26,477] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 14: [2023-04-29 17:23:26,477] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 27: [2023-04-29 17:23:26,477] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 24: [2023-04-29 17:23:26,477] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 6: [2023-04-29 17:23:26,478] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 6: [2023-04-29 17:23:26,478] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 6: [2023-04-29 17:23:26,478] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 6: [2023-04-29 17:23:26,478] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 5: [2023-04-29 17:23:26,478] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 24: [2023-04-29 17:23:26,478] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 24: [2023-04-29 17:23:26,478] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 24: [2023-04-29 17:23:26,478] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 24: [2023-04-29 17:23:26,478] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 24: [2023-04-29 17:23:26,478] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 24: [2023-04-29 17:23:26,478] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 0: [2023-04-29 17:23:26,478] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 2: [2023-04-29 17:23:26,478] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 12: [2023-04-29 17:23:26,479] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 2: [2023-04-29 17:23:26,479] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 2: [2023-04-29 17:23:26,479] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 2: [2023-04-29 17:23:26,479] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 2: [2023-04-29 17:23:26,479] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 2: [2023-04-29 17:23:26,479] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 14: [2023-04-29 17:23:26,480] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 2: [2023-04-29 17:23:26,480] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 12: [2023-04-29 17:23:26,480] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 27: [2023-04-29 17:23:26,480] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 2: [2023-04-29 17:23:26,481] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 19: [2023-04-29 17:23:26,482] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 19: [2023-04-29 17:23:26,482] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 14: [2023-04-29 17:23:26,483] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 14: [2023-04-29 17:23:26,483] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 18: [2023-04-29 17:23:26,484] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 2: [2023-04-29 17:23:26,484] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 6: [2023-04-29 17:23:26,486] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 4: [2023-04-29 17:23:26,487] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 4: [2023-04-29 17:23:26,487] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 2: [2023-04-29 17:23:26,487] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 3: [2023-04-29 17:23:26,487] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 18: [2023-04-29 17:23:26,488] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 29: [2023-04-29 17:23:26,488] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 18: [2023-04-29 17:23:26,488] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 2: [2023-04-29 17:23:26,488] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 2: [2023-04-29 17:23:26,488] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 2: [2023-04-29 17:23:26,489] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 18: [2023-04-29 17:23:26,489] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 27: [2023-04-29 17:23:26,489] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 27: [2023-04-29 17:23:26,489] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 18: [2023-04-29 17:23:26,489] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 27: [2023-04-29 17:23:26,489] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 18: [2023-04-29 17:23:26,489] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 2: [2023-04-29 17:23:26,490] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 27: [2023-04-29 17:23:26,490] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 18: [2023-04-29 17:23:26,490] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 25: [2023-04-29 17:23:26,490] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 19: [2023-04-29 17:23:26,491] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 27: [2023-04-29 17:23:26,491] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 25: [2023-04-29 17:23:26,491] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 4: [2023-04-29 17:23:26,491] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 4: [2023-04-29 17:23:26,491] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 4: [2023-04-29 17:23:26,491] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 4: [2023-04-29 17:23:26,491] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 4: [2023-04-29 17:23:26,491] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 4: [2023-04-29 17:23:26,491] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 27: [2023-04-29 17:23:26,491] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 4: [2023-04-29 17:23:26,492] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 18: [2023-04-29 17:23:26,491] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 25: [2023-04-29 17:23:26,492] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 27: [2023-04-29 17:23:26,492] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 4: [2023-04-29 17:23:26,492] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 25: [2023-04-29 17:23:26,494] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 11: [2023-04-29 17:23:26,496] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 11: [2023-04-29 17:23:26,496] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 25: [2023-04-29 17:23:26,496] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 25: [2023-04-29 17:23:26,496] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 29: [2023-04-29 17:23:26,497] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 29: [2023-04-29 17:23:26,498] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 3: [2023-04-29 17:23:26,498] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 11: [2023-04-29 17:23:26,498] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 11: [2023-04-29 17:23:26,499] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 11: [2023-04-29 17:23:26,499] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 11: [2023-04-29 17:23:26,499] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 11: [2023-04-29 17:23:26,499] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 11: [2023-04-29 17:23:26,499] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 4: [2023-04-29 17:23:26,500] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 11: [2023-04-29 17:23:26,501] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 11: [2023-04-29 17:23:26,501] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 12: [2023-04-29 17:23:26,501] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 13: [2023-04-29 17:23:26,501] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 5: [2023-04-29 17:23:26,501] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 5: [2023-04-29 17:23:26,502] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 29: [2023-04-29 17:23:26,502] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 4: [2023-04-29 17:23:26,501] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 4: [2023-04-29 17:23:26,501] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 12: [2023-04-29 17:23:26,502] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 4: [2023-04-29 17:23:26,502] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 12: [2023-04-29 17:23:26,502] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 12: [2023-04-29 17:23:26,502] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 12: [2023-04-29 17:23:26,502] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 12: [2023-04-29 17:23:26,502] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 6: [2023-04-29 17:23:26,502] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 5: [2023-04-29 17:23:26,503] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 12: [2023-04-29 17:23:26,503] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 19: [2023-04-29 17:23:26,503] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 11: [2023-04-29 17:23:26,503] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 31: [2023-04-29 17:23:26,503] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 31: [2023-04-29 17:23:26,503] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 31: [2023-04-29 17:23:26,503] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 31: [2023-04-29 17:23:26,503] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 31: [2023-04-29 17:23:26,503] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 31: [2023-04-29 17:23:26,503] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 31: [2023-04-29 17:23:26,503] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 4: [2023-04-29 17:23:26,503] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 31: [2023-04-29 17:23:26,504] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 4: [2023-04-29 17:23:26,504] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 12: [2023-04-29 17:23:26,504] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 5: [2023-04-29 17:23:26,505] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 19: [2023-04-29 17:23:26,506] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 11: [2023-04-29 17:23:26,506] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 19: [2023-04-29 17:23:26,507] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 19: [2023-04-29 17:23:26,507] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 29: [2023-04-29 17:23:26,507] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 29: [2023-04-29 17:23:26,507] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 11: [2023-04-29 17:23:26,508] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 31: [2023-04-29 17:23:26,508] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 31: [2023-04-29 17:23:26,508] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 31: [2023-04-29 17:23:26,508] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 31: [2023-04-29 17:23:26,508] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 11: [2023-04-29 17:23:26,508] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 11: [2023-04-29 17:23:26,509] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 11: [2023-04-29 17:23:26,509] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 31: [2023-04-29 17:23:26,509] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 31: [2023-04-29 17:23:26,510] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 31: [2023-04-29 17:23:26,510] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 31: [2023-04-29 17:23:26,510] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 6: [2023-04-29 17:23:26,511] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 13: [2023-04-29 17:23:26,512] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 6: [2023-04-29 17:23:26,514] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 3: [2023-04-29 17:23:26,514] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 6: [2023-04-29 17:23:26,515] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 6: [2023-04-29 17:23:26,515] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 23: [2023-04-29 17:23:26,518] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 23: [2023-04-29 17:23:26,518] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 24: [2023-04-29 17:23:26,479] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 24: [2023-04-29 17:23:26,482] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 13: [2023-04-29 17:23:26,519] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 24: [2023-04-29 17:23:26,488] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 24: [2023-04-29 17:23:26,489] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 24: [2023-04-29 17:23:26,490] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 24: [2023-04-29 17:23:26,490] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 24: [2023-04-29 17:23:26,490] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 24: [2023-04-29 17:23:26,491] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 24: [2023-04-29 17:23:26,491] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 13: [2023-04-29 17:23:26,521] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 3: [2023-04-29 17:23:26,522] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 3: [2023-04-29 17:23:26,524] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 9: [2023-04-29 17:23:26,525] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 9: [2023-04-29 17:23:26,525] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 9: [2023-04-29 17:23:26,526] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 9: [2023-04-29 17:23:26,526] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 9: [2023-04-29 17:23:26,526] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 9: [2023-04-29 17:23:26,526] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 9: [2023-04-29 17:23:26,526] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 9: [2023-04-29 17:23:26,526] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 3: [2023-04-29 17:23:26,526] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 3: [2023-04-29 17:23:26,526] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 3: [2023-04-29 17:23:26,526] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 3: [2023-04-29 17:23:26,526] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 3: [2023-04-29 17:23:26,526] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 27: [2023-04-29 17:23:26,527] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 12: [2023-04-29 17:23:26,528] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 2: [2023-04-29 17:23:26,528] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 13: [2023-04-29 17:23:26,530] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 13: [2023-04-29 17:23:26,530] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 13: [2023-04-29 17:23:26,530] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 12: [2023-04-29 17:23:26,530] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 9: [2023-04-29 17:23:26,531] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 9: [2023-04-29 17:23:26,531] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 9: [2023-04-29 17:23:26,531] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 9: [2023-04-29 17:23:26,531] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 9: [2023-04-29 17:23:26,531] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 12: [2023-04-29 17:23:26,531] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 9: [2023-04-29 17:23:26,531] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 9: [2023-04-29 17:23:26,532] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 9: [2023-04-29 17:23:26,532] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 12: [2023-04-29 17:23:26,533] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 23: [2023-04-29 17:23:26,533] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 12: [2023-04-29 17:23:26,534] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 12: [2023-04-29 17:23:26,534] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 23: [2023-04-29 17:23:26,536] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 23: [2023-04-29 17:23:26,536] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 0: [2023-04-29 17:23:26,536] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 13: [2023-04-29 17:23:26,537] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 23: [2023-04-29 17:23:26,536] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 30: [2023-04-29 17:23:26,538] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 28: [2023-04-29 17:23:26,538] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 28: [2023-04-29 17:23:26,538] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 28: [2023-04-29 17:23:26,538] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 28: [2023-04-29 17:23:26,538] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 28: [2023-04-29 17:23:26,538] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 28: [2023-04-29 17:23:26,538] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 28: [2023-04-29 17:23:26,538] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 28: [2023-04-29 17:23:26,539] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 2: [2023-04-29 17:23:26,540] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 23: [2023-04-29 17:23:26,540] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 4: [2023-04-29 17:23:26,542] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 4: [2023-04-29 17:23:26,542] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 30: [2023-04-29 17:23:26,542] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 30: [2023-04-29 17:23:26,542] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 23: [2023-04-29 17:23:26,543] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 2: [2023-04-29 17:23:26,544] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 13: [2023-04-29 17:23:26,544] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 13: [2023-04-29 17:23:26,544] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 26: [2023-04-29 17:23:26,543] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 26: [2023-04-29 17:23:26,544] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 26: [2023-04-29 17:23:26,544] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 26: [2023-04-29 17:23:26,544] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 26: [2023-04-29 17:23:26,544] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 26: [2023-04-29 17:23:26,544] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 26: [2023-04-29 17:23:26,544] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 23: [2023-04-29 17:23:26,544] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 26: [2023-04-29 17:23:26,544] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 13: [2023-04-29 17:23:26,546] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 27: [2023-04-29 17:23:26,546] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 28: [2023-04-29 17:23:26,547] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 2: [2023-04-29 17:23:26,548] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 2: [2023-04-29 17:23:26,548] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 26: [2023-04-29 17:23:26,549] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 28: [2023-04-29 17:23:26,549] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 26: [2023-04-29 17:23:26,550] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 26: [2023-04-29 17:23:26,550] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 28: [2023-04-29 17:23:26,550] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 28: [2023-04-29 17:23:26,551] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 26: [2023-04-29 17:23:26,551] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 28: [2023-04-29 17:23:26,551] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 26: [2023-04-29 17:23:26,552] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 26: [2023-04-29 17:23:26,552] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 23: [2023-04-29 17:23:26,553] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 18: [2023-04-29 17:23:26,552] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 26: [2023-04-29 17:23:26,553] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 28: [2023-04-29 17:23:26,553] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 26: [2023-04-29 17:23:26,553] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 28: [2023-04-29 17:23:26,553] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 28: [2023-04-29 17:23:26,554] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 11: [2023-04-29 17:23:26,555] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 11: [2023-04-29 17:23:26,555] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 11: [2023-04-29 17:23:26,555] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 3: [2023-04-29 17:23:26,556] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 3: [2023-04-29 17:23:26,557] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 3: [2023-04-29 17:23:26,557] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 3: [2023-04-29 17:23:26,558] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 2: [2023-04-29 17:23:26,559] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 3: [2023-04-29 17:23:26,559] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 13: [2023-04-29 17:23:26,559] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 0: [2023-04-29 17:23:26,560] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 0: [2023-04-29 17:23:26,560] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 2: [2023-04-29 17:23:26,560] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 2: [2023-04-29 17:23:26,560] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 2: [2023-04-29 17:23:26,560] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 3: [2023-04-29 17:23:26,561] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 23: [2023-04-29 17:23:26,561] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 4: [2023-04-29 17:23:26,561] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 11: [2023-04-29 17:23:26,560] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 13: [2023-04-29 17:23:26,562] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 0: [2023-04-29 17:23:26,563] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 24: [2023-04-29 17:23:26,532] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 24: [2023-04-29 17:23:26,553] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 24: [2023-04-29 17:23:26,557] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 24: [2023-04-29 17:23:26,557] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 31: [2023-04-29 17:23:26,562] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 31: [2023-04-29 17:23:26,562] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 31: [2023-04-29 17:23:26,562] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 4: [2023-04-29 17:23:26,564] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 27: [2023-04-29 17:23:26,564] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 30: [2023-04-29 17:23:26,564] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 13: [2023-04-29 17:23:26,564] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 27: [2023-04-29 17:23:26,565] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 2: [2023-04-29 17:23:26,565] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 27: [2023-04-29 17:23:26,565] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 27: [2023-04-29 17:23:26,565] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 4: [2023-04-29 17:23:26,565] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 27: [2023-04-29 17:23:26,565] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 27: [2023-04-29 17:23:26,565] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 27: [2023-04-29 17:23:26,565] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 23: [2023-04-29 17:23:26,565] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 23: [2023-04-29 17:23:26,566] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 18: [2023-04-29 17:23:26,566] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 15: [2023-04-29 17:23:26,565] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 15: [2023-04-29 17:23:26,566] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 15: [2023-04-29 17:23:26,566] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 15: [2023-04-29 17:23:26,566] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 15: [2023-04-29 17:23:26,566] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 15: [2023-04-29 17:23:26,566] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 15: [2023-04-29 17:23:26,566] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 15: [2023-04-29 17:23:26,566] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 31: [2023-04-29 17:23:26,566] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 23: [2023-04-29 17:23:26,567] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 2: [2023-04-29 17:23:26,569] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 30: [2023-04-29 17:23:26,570] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 30: [2023-04-29 17:23:26,570] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 30: [2023-04-29 17:23:26,570] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 30: [2023-04-29 17:23:26,570] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 30: [2023-04-29 17:23:26,570] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 4: [2023-04-29 17:23:26,571] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 4: [2023-04-29 17:23:26,571] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 30: [2023-04-29 17:23:26,572] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 30: [2023-04-29 17:23:26,572] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 18: [2023-04-29 17:23:26,572] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 2: [2023-04-29 17:23:26,573] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 11: [2023-04-29 17:23:26,573] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 0: [2023-04-29 17:23:26,573] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 0: [2023-04-29 17:23:26,573] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 0: [2023-04-29 17:23:26,573] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 0: [2023-04-29 17:23:26,573] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 23: [2023-04-29 17:23:26,574] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 18: [2023-04-29 17:23:26,574] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 24: [2023-04-29 17:23:26,575] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 24: [2023-04-29 17:23:26,575] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 24: [2023-04-29 17:23:26,575] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 24: [2023-04-29 17:23:26,575] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 24: [2023-04-29 17:23:26,575] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 13: [2023-04-29 17:23:26,576] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 13: [2023-04-29 17:23:26,576] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 0: [2023-04-29 17:23:26,577] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 15: [2023-04-29 17:23:26,577] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 31: [2023-04-29 17:23:26,578] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 31: [2023-04-29 17:23:26,578] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 31: [2023-04-29 17:23:26,578] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 11: [2023-04-29 17:23:26,578] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 11: [2023-04-29 17:23:26,578] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 11: [2023-04-29 17:23:26,578] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 31: [2023-04-29 17:23:26,578] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 11: [2023-04-29 17:23:26,579] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 15: [2023-04-29 17:23:26,579] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 15: [2023-04-29 17:23:26,579] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 11: [2023-04-29 17:23:26,579] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 11: [2023-04-29 17:23:26,580] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 15: [2023-04-29 17:23:26,580] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 18: [2023-04-29 17:23:26,580] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 15: [2023-04-29 17:23:26,580] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 15: [2023-04-29 17:23:26,580] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 15: [2023-04-29 17:23:26,581] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 15: [2023-04-29 17:23:26,582] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt... 24: [2023-04-29 17:23:26,583] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 23: [2023-04-29 17:23:26,583] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 31: [2023-04-29 17:23:26,584] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 24: [2023-04-29 17:23:26,584] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 31: [2023-04-29 17:23:26,585] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 11: [2023-04-29 17:23:26,585] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 31: [2023-04-29 17:23:26,585] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 4: [2023-04-29 17:23:26,586] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 4: [2023-04-29 17:23:26,587] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 18: [2023-04-29 17:23:26,587] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 18: [2023-04-29 17:23:26,587] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 18: [2023-04-29 17:23:26,587] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 18: [2023-04-29 17:23:26,587] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 4: [2023-04-29 17:23:26,587] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 2: [2023-04-29 17:23:26,588] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 0: [2023-04-29 17:23:26,588] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 9: [2023-04-29 17:23:26,588] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 9: [2023-04-29 17:23:26,588] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 9: [2023-04-29 17:23:26,588] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 9: [2023-04-29 17:23:26,589] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 2: [2023-04-29 17:23:26,590] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 2: [2023-04-29 17:23:26,590] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 31: [2023-04-29 17:23:26,590] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 4: [2023-04-29 17:23:26,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 2: [2023-04-29 17:23:26,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 9: [2023-04-29 17:23:26,593] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 9: [2023-04-29 17:23:26,593] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 9: [2023-04-29 17:23:26,593] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 9: [2023-04-29 17:23:26,593] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 0: [2023-04-29 17:23:26,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 11: [2023-04-29 17:23:26,597] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 27: [2023-04-29 17:23:26,597] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 18: [2023-04-29 17:23:26,598] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 4: [2023-04-29 17:23:26,599] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 4: [2023-04-29 17:23:26,599] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 30: [2023-04-29 17:23:26,600] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 30: [2023-04-29 17:23:26,601] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 30: [2023-04-29 17:23:26,601] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 27: [2023-04-29 17:23:26,602] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 26: [2023-04-29 17:23:26,603] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 27: [2023-04-29 17:23:26,603] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 0: [2023-04-29 17:23:26,603] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 24: [2023-04-29 17:23:26,604] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 26: [2023-04-29 17:23:26,604] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 30: [2023-04-29 17:23:26,605] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 30: [2023-04-29 17:23:26,605] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 27: [2023-04-29 17:23:26,605] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 24: [2023-04-29 17:23:26,605] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 27: [2023-04-29 17:23:26,605] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 31: [2023-04-29 17:23:26,606] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 11: [2023-04-29 17:23:26,606] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 31: [2023-04-29 17:23:26,606] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 31: [2023-04-29 17:23:26,606] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 31: [2023-04-29 17:23:26,606] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 24: [2023-04-29 17:23:26,607] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 11: [2023-04-29 17:23:26,607] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 11: [2023-04-29 17:23:26,607] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 27: [2023-04-29 17:23:26,607] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 0: [2023-04-29 17:23:26,607] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 27: [2023-04-29 17:23:26,607] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 26: [2023-04-29 17:23:26,607] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 0: [2023-04-29 17:23:26,608] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 18: [2023-04-29 17:23:26,608] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 18: [2023-04-29 17:23:26,608] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 24: [2023-04-29 17:23:26,609] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 0: [2023-04-29 17:23:26,610] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 0: [2023-04-29 17:23:26,610] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 24: [2023-04-29 17:23:26,613] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 9: [2023-04-29 17:23:26,615] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 9: [2023-04-29 17:23:26,615] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 9: [2023-04-29 17:23:26,615] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 9: [2023-04-29 17:23:26,615] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 4: [2023-04-29 17:23:26,617] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 26: [2023-04-29 17:23:26,617] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 4: [2023-04-29 17:23:26,617] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 4: [2023-04-29 17:23:26,617] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 26: [2023-04-29 17:23:26,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 26: [2023-04-29 17:23:26,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 26: [2023-04-29 17:23:26,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 26: [2023-04-29 17:23:26,619] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 28: [2023-04-29 17:23:26,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 9: [2023-04-29 17:23:26,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 9: [2023-04-29 17:23:26,620] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 18: [2023-04-29 17:23:26,620] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 18: [2023-04-29 17:23:26,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 9: [2023-04-29 17:23:26,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 9: [2023-04-29 17:23:26,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 18: [2023-04-29 17:23:26,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 18: [2023-04-29 17:23:26,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 22: [2023-04-29 17:23:26,627] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 22: [2023-04-29 17:23:26,627] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 22: [2023-04-29 17:23:26,627] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 22: [2023-04-29 17:23:26,627] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 26: [2023-04-29 17:23:26,627] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 22: [2023-04-29 17:23:26,627] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 22: [2023-04-29 17:23:26,627] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 22: [2023-04-29 17:23:26,627] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 22: [2023-04-29 17:23:26,627] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 22: [2023-04-29 17:23:26,630] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 22: [2023-04-29 17:23:26,631] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 16: [2023-04-29 17:23:26,631] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 16: [2023-04-29 17:23:26,631] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 16: [2023-04-29 17:23:26,631] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 28: [2023-04-29 17:23:26,632] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 16: [2023-04-29 17:23:26,632] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 16: [2023-04-29 17:23:26,632] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 16: [2023-04-29 17:23:26,632] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 16: [2023-04-29 17:23:26,632] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 16: [2023-04-29 17:23:26,632] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 28: [2023-04-29 17:23:26,633] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 28: [2023-04-29 17:23:26,633] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 26: [2023-04-29 17:23:26,634] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 26: [2023-04-29 17:23:26,636] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 22: [2023-04-29 17:23:26,637] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 22: [2023-04-29 17:23:26,637] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 22: [2023-04-29 17:23:26,637] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 22: [2023-04-29 17:23:26,638] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 16: [2023-04-29 17:23:26,638] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 16: [2023-04-29 17:23:26,638] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 16: [2023-04-29 17:23:26,638] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 22: [2023-04-29 17:23:26,639] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 16: [2023-04-29 17:23:26,639] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 16: [2023-04-29 17:23:26,639] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 22: [2023-04-29 17:23:26,639] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 16: [2023-04-29 17:23:26,639] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 16: [2023-04-29 17:23:26,639] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 16: [2023-04-29 17:23:26,639] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 26: [2023-04-29 17:23:26,645] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 26: [2023-04-29 17:23:26,646] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 28: [2023-04-29 17:23:26,647] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 26: [2023-04-29 17:23:26,647] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 26: [2023-04-29 17:23:26,647] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 26: [2023-04-29 17:23:26,649] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 28: [2023-04-29 17:23:26,650] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 28: [2023-04-29 17:23:26,655] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 28: [2023-04-29 17:23:26,655] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 28: [2023-04-29 17:23:26,655] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 15: [2023-04-29 17:23:26,658] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 15: [2023-04-29 17:23:26,660] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 15: [2023-04-29 17:23:26,660] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 15: [2023-04-29 17:23:26,660] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 15: [2023-04-29 17:23:26,660] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 15: [2023-04-29 17:23:26,663] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 15: [2023-04-29 17:23:26,663] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 15: [2023-04-29 17:23:26,663] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_23-model_00-model_states.pt. 28: [2023-04-29 17:23:26,665] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 28: [2023-04-29 17:23:26,666] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 28: [2023-04-29 17:23:26,672] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 22: [2023-04-29 17:23:26,675] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 22: [2023-04-29 17:23:26,675] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 28: [2023-04-29 17:23:26,684] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 28: [2023-04-29 17:23:26,684] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 28: [2023-04-29 17:23:26,687] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 28: [2023-04-29 17:23:26,687] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 16: [2023-04-29 17:23:26,692] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 16: [2023-04-29 17:23:26,692] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 16: [2023-04-29 17:23:26,694] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 15: [2023-04-29 17:23:26,698] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 22: [2023-04-29 17:23:26,698] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 15: [2023-04-29 17:23:26,698] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 22: [2023-04-29 17:23:26,698] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 16: [2023-04-29 17:23:26,702] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 15: [2023-04-29 17:23:26,705] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 15: [2023-04-29 17:23:26,706] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 15: [2023-04-29 17:23:26,706] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 15: [2023-04-29 17:23:26,706] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 22: [2023-04-29 17:23:26,708] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 22: [2023-04-29 17:23:26,708] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 22: [2023-04-29 17:23:26,708] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 15: [2023-04-29 17:23:26,708] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 16: [2023-04-29 17:23:26,709] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 16: [2023-04-29 17:23:26,709] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 16: [2023-04-29 17:23:26,709] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 16: [2023-04-29 17:23:26,709] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 15: [2023-04-29 17:23:26,708] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 22: [2023-04-29 17:23:26,711] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 22: [2023-04-29 17:23:26,711] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 22: [2023-04-29 17:23:26,711] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 16: [2023-04-29 17:23:26,715] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 20: [2023-04-29 17:23:26,715] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 20: [2023-04-29 17:23:26,715] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 16: [2023-04-29 17:23:26,715] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 20: [2023-04-29 17:23:26,715] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 20: [2023-04-29 17:23:26,715] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 20: [2023-04-29 17:23:26,715] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 20: [2023-04-29 17:23:26,716] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 20: [2023-04-29 17:23:26,716] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 20: [2023-04-29 17:23:26,716] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 17: [2023-04-29 17:23:26,718] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 17: [2023-04-29 17:23:26,718] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 17: [2023-04-29 17:23:26,718] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 17: [2023-04-29 17:23:26,718] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 17: [2023-04-29 17:23:26,718] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 17: [2023-04-29 17:23:26,718] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 17: [2023-04-29 17:23:26,719] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 17: [2023-04-29 17:23:26,719] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 5: [2023-04-29 17:23:26,719] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 5: [2023-04-29 17:23:26,719] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 5: [2023-04-29 17:23:26,720] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 5: [2023-04-29 17:23:26,720] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 5: [2023-04-29 17:23:26,720] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 5: [2023-04-29 17:23:26,720] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 5: [2023-04-29 17:23:26,721] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 5: [2023-04-29 17:23:26,721] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 20: [2023-04-29 17:23:26,721] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 17: [2023-04-29 17:23:26,721] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 20: [2023-04-29 17:23:26,722] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 20: [2023-04-29 17:23:26,723] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 20: [2023-04-29 17:23:26,724] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 5: [2023-04-29 17:23:26,723] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 5: [2023-04-29 17:23:26,724] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 20: [2023-04-29 17:23:26,724] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 17: [2023-04-29 17:23:26,723] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 20: [2023-04-29 17:23:26,725] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 17: [2023-04-29 17:23:26,725] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 20: [2023-04-29 17:23:26,726] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 20: [2023-04-29 17:23:26,726] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 16: [2023-04-29 17:23:26,726] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 16: [2023-04-29 17:23:26,727] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 17: [2023-04-29 17:23:26,728] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 17: [2023-04-29 17:23:26,728] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 5: [2023-04-29 17:23:26,728] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 5: [2023-04-29 17:23:26,728] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 17: [2023-04-29 17:23:26,729] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 17: [2023-04-29 17:23:26,729] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 17: [2023-04-29 17:23:26,729] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 5: [2023-04-29 17:23:26,730] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 5: [2023-04-29 17:23:26,730] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 5: [2023-04-29 17:23:26,731] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 5: [2023-04-29 17:23:26,732] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 16: [2023-04-29 17:23:26,735] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 16: [2023-04-29 17:23:26,735] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 16: [2023-04-29 17:23:26,738] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 16: [2023-04-29 17:23:26,738] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 22: [2023-04-29 17:23:26,739] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 22: [2023-04-29 17:23:26,741] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 7: [2023-04-29 17:23:26,741] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 7: [2023-04-29 17:23:26,741] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 7: [2023-04-29 17:23:26,741] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 7: [2023-04-29 17:23:26,741] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 7: [2023-04-29 17:23:26,741] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 22: [2023-04-29 17:23:26,741] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 7: [2023-04-29 17:23:26,741] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 7: [2023-04-29 17:23:26,741] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 7: [2023-04-29 17:23:26,742] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 22: [2023-04-29 17:23:26,745] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 7: [2023-04-29 17:23:26,746] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 7: [2023-04-29 17:23:26,746] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 7: [2023-04-29 17:23:26,746] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 7: [2023-04-29 17:23:26,747] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 22: [2023-04-29 17:23:26,747] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 22: [2023-04-29 17:23:26,747] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 7: [2023-04-29 17:23:26,748] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 7: [2023-04-29 17:23:26,748] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 7: [2023-04-29 17:23:26,748] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 7: [2023-04-29 17:23:26,748] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 1: [2023-04-29 17:23:26,755] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 1: [2023-04-29 17:23:26,755] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 1: [2023-04-29 17:23:26,756] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 1: [2023-04-29 17:23:26,756] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 1: [2023-04-29 17:23:26,756] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 1: [2023-04-29 17:23:26,756] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 1: [2023-04-29 17:23:26,756] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 1: [2023-04-29 17:23:26,757] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 1: [2023-04-29 17:23:26,760] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 1: [2023-04-29 17:23:26,761] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 1: [2023-04-29 17:23:26,761] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 1: [2023-04-29 17:23:26,762] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 1: [2023-04-29 17:23:26,763] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 1: [2023-04-29 17:23:26,764] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 1: [2023-04-29 17:23:26,764] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 1: [2023-04-29 17:23:26,765] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 17: [2023-04-29 17:23:26,768] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 21: [2023-04-29 17:23:26,769] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 21: [2023-04-29 17:23:26,769] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 21: [2023-04-29 17:23:26,770] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 21: [2023-04-29 17:23:26,770] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 21: [2023-04-29 17:23:26,770] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 21: [2023-04-29 17:23:26,770] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 21: [2023-04-29 17:23:26,770] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 21: [2023-04-29 17:23:26,770] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 21: [2023-04-29 17:23:26,773] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 21: [2023-04-29 17:23:26,775] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 21: [2023-04-29 17:23:26,775] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 5: [2023-04-29 17:23:26,774] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 5: [2023-04-29 17:23:26,774] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 21: [2023-04-29 17:23:26,775] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 20: [2023-04-29 17:23:26,776] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 20: [2023-04-29 17:23:26,776] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 21: [2023-04-29 17:23:26,776] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 21: [2023-04-29 17:23:26,776] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 21: [2023-04-29 17:23:26,777] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 21: [2023-04-29 17:23:26,777] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 20: [2023-04-29 17:23:26,778] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 17: [2023-04-29 17:23:26,779] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 17: [2023-04-29 17:23:26,783] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 17: [2023-04-29 17:23:26,789] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 25: [2023-04-29 17:23:26,789] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 25: [2023-04-29 17:23:26,789] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 20: [2023-04-29 17:23:26,790] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 20: [2023-04-29 17:23:26,790] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 20: [2023-04-29 17:23:26,790] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 20: [2023-04-29 17:23:26,791] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 20: [2023-04-29 17:23:26,791] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 5: [2023-04-29 17:23:26,793] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 5: [2023-04-29 17:23:26,793] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 25: [2023-04-29 17:23:26,793] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 25: [2023-04-29 17:23:26,793] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 25: [2023-04-29 17:23:26,793] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 25: [2023-04-29 17:23:26,793] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 25: [2023-04-29 17:23:26,793] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 25: [2023-04-29 17:23:26,793] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 25: [2023-04-29 17:23:26,793] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 25: [2023-04-29 17:23:26,794] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 5: [2023-04-29 17:23:26,795] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 5: [2023-04-29 17:23:26,797] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 20: [2023-04-29 17:23:26,798] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 7: [2023-04-29 17:23:26,800] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 7: [2023-04-29 17:23:26,800] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 7: [2023-04-29 17:23:26,800] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 20: [2023-04-29 17:23:26,800] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 17: [2023-04-29 17:23:26,800] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 25: [2023-04-29 17:23:26,801] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 25: [2023-04-29 17:23:26,803] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 25: [2023-04-29 17:23:26,803] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 7: [2023-04-29 17:23:26,803] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 25: [2023-04-29 17:23:26,804] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 17: [2023-04-29 17:23:26,804] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 25: [2023-04-29 17:23:26,804] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 5: [2023-04-29 17:23:26,805] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 25: [2023-04-29 17:23:26,805] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 20: [2023-04-29 17:23:26,806] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 5: [2023-04-29 17:23:26,806] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 17: [2023-04-29 17:23:26,808] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 17: [2023-04-29 17:23:26,808] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 17: [2023-04-29 17:23:26,808] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 17: [2023-04-29 17:23:26,810] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 17: [2023-04-29 17:23:26,810] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 5: [2023-04-29 17:23:26,817] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 5: [2023-04-29 17:23:26,817] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 20: [2023-04-29 17:23:26,817] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 7: [2023-04-29 17:23:26,817] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 7: [2023-04-29 17:23:26,817] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 7: [2023-04-29 17:23:26,817] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 5: [2023-04-29 17:23:26,817] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 7: [2023-04-29 17:23:26,818] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 5: [2023-04-29 17:23:26,818] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 20: [2023-04-29 17:23:26,818] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 20: [2023-04-29 17:23:26,819] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 1: [2023-04-29 17:23:26,819] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 1: [2023-04-29 17:23:26,819] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 1: [2023-04-29 17:23:26,819] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 1: [2023-04-29 17:23:26,819] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 20: [2023-04-29 17:23:26,820] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 21: [2023-04-29 17:23:26,820] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 20: [2023-04-29 17:23:26,823] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 7: [2023-04-29 17:23:26,824] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 7: [2023-04-29 17:23:26,824] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 1: [2023-04-29 17:23:26,824] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 1: [2023-04-29 17:23:26,824] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 1: [2023-04-29 17:23:26,824] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 7: [2023-04-29 17:23:26,825] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 1: [2023-04-29 17:23:26,826] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 17: [2023-04-29 17:23:26,829] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 7: [2023-04-29 17:23:26,829] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 21: [2023-04-29 17:23:26,831] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 21: [2023-04-29 17:23:26,831] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 5: [2023-04-29 17:23:26,832] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 17: [2023-04-29 17:23:26,836] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 14: [2023-04-29 17:23:26,836] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 14: [2023-04-29 17:23:26,837] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 25: [2023-04-29 17:23:26,837] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 5: [2023-04-29 17:23:26,838] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 14: [2023-04-29 17:23:26,840] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 14: [2023-04-29 17:23:26,840] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 14: [2023-04-29 17:23:26,840] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 14: [2023-04-29 17:23:26,840] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 14: [2023-04-29 17:23:26,840] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 14: [2023-04-29 17:23:26,840] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 14: [2023-04-29 17:23:26,841] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 17: [2023-04-29 17:23:26,841] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 17: [2023-04-29 17:23:26,841] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 17: [2023-04-29 17:23:26,841] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 21: [2023-04-29 17:23:26,841] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 7: [2023-04-29 17:23:26,843] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 14: [2023-04-29 17:23:26,844] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 14: [2023-04-29 17:23:26,844] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 7: [2023-04-29 17:23:26,844] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 21: [2023-04-29 17:23:26,844] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 21: [2023-04-29 17:23:26,844] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 21: [2023-04-29 17:23:26,844] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 21: [2023-04-29 17:23:26,844] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 21: [2023-04-29 17:23:26,844] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 1: [2023-04-29 17:23:26,846] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 5: [2023-04-29 17:23:26,846] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 7: [2023-04-29 17:23:26,846] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 5: [2023-04-29 17:23:26,846] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 7: [2023-04-29 17:23:26,847] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 25: [2023-04-29 17:23:26,848] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 1: [2023-04-29 17:23:26,849] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 29: [2023-04-29 17:23:26,849] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 8: [2023-04-29 17:23:26,850] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 8: [2023-04-29 17:23:26,850] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 14: [2023-04-29 17:23:26,849] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 8: [2023-04-29 17:23:26,850] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 8: [2023-04-29 17:23:26,850] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 8: [2023-04-29 17:23:26,850] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 8: [2023-04-29 17:23:26,850] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 8: [2023-04-29 17:23:26,850] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 29: [2023-04-29 17:23:26,850] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 8: [2023-04-29 17:23:26,851] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 14: [2023-04-29 17:23:26,851] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 14: [2023-04-29 17:23:26,851] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 14: [2023-04-29 17:23:26,851] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 14: [2023-04-29 17:23:26,851] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 1: [2023-04-29 17:23:26,852] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 29: [2023-04-29 17:23:26,853] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 29: [2023-04-29 17:23:26,854] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 29: [2023-04-29 17:23:26,854] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 29: [2023-04-29 17:23:26,854] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 29: [2023-04-29 17:23:26,854] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 29: [2023-04-29 17:23:26,854] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 29: [2023-04-29 17:23:26,854] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 1: [2023-04-29 17:23:26,855] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 2: [2023-04-29 17:23:26,856] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 2: [2023-04-29 17:23:26,856] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 6: [2023-04-29 17:23:26,856] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 6: [2023-04-29 17:23:26,856] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 6: [2023-04-29 17:23:26,856] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 21: [2023-04-29 17:23:26,856] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 13: [2023-04-29 17:23:26,856] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 6: [2023-04-29 17:23:26,856] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 6: [2023-04-29 17:23:26,856] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 6: [2023-04-29 17:23:26,856] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 6: [2023-04-29 17:23:26,856] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 8: [2023-04-29 17:23:26,856] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 6: [2023-04-29 17:23:26,857] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 13: [2023-04-29 17:23:26,856] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 19: [2023-04-29 17:23:26,856] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 1: [2023-04-29 17:23:26,857] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 1: [2023-04-29 17:23:26,857] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 19: [2023-04-29 17:23:26,857] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 19: [2023-04-29 17:23:26,857] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 25: [2023-04-29 17:23:26,857] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 19: [2023-04-29 17:23:26,857] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 1: [2023-04-29 17:23:26,857] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 19: [2023-04-29 17:23:26,857] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 19: [2023-04-29 17:23:26,857] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 19: [2023-04-29 17:23:26,857] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 8: [2023-04-29 17:23:26,857] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 29: [2023-04-29 17:23:26,857] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 2: [2023-04-29 17:23:26,857] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 19: [2023-04-29 17:23:26,858] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 8: [2023-04-29 17:23:26,858] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 21: [2023-04-29 17:23:26,858] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 2: [2023-04-29 17:23:26,858] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 2: [2023-04-29 17:23:26,858] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 2: [2023-04-29 17:23:26,858] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 2: [2023-04-29 17:23:26,858] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 2: [2023-04-29 17:23:26,859] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 13: [2023-04-29 17:23:26,859] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 13: [2023-04-29 17:23:26,859] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 13: [2023-04-29 17:23:26,859] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 13: [2023-04-29 17:23:26,859] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 13: [2023-04-29 17:23:26,859] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 8: [2023-04-29 17:23:26,859] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 29: [2023-04-29 17:23:26,859] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 13: [2023-04-29 17:23:26,859] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 6: [2023-04-29 17:23:26,859] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 1: [2023-04-29 17:23:26,860] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 8: [2023-04-29 17:23:26,860] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 3: [2023-04-29 17:23:26,860] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 3: [2023-04-29 17:23:26,860] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 3: [2023-04-29 17:23:26,860] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 8: [2023-04-29 17:23:26,860] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 6: [2023-04-29 17:23:26,860] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 3: [2023-04-29 17:23:26,860] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 3: [2023-04-29 17:23:26,860] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 3: [2023-04-29 17:23:26,860] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 3: [2023-04-29 17:23:26,860] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 3: [2023-04-29 17:23:26,861] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 8: [2023-04-29 17:23:26,861] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 13: [2023-04-29 17:23:26,861] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 2: [2023-04-29 17:23:26,861] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 2: [2023-04-29 17:23:26,861] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 19: [2023-04-29 17:23:26,861] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 8: [2023-04-29 17:23:26,861] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 25: [2023-04-29 17:23:26,861] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 19: [2023-04-29 17:23:26,862] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 19: [2023-04-29 17:23:26,862] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 2: [2023-04-29 17:23:26,862] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 27: [2023-04-29 17:23:26,863] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 27: [2023-04-29 17:23:26,863] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 27: [2023-04-29 17:23:26,863] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 27: [2023-04-29 17:23:26,863] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 27: [2023-04-29 17:23:26,863] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 27: [2023-04-29 17:23:26,863] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 27: [2023-04-29 17:23:26,863] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 27: [2023-04-29 17:23:26,864] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 29: [2023-04-29 17:23:26,863] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 29: [2023-04-29 17:23:26,863] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 29: [2023-04-29 17:23:26,864] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 3: [2023-04-29 17:23:26,864] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 3: [2023-04-29 17:23:26,865] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 13: [2023-04-29 17:23:26,864] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 13: [2023-04-29 17:23:26,865] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 29: [2023-04-29 17:23:26,865] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 29: [2023-04-29 17:23:26,865] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 2: [2023-04-29 17:23:26,865] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 6: [2023-04-29 17:23:26,865] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 19: [2023-04-29 17:23:26,865] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 19: [2023-04-29 17:23:26,865] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 6: [2023-04-29 17:23:26,866] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 13: [2023-04-29 17:23:26,866] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 2: [2023-04-29 17:23:26,866] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 6: [2023-04-29 17:23:26,866] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 19: [2023-04-29 17:23:26,866] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 6: [2023-04-29 17:23:26,866] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 6: [2023-04-29 17:23:26,866] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 6: [2023-04-29 17:23:26,867] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 19: [2023-04-29 17:23:26,867] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 27: [2023-04-29 17:23:26,867] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 19: [2023-04-29 17:23:26,867] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 2: [2023-04-29 17:23:26,867] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 25: [2023-04-29 17:23:26,868] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 2: [2023-04-29 17:23:26,868] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 2: [2023-04-29 17:23:26,869] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 3: [2023-04-29 17:23:26,869] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 13: [2023-04-29 17:23:26,869] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 13: [2023-04-29 17:23:26,869] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 13: [2023-04-29 17:23:26,869] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 13: [2023-04-29 17:23:26,870] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 3: [2023-04-29 17:23:26,870] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 3: [2023-04-29 17:23:26,871] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 3: [2023-04-29 17:23:26,871] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 3: [2023-04-29 17:23:26,871] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 3: [2023-04-29 17:23:26,872] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 21: [2023-04-29 17:23:26,874] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 21: [2023-04-29 17:23:26,874] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 21: [2023-04-29 17:23:26,875] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 27: [2023-04-29 17:23:26,875] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 27: [2023-04-29 17:23:26,876] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 21: [2023-04-29 17:23:26,876] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 27: [2023-04-29 17:23:26,876] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 21: [2023-04-29 17:23:26,876] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 27: [2023-04-29 17:23:26,876] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 27: [2023-04-29 17:23:26,877] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 27: [2023-04-29 17:23:26,878] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 27: [2023-04-29 17:23:26,878] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 25: [2023-04-29 17:23:26,879] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 25: [2023-04-29 17:23:26,879] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 25: [2023-04-29 17:23:26,879] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 25: [2023-04-29 17:23:26,879] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 25: [2023-04-29 17:23:26,880] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 25: [2023-04-29 17:23:26,885] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 14: [2023-04-29 17:23:26,891] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 14: [2023-04-29 17:23:26,896] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 6: [2023-04-29 17:23:26,903] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 23: [2023-04-29 17:23:26,905] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 23: [2023-04-29 17:23:26,906] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 23: [2023-04-29 17:23:26,906] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 23: [2023-04-29 17:23:26,906] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 29: [2023-04-29 17:23:26,906] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 29: [2023-04-29 17:23:26,906] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 26: [2023-04-29 17:23:26,905] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 26: [2023-04-29 17:23:26,905] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 26: [2023-04-29 17:23:26,906] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 26: [2023-04-29 17:23:26,906] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 26: [2023-04-29 17:23:26,906] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 23: [2023-04-29 17:23:26,906] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 26: [2023-04-29 17:23:26,906] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 26: [2023-04-29 17:23:26,906] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 26: [2023-04-29 17:23:26,906] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 23: [2023-04-29 17:23:26,906] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 23: [2023-04-29 17:23:26,906] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 23: [2023-04-29 17:23:26,907] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 19: [2023-04-29 17:23:26,908] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 8: [2023-04-29 17:23:26,911] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 23: [2023-04-29 17:23:26,911] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 26: [2023-04-29 17:23:26,910] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 26: [2023-04-29 17:23:26,911] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 23: [2023-04-29 17:23:26,912] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 25: [2023-04-29 17:23:26,913] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 8: [2023-04-29 17:23:26,912] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 8: [2023-04-29 17:23:26,912] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 14: [2023-04-29 17:23:26,913] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 26: [2023-04-29 17:23:26,913] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 25: [2023-04-29 17:23:26,913] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 25: [2023-04-29 17:23:26,913] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 26: [2023-04-29 17:23:26,914] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 6: [2023-04-29 17:23:26,914] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 13: [2023-04-29 17:23:26,913] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 26: [2023-04-29 17:23:26,914] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 26: [2023-04-29 17:23:26,914] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 26: [2023-04-29 17:23:26,915] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 26: [2023-04-29 17:23:26,915] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 0: [2023-04-29 17:23:26,916] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 0: [2023-04-29 17:23:26,916] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 0: [2023-04-29 17:23:26,916] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 0: [2023-04-29 17:23:26,916] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 0: [2023-04-29 17:23:26,916] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 0: [2023-04-29 17:23:26,916] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 0: [2023-04-29 17:23:26,916] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 0: [2023-04-29 17:23:26,916] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 23: [2023-04-29 17:23:26,916] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 23: [2023-04-29 17:23:26,916] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 3: [2023-04-29 17:23:26,916] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 3: [2023-04-29 17:23:26,916] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 2: [2023-04-29 17:23:26,917] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 13: [2023-04-29 17:23:26,918] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 23: [2023-04-29 17:23:26,918] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 23: [2023-04-29 17:23:26,918] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 27: [2023-04-29 17:23:26,918] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 23: [2023-04-29 17:23:26,918] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 23: [2023-04-29 17:23:26,919] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 19: [2023-04-29 17:23:26,919] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 25: [2023-04-29 17:23:26,919] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 14: [2023-04-29 17:23:26,919] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 25: [2023-04-29 17:23:26,919] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 2: [2023-04-29 17:23:26,920] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 2: [2023-04-29 17:23:26,920] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 2: [2023-04-29 17:23:26,920] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 19: [2023-04-29 17:23:26,920] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 8: [2023-04-29 17:23:26,921] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 8: [2023-04-29 17:23:26,921] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 14: [2023-04-29 17:23:26,921] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 14: [2023-04-29 17:23:26,921] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 8: [2023-04-29 17:23:26,922] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 8: [2023-04-29 17:23:26,922] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 8: [2023-04-29 17:23:26,922] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 14: [2023-04-29 17:23:26,922] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 0: [2023-04-29 17:23:26,924] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 6: [2023-04-29 17:23:26,925] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 13: [2023-04-29 17:23:26,925] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 14: [2023-04-29 17:23:26,925] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 14: [2023-04-29 17:23:26,925] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 14: [2023-04-29 17:23:26,925] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 31: [2023-04-29 17:23:26,926] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 31: [2023-04-29 17:23:26,926] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 31: [2023-04-29 17:23:26,926] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 31: [2023-04-29 17:23:26,927] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 31: [2023-04-29 17:23:26,927] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 31: [2023-04-29 17:23:26,927] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 31: [2023-04-29 17:23:26,927] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 31: [2023-04-29 17:23:26,927] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 29: [2023-04-29 17:23:26,928] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 0: [2023-04-29 17:23:26,928] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 24: [2023-04-29 17:23:26,928] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 0: [2023-04-29 17:23:26,928] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 24: [2023-04-29 17:23:26,929] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 24: [2023-04-29 17:23:26,929] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 24: [2023-04-29 17:23:26,929] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 29: [2023-04-29 17:23:26,929] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 24: [2023-04-29 17:23:26,929] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 24: [2023-04-29 17:23:26,929] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 24: [2023-04-29 17:23:26,929] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 12: [2023-04-29 17:23:26,929] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 12: [2023-04-29 17:23:26,929] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 12: [2023-04-29 17:23:26,929] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 12: [2023-04-29 17:23:26,929] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 12: [2023-04-29 17:23:26,929] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 19: [2023-04-29 17:23:26,929] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 12: [2023-04-29 17:23:26,929] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 12: [2023-04-29 17:23:26,929] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 24: [2023-04-29 17:23:26,929] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 12: [2023-04-29 17:23:26,930] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 0: [2023-04-29 17:23:26,930] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 3: [2023-04-29 17:23:26,930] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 31: [2023-04-29 17:23:26,930] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 31: [2023-04-29 17:23:26,931] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 29: [2023-04-29 17:23:26,931] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 0: [2023-04-29 17:23:26,931] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 31: [2023-04-29 17:23:26,931] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 19: [2023-04-29 17:23:26,931] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 0: [2023-04-29 17:23:26,932] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 0: [2023-04-29 17:23:26,932] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 2: [2023-04-29 17:23:26,932] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 2: [2023-04-29 17:23:26,932] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 24: [2023-04-29 17:23:26,932] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 31: [2023-04-29 17:23:26,933] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 31: [2023-04-29 17:23:26,934] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 31: [2023-04-29 17:23:26,934] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 8: [2023-04-29 17:23:26,934] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 31: [2023-04-29 17:23:26,934] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 19: [2023-04-29 17:23:26,934] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 19: [2023-04-29 17:23:26,934] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 19: [2023-04-29 17:23:26,934] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 19: [2023-04-29 17:23:26,934] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 31: [2023-04-29 17:23:26,934] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 29: [2023-04-29 17:23:26,934] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 29: [2023-04-29 17:23:26,934] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 0: [2023-04-29 17:23:26,935] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 6: [2023-04-29 17:23:26,935] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 29: [2023-04-29 17:23:26,935] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 6: [2023-04-29 17:23:26,935] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 12: [2023-04-29 17:23:26,935] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 12: [2023-04-29 17:23:26,935] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 10: [2023-04-29 17:23:26,936] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 10: [2023-04-29 17:23:26,936] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 10: [2023-04-29 17:23:26,936] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 10: [2023-04-29 17:23:26,936] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 10: [2023-04-29 17:23:26,936] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 10: [2023-04-29 17:23:26,936] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 10: [2023-04-29 17:23:26,936] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 10: [2023-04-29 17:23:26,936] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 12: [2023-04-29 17:23:26,937] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 12: [2023-04-29 17:23:26,937] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 12: [2023-04-29 17:23:26,937] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 3: [2023-04-29 17:23:26,937] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 12: [2023-04-29 17:23:26,937] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 27: [2023-04-29 17:23:26,937] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 8: [2023-04-29 17:23:26,937] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 12: [2023-04-29 17:23:26,937] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 13: [2023-04-29 17:23:26,938] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 8: [2023-04-29 17:23:26,938] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 6: [2023-04-29 17:23:26,937] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 3: [2023-04-29 17:23:26,938] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 12: [2023-04-29 17:23:26,939] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 24: [2023-04-29 17:23:26,939] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 3: [2023-04-29 17:23:26,939] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 24: [2023-04-29 17:23:26,940] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 10: [2023-04-29 17:23:26,940] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 2: [2023-04-29 17:23:26,941] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 10: [2023-04-29 17:23:26,941] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 24: [2023-04-29 17:23:26,941] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 10: [2023-04-29 17:23:26,942] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 13: [2023-04-29 17:23:26,941] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 13: [2023-04-29 17:23:26,941] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 13: [2023-04-29 17:23:26,942] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 10: [2023-04-29 17:23:26,942] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 13: [2023-04-29 17:23:26,942] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 24: [2023-04-29 17:23:26,942] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 6: [2023-04-29 17:23:26,942] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 6: [2023-04-29 17:23:26,942] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 6: [2023-04-29 17:23:26,942] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 19: [2023-04-29 17:23:26,942] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 24: [2023-04-29 17:23:26,942] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 19: [2023-04-29 17:23:26,943] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 24: [2023-04-29 17:23:26,943] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 2: [2023-04-29 17:23:26,943] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 13: [2023-04-29 17:23:26,943] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 6: [2023-04-29 17:23:26,944] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 10: [2023-04-29 17:23:26,943] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 10: [2023-04-29 17:23:26,944] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 2: [2023-04-29 17:23:26,944] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 24: [2023-04-29 17:23:26,944] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 2: [2023-04-29 17:23:26,945] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 10: [2023-04-29 17:23:26,945] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 10: [2023-04-29 17:23:26,945] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 29: [2023-04-29 17:23:26,945] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 29: [2023-04-29 17:23:26,945] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 14: [2023-04-29 17:23:26,946] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 2: [2023-04-29 17:23:26,948] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 3: [2023-04-29 17:23:26,949] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 3: [2023-04-29 17:23:26,949] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 3: [2023-04-29 17:23:26,949] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 3: [2023-04-29 17:23:26,949] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 8: [2023-04-29 17:23:26,950] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 8: [2023-04-29 17:23:26,951] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 27: [2023-04-29 17:23:26,950] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 27: [2023-04-29 17:23:26,950] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 27: [2023-04-29 17:23:26,950] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 13: [2023-04-29 17:23:26,951] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 2: [2023-04-29 17:23:26,951] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 14: [2023-04-29 17:23:26,953] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 27: [2023-04-29 17:23:26,953] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 27: [2023-04-29 17:23:26,953] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 27: [2023-04-29 17:23:26,953] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 27: [2023-04-29 17:23:26,953] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 8: [2023-04-29 17:23:26,954] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 13: [2023-04-29 17:23:26,954] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 3: [2023-04-29 17:23:26,954] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 8: [2023-04-29 17:23:26,954] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 14: [2023-04-29 17:23:26,955] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 8: [2023-04-29 17:23:26,955] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 2: [2023-04-29 17:23:26,959] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 14: [2023-04-29 17:23:26,959] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 26: [2023-04-29 17:23:26,958] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 29: [2023-04-29 17:23:26,960] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 3: [2023-04-29 17:23:26,961] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 2: [2023-04-29 17:23:26,961] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 26: [2023-04-29 17:23:26,961] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 14: [2023-04-29 17:23:26,962] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 14: [2023-04-29 17:23:26,962] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 19: [2023-04-29 17:23:26,962] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 19: [2023-04-29 17:23:26,963] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 22: [2023-04-29 17:23:26,963] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 22: [2023-04-29 17:23:26,963] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 22: [2023-04-29 17:23:26,963] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 22: [2023-04-29 17:23:26,963] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 22: [2023-04-29 17:23:26,964] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 22: [2023-04-29 17:23:26,964] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 22: [2023-04-29 17:23:26,964] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 19: [2023-04-29 17:23:26,964] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 23: [2023-04-29 17:23:26,964] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 22: [2023-04-29 17:23:26,964] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 29: [2023-04-29 17:23:26,964] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 19: [2023-04-29 17:23:26,965] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 19: [2023-04-29 17:23:26,966] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 29: [2023-04-29 17:23:26,967] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 23: [2023-04-29 17:23:26,967] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 22: [2023-04-29 17:23:26,967] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 6: [2023-04-29 17:23:26,968] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 22: [2023-04-29 17:23:26,968] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 4: [2023-04-29 17:23:26,969] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 4: [2023-04-29 17:23:26,969] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 29: [2023-04-29 17:23:26,969] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 2: [2023-04-29 17:23:26,972] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 4: [2023-04-29 17:23:26,971] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 4: [2023-04-29 17:23:26,971] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 4: [2023-04-29 17:23:26,971] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 4: [2023-04-29 17:23:26,972] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 4: [2023-04-29 17:23:26,972] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 4: [2023-04-29 17:23:26,972] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 4: [2023-04-29 17:23:26,972] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 6: [2023-04-29 17:23:26,972] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 6: [2023-04-29 17:23:26,973] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 4: [2023-04-29 17:23:26,973] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 13: [2023-04-29 17:23:26,973] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 22: [2023-04-29 17:23:26,973] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 29: [2023-04-29 17:23:26,974] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 22: [2023-04-29 17:23:26,974] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 6: [2023-04-29 17:23:26,974] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 9: [2023-04-29 17:23:26,974] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 22: [2023-04-29 17:23:26,974] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 9: [2023-04-29 17:23:26,974] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 9: [2023-04-29 17:23:26,974] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 9: [2023-04-29 17:23:26,974] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 9: [2023-04-29 17:23:26,974] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 9: [2023-04-29 17:23:26,974] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 9: [2023-04-29 17:23:26,974] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 2: [2023-04-29 17:23:26,974] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 9: [2023-04-29 17:23:26,975] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 13: [2023-04-29 17:23:26,975] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 30: [2023-04-29 17:23:26,974] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 30: [2023-04-29 17:23:26,975] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 30: [2023-04-29 17:23:26,975] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 30: [2023-04-29 17:23:26,975] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 30: [2023-04-29 17:23:26,975] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 30: [2023-04-29 17:23:26,975] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 30: [2023-04-29 17:23:26,975] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 30: [2023-04-29 17:23:26,975] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 26: [2023-04-29 17:23:26,975] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 22: [2023-04-29 17:23:26,975] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 22: [2023-04-29 17:23:26,976] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 29: [2023-04-29 17:23:26,976] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 22: [2023-04-29 17:23:26,977] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 6: [2023-04-29 17:23:26,977] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 13: [2023-04-29 17:23:26,978] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 13: [2023-04-29 17:23:26,978] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 6: [2023-04-29 17:23:26,978] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 3: [2023-04-29 17:23:26,978] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 3: [2023-04-29 17:23:26,978] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 9: [2023-04-29 17:23:26,979] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 9: [2023-04-29 17:23:26,979] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 3: [2023-04-29 17:23:26,980] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 3: [2023-04-29 17:23:26,980] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 26: [2023-04-29 17:23:26,980] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 9: [2023-04-29 17:23:26,980] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 9: [2023-04-29 17:23:26,980] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 9: [2023-04-29 17:23:26,980] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 9: [2023-04-29 17:23:26,980] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 9: [2023-04-29 17:23:26,980] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 26: [2023-04-29 17:23:26,980] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 26: [2023-04-29 17:23:26,981] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 26: [2023-04-29 17:23:26,981] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 26: [2023-04-29 17:23:26,981] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 26: [2023-04-29 17:23:26,981] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 4: [2023-04-29 17:23:26,980] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 9: [2023-04-29 17:23:26,981] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 18: [2023-04-29 17:23:26,981] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 18: [2023-04-29 17:23:26,981] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 18: [2023-04-29 17:23:26,981] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 18: [2023-04-29 17:23:26,982] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 18: [2023-04-29 17:23:26,982] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 18: [2023-04-29 17:23:26,982] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 18: [2023-04-29 17:23:26,982] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 18: [2023-04-29 17:23:26,982] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 4: [2023-04-29 17:23:26,982] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 12: [2023-04-29 17:23:26,982] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 4: [2023-04-29 17:23:26,983] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 4: [2023-04-29 17:23:26,983] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 24: [2023-04-29 17:23:26,983] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 13: [2023-04-29 17:23:26,984] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 31: [2023-04-29 17:23:26,984] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 31: [2023-04-29 17:23:26,984] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 31: [2023-04-29 17:23:26,984] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 4: [2023-04-29 17:23:26,984] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 4: [2023-04-29 17:23:26,985] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 27: [2023-04-29 17:23:26,987] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 30: [2023-04-29 17:23:26,986] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 30: [2023-04-29 17:23:26,986] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 30: [2023-04-29 17:23:26,986] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 26: [2023-04-29 17:23:26,987] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 30: [2023-04-29 17:23:26,987] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 23: [2023-04-29 17:23:26,987] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 27: [2023-04-29 17:23:26,987] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 27: [2023-04-29 17:23:26,987] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 30: [2023-04-29 17:23:26,987] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 30: [2023-04-29 17:23:26,988] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 30: [2023-04-29 17:23:26,989] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 23: [2023-04-29 17:23:26,989] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 23: [2023-04-29 17:23:26,989] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 23: [2023-04-29 17:23:26,989] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 30: [2023-04-29 17:23:26,989] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 27: [2023-04-29 17:23:26,990] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 23: [2023-04-29 17:23:26,992] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 0: [2023-04-29 17:23:26,992] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 27: [2023-04-29 17:23:26,993] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 27: [2023-04-29 17:23:26,993] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 27: [2023-04-29 17:23:26,993] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 23: [2023-04-29 17:23:26,993] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 12: [2023-04-29 17:23:26,994] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 18: [2023-04-29 17:23:26,994] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 18: [2023-04-29 17:23:26,994] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 18: [2023-04-29 17:23:26,995] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 18: [2023-04-29 17:23:26,995] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 12: [2023-04-29 17:23:26,995] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 18: [2023-04-29 17:23:26,995] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 23: [2023-04-29 17:23:26,996] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 18: [2023-04-29 17:23:26,996] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 18: [2023-04-29 17:23:26,996] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 23: [2023-04-29 17:23:26,996] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 18: [2023-04-29 17:23:26,997] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 12: [2023-04-29 17:23:26,998] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 10: [2023-04-29 17:23:26,997] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 10: [2023-04-29 17:23:26,997] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 10: [2023-04-29 17:23:26,997] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 10: [2023-04-29 17:23:26,997] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 31: [2023-04-29 17:23:26,999] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 31: [2023-04-29 17:23:26,999] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 31: [2023-04-29 17:23:26,999] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 31: [2023-04-29 17:23:26,999] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 31: [2023-04-29 17:23:27,000] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 16: [2023-04-29 17:23:27,001] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 16: [2023-04-29 17:23:27,001] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 16: [2023-04-29 17:23:27,001] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 16: [2023-04-29 17:23:27,001] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 16: [2023-04-29 17:23:27,001] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 16: [2023-04-29 17:23:27,001] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 16: [2023-04-29 17:23:27,001] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 16: [2023-04-29 17:23:27,002] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 26: [2023-04-29 17:23:27,002] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 12: [2023-04-29 17:23:27,003] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 24: [2023-04-29 17:23:27,003] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 10: [2023-04-29 17:23:27,004] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 10: [2023-04-29 17:23:27,004] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 10: [2023-04-29 17:23:27,004] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 10: [2023-04-29 17:23:27,004] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 31: [2023-04-29 17:23:27,006] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 16: [2023-04-29 17:23:27,007] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 26: [2023-04-29 17:23:27,007] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 31: [2023-04-29 17:23:27,007] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 31: [2023-04-29 17:23:27,007] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 16: [2023-04-29 17:23:27,008] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 16: [2023-04-29 17:23:27,008] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 16: [2023-04-29 17:23:27,008] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 16: [2023-04-29 17:23:27,008] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 12: [2023-04-29 17:23:27,008] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 12: [2023-04-29 17:23:27,008] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 12: [2023-04-29 17:23:27,008] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 12: [2023-04-29 17:23:27,008] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 16: [2023-04-29 17:23:27,008] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 26: [2023-04-29 17:23:27,009] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 16: [2023-04-29 17:23:27,009] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 24: [2023-04-29 17:23:27,008] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 24: [2023-04-29 17:23:27,009] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 16: [2023-04-29 17:23:27,009] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 26: [2023-04-29 17:23:27,011] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 26: [2023-04-29 17:23:27,011] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 26: [2023-04-29 17:23:27,012] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 0: [2023-04-29 17:23:27,012] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 4: [2023-04-29 17:23:27,016] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 0: [2023-04-29 17:23:27,017] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 23: [2023-04-29 17:23:27,017] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 0: [2023-04-29 17:23:27,018] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 0: [2023-04-29 17:23:27,018] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 0: [2023-04-29 17:23:27,018] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 23: [2023-04-29 17:23:27,019] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 23: [2023-04-29 17:23:27,021] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 12: [2023-04-29 17:23:27,021] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 22: [2023-04-29 17:23:27,021] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 22: [2023-04-29 17:23:27,021] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 10: [2023-04-29 17:23:27,022] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 12: [2023-04-29 17:23:27,022] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 23: [2023-04-29 17:23:27,023] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 24: [2023-04-29 17:23:27,023] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 24: [2023-04-29 17:23:27,023] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 24: [2023-04-29 17:23:27,023] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 20: [2023-04-29 17:23:27,023] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 20: [2023-04-29 17:23:27,023] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 23: [2023-04-29 17:23:27,024] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 10: [2023-04-29 17:23:27,024] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 10: [2023-04-29 17:23:27,024] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 10: [2023-04-29 17:23:27,025] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 20: [2023-04-29 17:23:27,025] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 12: [2023-04-29 17:23:27,025] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 20: [2023-04-29 17:23:27,026] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 20: [2023-04-29 17:23:27,026] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 20: [2023-04-29 17:23:27,026] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 20: [2023-04-29 17:23:27,026] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 20: [2023-04-29 17:23:27,026] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 31: [2023-04-29 17:23:27,027] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 31: [2023-04-29 17:23:27,027] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 31: [2023-04-29 17:23:27,027] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 31: [2023-04-29 17:23:27,028] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 31: [2023-04-29 17:23:27,028] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 4: [2023-04-29 17:23:27,028] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 23: [2023-04-29 17:23:27,029] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 20: [2023-04-29 17:23:27,029] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 20: [2023-04-29 17:23:27,029] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 20: [2023-04-29 17:23:27,032] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 9: [2023-04-29 17:23:27,032] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 10: [2023-04-29 17:23:27,034] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 10: [2023-04-29 17:23:27,034] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 10: [2023-04-29 17:23:27,034] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 10: [2023-04-29 17:23:27,035] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 20: [2023-04-29 17:23:27,035] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 4: [2023-04-29 17:23:27,036] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 20: [2023-04-29 17:23:27,036] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 20: [2023-04-29 17:23:27,036] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 24: [2023-04-29 17:23:27,036] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 12: [2023-04-29 17:23:27,037] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 20: [2023-04-29 17:23:27,037] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 24: [2023-04-29 17:23:27,037] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 20: [2023-04-29 17:23:27,037] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 12: [2023-04-29 17:23:27,038] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 9: [2023-04-29 17:23:27,037] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 9: [2023-04-29 17:23:27,037] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 9: [2023-04-29 17:23:27,038] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 9: [2023-04-29 17:23:27,038] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 24: [2023-04-29 17:23:27,039] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 12: [2023-04-29 17:23:27,040] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 0: [2023-04-29 17:23:27,040] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 0: [2023-04-29 17:23:27,040] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 24: [2023-04-29 17:23:27,040] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 12: [2023-04-29 17:23:27,041] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 9: [2023-04-29 17:23:27,041] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 9: [2023-04-29 17:23:27,041] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 9: [2023-04-29 17:23:27,041] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 22: [2023-04-29 17:23:27,041] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 22: [2023-04-29 17:23:27,042] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 22: [2023-04-29 17:23:27,043] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 22: [2023-04-29 17:23:27,043] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 4: [2023-04-29 17:23:27,044] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 22: [2023-04-29 17:23:27,044] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 11: [2023-04-29 17:23:27,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 11: [2023-04-29 17:23:27,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 11: [2023-04-29 17:23:27,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 0: [2023-04-29 17:23:27,046] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 0: [2023-04-29 17:23:27,046] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 22: [2023-04-29 17:23:27,047] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 22: [2023-04-29 17:23:27,047] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 22: [2023-04-29 17:23:27,047] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 4: [2023-04-29 17:23:27,050] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 11: [2023-04-29 17:23:27,049] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 11: [2023-04-29 17:23:27,049] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 11: [2023-04-29 17:23:27,049] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 11: [2023-04-29 17:23:27,049] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 11: [2023-04-29 17:23:27,049] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 11: [2023-04-29 17:23:27,050] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 11: [2023-04-29 17:23:27,050] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 11: [2023-04-29 17:23:27,050] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 0: [2023-04-29 17:23:27,052] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 0: [2023-04-29 17:23:27,053] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 0: [2023-04-29 17:23:27,053] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 24: [2023-04-29 17:23:27,054] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 9: [2023-04-29 17:23:27,056] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 11: [2023-04-29 17:23:27,056] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 24: [2023-04-29 17:23:27,057] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 24: [2023-04-29 17:23:27,057] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 4: [2023-04-29 17:23:27,058] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 4: [2023-04-29 17:23:27,058] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 11: [2023-04-29 17:23:27,059] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 30: [2023-04-29 17:23:27,059] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 11: [2023-04-29 17:23:27,059] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 5: [2023-04-29 17:23:27,059] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 5: [2023-04-29 17:23:27,059] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 11: [2023-04-29 17:23:27,059] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 11: [2023-04-29 17:23:27,060] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 5: [2023-04-29 17:23:27,061] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 5: [2023-04-29 17:23:27,061] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 5: [2023-04-29 17:23:27,061] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 5: [2023-04-29 17:23:27,061] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 5: [2023-04-29 17:23:27,061] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 4: [2023-04-29 17:23:27,062] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 4: [2023-04-29 17:23:27,062] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 5: [2023-04-29 17:23:27,062] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 4: [2023-04-29 17:23:27,062] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 16: [2023-04-29 17:23:27,062] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 16: [2023-04-29 17:23:27,062] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 5: [2023-04-29 17:23:27,063] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 5: [2023-04-29 17:23:27,063] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 15: [2023-04-29 17:23:27,065] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 15: [2023-04-29 17:23:27,065] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 15: [2023-04-29 17:23:27,065] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 15: [2023-04-29 17:23:27,065] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 15: [2023-04-29 17:23:27,065] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 15: [2023-04-29 17:23:27,065] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 15: [2023-04-29 17:23:27,065] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 15: [2023-04-29 17:23:27,066] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 9: [2023-04-29 17:23:27,066] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 9: [2023-04-29 17:23:27,066] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 9: [2023-04-29 17:23:27,066] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 16: [2023-04-29 17:23:27,068] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 9: [2023-04-29 17:23:27,069] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 9: [2023-04-29 17:23:27,069] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 4: [2023-04-29 17:23:27,069] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 1: [2023-04-29 17:23:27,069] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 1: [2023-04-29 17:23:27,069] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 24: [2023-04-29 17:23:27,069] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 0: [2023-04-29 17:23:27,070] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 1: [2023-04-29 17:23:27,070] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 1: [2023-04-29 17:23:27,070] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 1: [2023-04-29 17:23:27,070] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 9: [2023-04-29 17:23:27,071] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 5: [2023-04-29 17:23:27,071] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 1: [2023-04-29 17:23:27,071] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 1: [2023-04-29 17:23:27,071] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 9: [2023-04-29 17:23:27,071] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 1: [2023-04-29 17:23:27,071] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 24: [2023-04-29 17:23:27,071] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 5: [2023-04-29 17:23:27,072] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 17: [2023-04-29 17:23:27,070] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 17: [2023-04-29 17:23:27,070] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 17: [2023-04-29 17:23:27,070] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 17: [2023-04-29 17:23:27,070] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 17: [2023-04-29 17:23:27,071] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 17: [2023-04-29 17:23:27,071] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 17: [2023-04-29 17:23:27,071] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 17: [2023-04-29 17:23:27,071] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 5: [2023-04-29 17:23:27,072] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 5: [2023-04-29 17:23:27,073] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 0: [2023-04-29 17:23:27,073] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 5: [2023-04-29 17:23:27,073] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 18: [2023-04-29 17:23:27,074] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 18: [2023-04-29 17:23:27,074] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 18: [2023-04-29 17:23:27,074] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 5: [2023-04-29 17:23:27,074] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 1: [2023-04-29 17:23:27,074] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 1: [2023-04-29 17:23:27,074] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 1: [2023-04-29 17:23:27,075] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 1: [2023-04-29 17:23:27,075] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 1: [2023-04-29 17:23:27,075] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 17: [2023-04-29 17:23:27,075] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 0: [2023-04-29 17:23:27,076] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 17: [2023-04-29 17:23:27,077] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 16: [2023-04-29 17:23:27,077] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 16: [2023-04-29 17:23:27,077] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 16: [2023-04-29 17:23:27,077] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 16: [2023-04-29 17:23:27,077] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 16: [2023-04-29 17:23:27,077] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 22: [2023-04-29 17:23:27,077] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 1: [2023-04-29 17:23:27,077] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 1: [2023-04-29 17:23:27,078] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 30: [2023-04-29 17:23:27,078] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 30: [2023-04-29 17:23:27,078] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 30: [2023-04-29 17:23:27,078] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 30: [2023-04-29 17:23:27,078] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 30: [2023-04-29 17:23:27,078] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 30: [2023-04-29 17:23:27,078] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 1: [2023-04-29 17:23:27,078] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 15: [2023-04-29 17:23:27,078] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 15: [2023-04-29 17:23:27,078] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 30: [2023-04-29 17:23:27,079] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 7: [2023-04-29 17:23:27,078] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 7: [2023-04-29 17:23:27,079] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 7: [2023-04-29 17:23:27,079] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 7: [2023-04-29 17:23:27,079] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 7: [2023-04-29 17:23:27,079] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 15: [2023-04-29 17:23:27,079] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 7: [2023-04-29 17:23:27,079] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 7: [2023-04-29 17:23:27,079] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 7: [2023-04-29 17:23:27,079] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 22: [2023-04-29 17:23:27,080] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 22: [2023-04-29 17:23:27,080] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 17: [2023-04-29 17:23:27,079] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 15: [2023-04-29 17:23:27,080] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 15: [2023-04-29 17:23:27,080] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 15: [2023-04-29 17:23:27,081] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 17: [2023-04-29 17:23:27,081] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 15: [2023-04-29 17:23:27,081] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 18: [2023-04-29 17:23:27,081] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 18: [2023-04-29 17:23:27,081] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 18: [2023-04-29 17:23:27,081] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 18: [2023-04-29 17:23:27,081] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 18: [2023-04-29 17:23:27,081] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 15: [2023-04-29 17:23:27,081] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 28: [2023-04-29 17:23:27,082] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 17: [2023-04-29 17:23:27,082] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 28: [2023-04-29 17:23:27,082] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 28: [2023-04-29 17:23:27,082] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 28: [2023-04-29 17:23:27,082] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 28: [2023-04-29 17:23:27,082] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 28: [2023-04-29 17:23:27,082] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 28: [2023-04-29 17:23:27,082] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 17: [2023-04-29 17:23:27,082] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 28: [2023-04-29 17:23:27,082] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 17: [2023-04-29 17:23:27,083] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 30: [2023-04-29 17:23:27,083] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 17: [2023-04-29 17:23:27,083] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 7: [2023-04-29 17:23:27,083] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 7: [2023-04-29 17:23:27,083] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 7: [2023-04-29 17:23:27,084] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 20: [2023-04-29 17:23:27,084] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 20: [2023-04-29 17:23:27,084] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 7: [2023-04-29 17:23:27,085] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 7: [2023-04-29 17:23:27,085] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 22: [2023-04-29 17:23:27,085] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 22: [2023-04-29 17:23:27,085] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 7: [2023-04-29 17:23:27,085] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 7: [2023-04-29 17:23:27,086] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 20: [2023-04-29 17:23:27,086] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 7: [2023-04-29 17:23:27,087] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 16: [2023-04-29 17:23:27,087] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 22: [2023-04-29 17:23:27,087] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 16: [2023-04-29 17:23:27,088] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 4: [2023-04-29 17:23:27,090] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 4: [2023-04-29 17:23:27,091] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 20: [2023-04-29 17:23:27,091] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 4: [2023-04-29 17:23:27,092] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 4: [2023-04-29 17:23:27,094] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 4: [2023-04-29 17:23:27,095] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 28: [2023-04-29 17:23:27,095] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 28: [2023-04-29 17:23:27,095] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 28: [2023-04-29 17:23:27,096] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 28: [2023-04-29 17:23:27,096] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 28: [2023-04-29 17:23:27,097] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 28: [2023-04-29 17:23:27,097] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 28: [2023-04-29 17:23:27,098] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 28: [2023-04-29 17:23:27,098] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt... 16: [2023-04-29 17:23:27,102] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 11: [2023-04-29 17:23:27,103] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 11: [2023-04-29 17:23:27,103] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 11: [2023-04-29 17:23:27,103] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 20: [2023-04-29 17:23:27,104] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 20: [2023-04-29 17:23:27,104] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 20: [2023-04-29 17:23:27,106] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 20: [2023-04-29 17:23:27,106] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 18: [2023-04-29 17:23:27,106] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 18: [2023-04-29 17:23:27,106] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 16: [2023-04-29 17:23:27,106] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 16: [2023-04-29 17:23:27,107] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 20: [2023-04-29 17:23:27,108] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 16: [2023-04-29 17:23:27,108] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 20: [2023-04-29 17:23:27,108] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 18: [2023-04-29 17:23:27,109] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 30: [2023-04-29 17:23:27,110] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 20: [2023-04-29 17:23:27,112] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 30: [2023-04-29 17:23:27,112] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 30: [2023-04-29 17:23:27,112] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 16: [2023-04-29 17:23:27,112] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 16: [2023-04-29 17:23:27,112] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 30: [2023-04-29 17:23:27,115] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 30: [2023-04-29 17:23:27,115] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 5: [2023-04-29 17:23:27,115] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 5: [2023-04-29 17:23:27,115] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 30: [2023-04-29 17:23:27,115] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 30: [2023-04-29 17:23:27,116] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 20: [2023-04-29 17:23:27,118] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 11: [2023-04-29 17:23:27,119] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 11: [2023-04-29 17:23:27,119] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 18: [2023-04-29 17:23:27,121] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 18: [2023-04-29 17:23:27,121] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 1: [2023-04-29 17:23:27,123] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 18: [2023-04-29 17:23:27,124] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 11: [2023-04-29 17:23:27,125] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 11: [2023-04-29 17:23:27,125] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 21: [2023-04-29 17:23:27,126] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 21: [2023-04-29 17:23:27,126] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 21: [2023-04-29 17:23:27,126] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 11: [2023-04-29 17:23:27,126] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 21: [2023-04-29 17:23:27,126] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 21: [2023-04-29 17:23:27,126] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 21: [2023-04-29 17:23:27,126] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 21: [2023-04-29 17:23:27,126] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 21: [2023-04-29 17:23:27,126] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 18: [2023-04-29 17:23:27,127] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 1: [2023-04-29 17:23:27,127] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 11: [2023-04-29 17:23:27,128] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 11: [2023-04-29 17:23:27,128] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 11: [2023-04-29 17:23:27,128] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 18: [2023-04-29 17:23:27,129] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 20: [2023-04-29 17:23:27,129] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 17: [2023-04-29 17:23:27,130] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 25: [2023-04-29 17:23:27,130] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 20: [2023-04-29 17:23:27,130] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 25: [2023-04-29 17:23:27,130] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 21: [2023-04-29 17:23:27,130] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 21: [2023-04-29 17:23:27,131] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 21: [2023-04-29 17:23:27,131] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 17: [2023-04-29 17:23:27,132] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 21: [2023-04-29 17:23:27,132] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 25: [2023-04-29 17:23:27,132] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 25: [2023-04-29 17:23:27,132] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 25: [2023-04-29 17:23:27,132] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 25: [2023-04-29 17:23:27,132] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 25: [2023-04-29 17:23:27,132] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 21: [2023-04-29 17:23:27,132] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 25: [2023-04-29 17:23:27,132] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 21: [2023-04-29 17:23:27,132] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 21: [2023-04-29 17:23:27,133] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 21: [2023-04-29 17:23:27,133] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 5: [2023-04-29 17:23:27,133] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 20: [2023-04-29 17:23:27,135] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 25: [2023-04-29 17:23:27,134] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 25: [2023-04-29 17:23:27,134] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 20: [2023-04-29 17:23:27,135] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 5: [2023-04-29 17:23:27,136] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 5: [2023-04-29 17:23:27,137] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 7: [2023-04-29 17:23:27,137] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 7: [2023-04-29 17:23:27,137] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 7: [2023-04-29 17:23:27,137] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 1: [2023-04-29 17:23:27,138] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 1: [2023-04-29 17:23:27,138] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 1: [2023-04-29 17:23:27,138] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 11: [2023-04-29 17:23:27,140] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 25: [2023-04-29 17:23:27,142] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 17: [2023-04-29 17:23:27,142] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 25: [2023-04-29 17:23:27,143] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 25: [2023-04-29 17:23:27,143] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 11: [2023-04-29 17:23:27,143] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 25: [2023-04-29 17:23:27,143] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 25: [2023-04-29 17:23:27,143] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 1: [2023-04-29 17:23:27,144] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 1: [2023-04-29 17:23:27,144] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 1: [2023-04-29 17:23:27,144] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 1: [2023-04-29 17:23:27,144] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 25: [2023-04-29 17:23:27,144] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 5: [2023-04-29 17:23:27,147] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 5: [2023-04-29 17:23:27,148] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 5: [2023-04-29 17:23:27,148] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 5: [2023-04-29 17:23:27,148] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 5: [2023-04-29 17:23:27,148] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 1: [2023-04-29 17:23:27,149] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 17: [2023-04-29 17:23:27,150] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 7: [2023-04-29 17:23:27,152] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 7: [2023-04-29 17:23:27,152] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 7: [2023-04-29 17:23:27,152] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 7: [2023-04-29 17:23:27,152] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 7: [2023-04-29 17:23:27,152] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 17: [2023-04-29 17:23:27,154] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 17: [2023-04-29 17:23:27,156] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 5: [2023-04-29 17:23:27,157] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 17: [2023-04-29 17:23:27,158] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 11: [2023-04-29 17:23:27,158] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 15: [2023-04-29 17:23:27,159] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 11: [2023-04-29 17:23:27,159] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 11: [2023-04-29 17:23:27,159] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 15: [2023-04-29 17:23:27,160] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 15: [2023-04-29 17:23:27,160] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 15: [2023-04-29 17:23:27,160] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 15: [2023-04-29 17:23:27,160] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 7: [2023-04-29 17:23:27,160] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 17: [2023-04-29 17:23:27,160] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 1: [2023-04-29 17:23:27,161] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 7: [2023-04-29 17:23:27,162] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 1: [2023-04-29 17:23:27,163] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 7: [2023-04-29 17:23:27,163] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 15: [2023-04-29 17:23:27,164] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 15: [2023-04-29 17:23:27,164] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 15: [2023-04-29 17:23:27,164] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 17: [2023-04-29 17:23:27,164] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 17: [2023-04-29 17:23:27,165] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 1: [2023-04-29 17:23:27,168] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 1: [2023-04-29 17:23:27,170] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 1: [2023-04-29 17:23:27,170] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 1: [2023-04-29 17:23:27,170] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 28: [2023-04-29 17:23:27,172] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 28: [2023-04-29 17:23:27,172] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 28: [2023-04-29 17:23:27,172] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 17: [2023-04-29 17:23:27,176] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 5: [2023-04-29 17:23:27,179] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 5: [2023-04-29 17:23:27,179] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 5: [2023-04-29 17:23:27,180] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 7: [2023-04-29 17:23:27,181] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 7: [2023-04-29 17:23:27,181] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 5: [2023-04-29 17:23:27,182] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 5: [2023-04-29 17:23:27,182] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 7: [2023-04-29 17:23:27,184] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 21: [2023-04-29 17:23:27,184] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 21: [2023-04-29 17:23:27,184] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 21: [2023-04-29 17:23:27,184] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 25: [2023-04-29 17:23:27,185] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 25: [2023-04-29 17:23:27,185] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 7: [2023-04-29 17:23:27,187] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 7: [2023-04-29 17:23:27,187] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 28: [2023-04-29 17:23:27,187] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 28: [2023-04-29 17:23:27,187] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 28: [2023-04-29 17:23:27,187] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 28: [2023-04-29 17:23:27,187] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 28: [2023-04-29 17:23:27,187] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_24-model_00-model_states.pt. 17: [2023-04-29 17:23:27,191] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 17: [2023-04-29 17:23:27,191] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 17: [2023-04-29 17:23:27,191] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 15: [2023-04-29 17:23:27,193] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 17: [2023-04-29 17:23:27,194] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 17: [2023-04-29 17:23:27,196] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 21: [2023-04-29 17:23:27,199] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 21: [2023-04-29 17:23:27,199] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 21: [2023-04-29 17:23:27,199] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 21: [2023-04-29 17:23:27,199] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 21: [2023-04-29 17:23:27,199] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 15: [2023-04-29 17:23:27,202] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 15: [2023-04-29 17:23:27,202] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 15: [2023-04-29 17:23:27,203] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 15: [2023-04-29 17:23:27,203] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 15: [2023-04-29 17:23:27,205] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 28: [2023-04-29 17:23:27,204] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 21: [2023-04-29 17:23:27,206] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 28: [2023-04-29 17:23:27,207] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 28: [2023-04-29 17:23:27,207] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 25: [2023-04-29 17:23:27,207] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 21: [2023-04-29 17:23:27,207] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 15: [2023-04-29 17:23:27,205] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 15: [2023-04-29 17:23:27,207] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 25: [2023-04-29 17:23:27,207] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 21: [2023-04-29 17:23:27,208] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 25: [2023-04-29 17:23:27,210] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 25: [2023-04-29 17:23:27,213] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 25: [2023-04-29 17:23:27,213] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 25: [2023-04-29 17:23:27,215] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 25: [2023-04-29 17:23:27,215] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 25: [2023-04-29 17:23:27,215] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 14: [2023-04-29 17:23:27,216] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 14: [2023-04-29 17:23:27,216] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 14: [2023-04-29 17:23:27,216] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 14: [2023-04-29 17:23:27,216] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 14: [2023-04-29 17:23:27,216] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 14: [2023-04-29 17:23:27,216] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 14: [2023-04-29 17:23:27,216] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 14: [2023-04-29 17:23:27,217] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 14: [2023-04-29 17:23:27,219] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 14: [2023-04-29 17:23:27,220] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 14: [2023-04-29 17:23:27,221] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 28: [2023-04-29 17:23:27,222] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 28: [2023-04-29 17:23:27,222] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 28: [2023-04-29 17:23:27,222] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 28: [2023-04-29 17:23:27,224] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 21: [2023-04-29 17:23:27,226] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 21: [2023-04-29 17:23:27,227] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 21: [2023-04-29 17:23:27,227] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 14: [2023-04-29 17:23:27,227] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 14: [2023-04-29 17:23:27,227] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 14: [2023-04-29 17:23:27,228] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 14: [2023-04-29 17:23:27,228] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 28: [2023-04-29 17:23:27,228] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 21: [2023-04-29 17:23:27,229] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 14: [2023-04-29 17:23:27,229] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 21: [2023-04-29 17:23:27,229] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 25: [2023-04-29 17:23:27,238] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 3: [2023-04-29 17:23:27,240] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 3: [2023-04-29 17:23:27,240] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 3: [2023-04-29 17:23:27,240] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 3: [2023-04-29 17:23:27,240] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 3: [2023-04-29 17:23:27,240] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 3: [2023-04-29 17:23:27,240] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 3: [2023-04-29 17:23:27,240] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 3: [2023-04-29 17:23:27,240] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 29: [2023-04-29 17:23:27,241] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 29: [2023-04-29 17:23:27,241] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 13: [2023-04-29 17:23:27,241] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 19: [2023-04-29 17:23:27,242] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 19: [2023-04-29 17:23:27,242] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 13: [2023-04-29 17:23:27,242] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 13: [2023-04-29 17:23:27,242] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 13: [2023-04-29 17:23:27,242] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 13: [2023-04-29 17:23:27,242] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 13: [2023-04-29 17:23:27,242] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 13: [2023-04-29 17:23:27,242] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 13: [2023-04-29 17:23:27,242] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 29: [2023-04-29 17:23:27,243] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 29: [2023-04-29 17:23:27,243] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 29: [2023-04-29 17:23:27,243] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 29: [2023-04-29 17:23:27,243] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 29: [2023-04-29 17:23:27,243] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 29: [2023-04-29 17:23:27,244] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 19: [2023-04-29 17:23:27,244] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 19: [2023-04-29 17:23:27,244] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 12: [2023-04-29 17:23:27,243] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 12: [2023-04-29 17:23:27,243] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 12: [2023-04-29 17:23:27,243] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 12: [2023-04-29 17:23:27,244] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 12: [2023-04-29 17:23:27,244] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 12: [2023-04-29 17:23:27,244] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 12: [2023-04-29 17:23:27,244] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 3: [2023-04-29 17:23:27,244] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 12: [2023-04-29 17:23:27,244] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 19: [2023-04-29 17:23:27,244] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 19: [2023-04-29 17:23:27,244] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 19: [2023-04-29 17:23:27,244] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 3: [2023-04-29 17:23:27,244] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 19: [2023-04-29 17:23:27,244] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 29: [2023-04-29 17:23:27,245] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 19: [2023-04-29 17:23:27,245] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 29: [2023-04-29 17:23:27,245] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 25: [2023-04-29 17:23:27,245] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 19: [2023-04-29 17:23:27,247] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 13: [2023-04-29 17:23:27,247] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 13: [2023-04-29 17:23:27,248] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 3: [2023-04-29 17:23:27,248] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 12: [2023-04-29 17:23:27,249] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 12: [2023-04-29 17:23:27,249] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 19: [2023-04-29 17:23:27,249] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 3: [2023-04-29 17:23:27,249] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 13: [2023-04-29 17:23:27,249] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 3: [2023-04-29 17:23:27,250] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 13: [2023-04-29 17:23:27,250] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 3: [2023-04-29 17:23:27,250] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 12: [2023-04-29 17:23:27,250] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 3: [2023-04-29 17:23:27,250] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 25: [2023-04-29 17:23:27,248] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 25: [2023-04-29 17:23:27,249] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 25: [2023-04-29 17:23:27,249] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 3: [2023-04-29 17:23:27,250] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 12: [2023-04-29 17:23:27,251] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 12: [2023-04-29 17:23:27,252] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 25: [2023-04-29 17:23:27,252] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 12: [2023-04-29 17:23:27,252] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 19: [2023-04-29 17:23:27,252] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 13: [2023-04-29 17:23:27,252] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 13: [2023-04-29 17:23:27,252] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 12: [2023-04-29 17:23:27,253] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 29: [2023-04-29 17:23:27,253] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 29: [2023-04-29 17:23:27,253] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 13: [2023-04-29 17:23:27,254] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 13: [2023-04-29 17:23:27,254] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 29: [2023-04-29 17:23:27,254] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 12: [2023-04-29 17:23:27,254] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 19: [2023-04-29 17:23:27,254] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 19: [2023-04-29 17:23:27,254] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 19: [2023-04-29 17:23:27,254] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 29: [2023-04-29 17:23:27,254] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 19: [2023-04-29 17:23:27,255] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 29: [2023-04-29 17:23:27,255] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 29: [2023-04-29 17:23:27,256] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 14: [2023-04-29 17:23:27,271] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 14: [2023-04-29 17:23:27,274] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 2: [2023-04-29 17:23:27,281] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 2: [2023-04-29 17:23:27,281] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 14: [2023-04-29 17:23:27,281] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 2: [2023-04-29 17:23:27,284] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 2: [2023-04-29 17:23:27,284] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 2: [2023-04-29 17:23:27,284] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 2: [2023-04-29 17:23:27,284] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 2: [2023-04-29 17:23:27,284] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 2: [2023-04-29 17:23:27,285] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 2: [2023-04-29 17:23:27,285] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 2: [2023-04-29 17:23:27,286] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 2: [2023-04-29 17:23:27,289] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 14: [2023-04-29 17:23:27,291] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 2: [2023-04-29 17:23:27,291] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 2: [2023-04-29 17:23:27,293] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 19: [2023-04-29 17:23:27,292] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 2: [2023-04-29 17:23:27,293] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 2: [2023-04-29 17:23:27,294] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 2: [2023-04-29 17:23:27,295] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 14: [2023-04-29 17:23:27,295] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 12: [2023-04-29 17:23:27,295] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 29: [2023-04-29 17:23:27,296] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 29: [2023-04-29 17:23:27,296] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 3: [2023-04-29 17:23:27,297] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 3: [2023-04-29 17:23:27,297] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 12: [2023-04-29 17:23:27,300] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 13: [2023-04-29 17:23:27,303] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 13: [2023-04-29 17:23:27,303] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 14: [2023-04-29 17:23:27,306] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 14: [2023-04-29 17:23:27,306] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 13: [2023-04-29 17:23:27,307] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 19: [2023-04-29 17:23:27,308] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 19: [2023-04-29 17:23:27,308] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 14: [2023-04-29 17:23:27,310] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 14: [2023-04-29 17:23:27,310] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 14: [2023-04-29 17:23:27,310] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 14: [2023-04-29 17:23:27,310] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 12: [2023-04-29 17:23:27,312] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 19: [2023-04-29 17:23:27,313] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 3: [2023-04-29 17:23:27,313] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 19: [2023-04-29 17:23:27,313] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 4: [2023-04-29 17:23:27,315] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 4: [2023-04-29 17:23:27,316] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 13: [2023-04-29 17:23:27,317] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 4: [2023-04-29 17:23:27,317] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 4: [2023-04-29 17:23:27,317] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 4: [2023-04-29 17:23:27,317] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 4: [2023-04-29 17:23:27,317] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 4: [2023-04-29 17:23:27,317] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 3: [2023-04-29 17:23:27,317] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 4: [2023-04-29 17:23:27,318] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 12: [2023-04-29 17:23:27,318] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 29: [2023-04-29 17:23:27,318] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 29: [2023-04-29 17:23:27,318] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 3: [2023-04-29 17:23:27,319] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 12: [2023-04-29 17:23:27,319] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 12: [2023-04-29 17:23:27,319] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 12: [2023-04-29 17:23:27,319] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 12: [2023-04-29 17:23:27,319] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 12: [2023-04-29 17:23:27,319] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 3: [2023-04-29 17:23:27,319] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 4: [2023-04-29 17:23:27,320] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 4: [2023-04-29 17:23:27,320] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 29: [2023-04-29 17:23:27,320] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 19: [2023-04-29 17:23:27,322] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 12: [2023-04-29 17:23:27,324] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 29: [2023-04-29 17:23:27,325] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 29: [2023-04-29 17:23:27,325] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 4: [2023-04-29 17:23:27,325] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 3: [2023-04-29 17:23:27,325] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 19: [2023-04-29 17:23:27,326] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 3: [2023-04-29 17:23:27,326] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 19: [2023-04-29 17:23:27,326] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 19: [2023-04-29 17:23:27,326] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 3: [2023-04-29 17:23:27,326] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 3: [2023-04-29 17:23:27,326] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 13: [2023-04-29 17:23:27,326] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 13: [2023-04-29 17:23:27,326] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 13: [2023-04-29 17:23:27,326] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 4: [2023-04-29 17:23:27,328] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 4: [2023-04-29 17:23:27,329] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 4: [2023-04-29 17:23:27,330] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 13: [2023-04-29 17:23:27,330] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 19: [2023-04-29 17:23:27,330] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 13: [2023-04-29 17:23:27,330] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 4: [2023-04-29 17:23:27,331] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 4: [2023-04-29 17:23:27,331] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 19: [2023-04-29 17:23:27,332] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 29: [2023-04-29 17:23:27,334] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 29: [2023-04-29 17:23:27,334] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 29: [2023-04-29 17:23:27,334] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 2: [2023-04-29 17:23:27,334] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 2: [2023-04-29 17:23:27,334] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 14: [2023-04-29 17:23:27,335] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 13: [2023-04-29 17:23:27,336] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 14: [2023-04-29 17:23:27,339] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 19: [2023-04-29 17:23:27,340] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 12: [2023-04-29 17:23:27,340] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 14: [2023-04-29 17:23:27,341] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 13: [2023-04-29 17:23:27,342] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 14: [2023-04-29 17:23:27,343] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 14: [2023-04-29 17:23:27,343] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 3: [2023-04-29 17:23:27,344] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 3: [2023-04-29 17:23:27,345] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 13: [2023-04-29 17:23:27,345] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 12: [2023-04-29 17:23:27,346] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 29: [2023-04-29 17:23:27,347] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 2: [2023-04-29 17:23:27,351] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 23: [2023-04-29 17:23:27,351] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 23: [2023-04-29 17:23:27,351] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 23: [2023-04-29 17:23:27,352] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 23: [2023-04-29 17:23:27,352] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 23: [2023-04-29 17:23:27,352] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 3: [2023-04-29 17:23:27,352] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 23: [2023-04-29 17:23:27,352] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 23: [2023-04-29 17:23:27,352] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 23: [2023-04-29 17:23:27,352] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 29: [2023-04-29 17:23:27,353] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 19: [2023-04-29 17:23:27,353] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 12: [2023-04-29 17:23:27,354] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 12: [2023-04-29 17:23:27,354] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 19: [2023-04-29 17:23:27,355] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 19: [2023-04-29 17:23:27,356] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 29: [2023-04-29 17:23:27,355] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 19: [2023-04-29 17:23:27,356] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 3: [2023-04-29 17:23:27,356] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 12: [2023-04-29 17:23:27,356] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 3: [2023-04-29 17:23:27,356] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 3: [2023-04-29 17:23:27,357] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 2: [2023-04-29 17:23:27,357] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 2: [2023-04-29 17:23:27,357] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 2: [2023-04-29 17:23:27,357] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 23: [2023-04-29 17:23:27,357] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 23: [2023-04-29 17:23:27,357] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 12: [2023-04-29 17:23:27,357] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 23: [2023-04-29 17:23:27,358] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 2: [2023-04-29 17:23:27,359] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 13: [2023-04-29 17:23:27,359] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 13: [2023-04-29 17:23:27,359] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 13: [2023-04-29 17:23:27,359] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 23: [2023-04-29 17:23:27,361] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 23: [2023-04-29 17:23:27,362] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 23: [2023-04-29 17:23:27,363] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 23: [2023-04-29 17:23:27,363] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 0: [2023-04-29 17:23:27,363] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 0: [2023-04-29 17:23:27,363] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 23: [2023-04-29 17:23:27,363] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 0: [2023-04-29 17:23:27,363] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 0: [2023-04-29 17:23:27,363] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 0: [2023-04-29 17:23:27,363] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 0: [2023-04-29 17:23:27,363] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 0: [2023-04-29 17:23:27,363] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 0: [2023-04-29 17:23:27,364] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 2: [2023-04-29 17:23:27,364] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 2: [2023-04-29 17:23:27,364] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 29: [2023-04-29 17:23:27,364] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 2: [2023-04-29 17:23:27,365] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 29: [2023-04-29 17:23:27,366] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 29: [2023-04-29 17:23:27,366] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 13: [2023-04-29 17:23:27,366] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 30: [2023-04-29 17:23:27,366] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 30: [2023-04-29 17:23:27,367] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 30: [2023-04-29 17:23:27,367] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 30: [2023-04-29 17:23:27,367] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 30: [2023-04-29 17:23:27,367] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 30: [2023-04-29 17:23:27,367] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 30: [2023-04-29 17:23:27,367] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 30: [2023-04-29 17:23:27,367] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 4: [2023-04-29 17:23:27,371] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 4: [2023-04-29 17:23:27,371] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 18: [2023-04-29 17:23:27,370] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 18: [2023-04-29 17:23:27,370] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 18: [2023-04-29 17:23:27,370] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 18: [2023-04-29 17:23:27,371] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 18: [2023-04-29 17:23:27,371] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 18: [2023-04-29 17:23:27,371] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 18: [2023-04-29 17:23:27,371] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 18: [2023-04-29 17:23:27,371] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 0: [2023-04-29 17:23:27,372] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 0: [2023-04-29 17:23:27,375] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 2: [2023-04-29 17:23:27,375] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 27: [2023-04-29 17:23:27,375] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 27: [2023-04-29 17:23:27,375] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 27: [2023-04-29 17:23:27,375] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 27: [2023-04-29 17:23:27,375] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 27: [2023-04-29 17:23:27,375] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 27: [2023-04-29 17:23:27,375] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 27: [2023-04-29 17:23:27,375] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 27: [2023-04-29 17:23:27,376] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 30: [2023-04-29 17:23:27,376] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 30: [2023-04-29 17:23:27,376] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 0: [2023-04-29 17:23:27,377] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 0: [2023-04-29 17:23:27,377] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 0: [2023-04-29 17:23:27,377] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 27: [2023-04-29 17:23:27,378] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 30: [2023-04-29 17:23:27,377] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 30: [2023-04-29 17:23:27,378] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 30: [2023-04-29 17:23:27,378] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 0: [2023-04-29 17:23:27,378] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 0: [2023-04-29 17:23:27,378] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 18: [2023-04-29 17:23:27,379] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 30: [2023-04-29 17:23:27,378] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 30: [2023-04-29 17:23:27,379] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 0: [2023-04-29 17:23:27,379] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 30: [2023-04-29 17:23:27,380] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 11: [2023-04-29 17:23:27,380] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 2: [2023-04-29 17:23:27,381] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 11: [2023-04-29 17:23:27,380] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 11: [2023-04-29 17:23:27,383] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 18: [2023-04-29 17:23:27,384] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 11: [2023-04-29 17:23:27,384] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 11: [2023-04-29 17:23:27,384] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 11: [2023-04-29 17:23:27,384] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 11: [2023-04-29 17:23:27,384] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 18: [2023-04-29 17:23:27,384] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 18: [2023-04-29 17:23:27,384] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 11: [2023-04-29 17:23:27,384] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 11: [2023-04-29 17:23:27,385] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 11: [2023-04-29 17:23:27,385] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 18: [2023-04-29 17:23:27,385] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 18: [2023-04-29 17:23:27,386] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 18: [2023-04-29 17:23:27,386] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 18: [2023-04-29 17:23:27,387] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 4: [2023-04-29 17:23:27,387] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 11: [2023-04-29 17:23:27,387] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 27: [2023-04-29 17:23:27,387] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 27: [2023-04-29 17:23:27,388] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 27: [2023-04-29 17:23:27,389] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 2: [2023-04-29 17:23:27,389] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 10: [2023-04-29 17:23:27,389] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 10: [2023-04-29 17:23:27,389] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 27: [2023-04-29 17:23:27,389] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 10: [2023-04-29 17:23:27,389] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 10: [2023-04-29 17:23:27,389] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 10: [2023-04-29 17:23:27,389] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 10: [2023-04-29 17:23:27,389] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 10: [2023-04-29 17:23:27,389] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 10: [2023-04-29 17:23:27,389] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 27: [2023-04-29 17:23:27,390] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 27: [2023-04-29 17:23:27,390] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 11: [2023-04-29 17:23:27,390] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 4: [2023-04-29 17:23:27,390] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 27: [2023-04-29 17:23:27,390] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 11: [2023-04-29 17:23:27,391] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 4: [2023-04-29 17:23:27,392] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 11: [2023-04-29 17:23:27,392] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 31: [2023-04-29 17:23:27,393] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 31: [2023-04-29 17:23:27,393] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 31: [2023-04-29 17:23:27,393] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 10: [2023-04-29 17:23:27,393] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 31: [2023-04-29 17:23:27,393] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 31: [2023-04-29 17:23:27,393] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 31: [2023-04-29 17:23:27,393] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 31: [2023-04-29 17:23:27,393] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 31: [2023-04-29 17:23:27,394] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 11: [2023-04-29 17:23:27,394] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 10: [2023-04-29 17:23:27,394] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 11: [2023-04-29 17:23:27,394] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 10: [2023-04-29 17:23:27,395] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 10: [2023-04-29 17:23:27,395] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 2: [2023-04-29 17:23:27,396] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 2: [2023-04-29 17:23:27,396] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 2: [2023-04-29 17:23:27,396] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 31: [2023-04-29 17:23:27,398] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 31: [2023-04-29 17:23:27,398] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 31: [2023-04-29 17:23:27,398] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 10: [2023-04-29 17:23:27,397] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 31: [2023-04-29 17:23:27,398] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 10: [2023-04-29 17:23:27,398] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 10: [2023-04-29 17:23:27,398] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 10: [2023-04-29 17:23:27,399] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 31: [2023-04-29 17:23:27,399] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 31: [2023-04-29 17:23:27,400] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 31: [2023-04-29 17:23:27,400] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 31: [2023-04-29 17:23:27,400] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 4: [2023-04-29 17:23:27,400] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 4: [2023-04-29 17:23:27,400] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 6: [2023-04-29 17:23:27,403] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 6: [2023-04-29 17:23:27,403] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 6: [2023-04-29 17:23:27,403] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 6: [2023-04-29 17:23:27,403] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 6: [2023-04-29 17:23:27,403] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 6: [2023-04-29 17:23:27,403] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 6: [2023-04-29 17:23:27,403] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 6: [2023-04-29 17:23:27,403] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 6: [2023-04-29 17:23:27,407] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 4: [2023-04-29 17:23:27,408] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 4: [2023-04-29 17:23:27,408] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 4: [2023-04-29 17:23:27,408] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 6: [2023-04-29 17:23:27,408] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 23: [2023-04-29 17:23:27,410] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 6: [2023-04-29 17:23:27,411] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 6: [2023-04-29 17:23:27,413] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 4: [2023-04-29 17:23:27,413] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 6: [2023-04-29 17:23:27,413] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 23: [2023-04-29 17:23:27,414] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 6: [2023-04-29 17:23:27,414] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 6: [2023-04-29 17:23:27,414] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 6: [2023-04-29 17:23:27,415] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 28: [2023-04-29 17:23:27,415] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 28: [2023-04-29 17:23:27,415] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 28: [2023-04-29 17:23:27,415] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 28: [2023-04-29 17:23:27,415] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 28: [2023-04-29 17:23:27,415] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 28: [2023-04-29 17:23:27,415] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 28: [2023-04-29 17:23:27,415] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 28: [2023-04-29 17:23:27,416] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 28: [2023-04-29 17:23:27,422] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 23: [2023-04-29 17:23:27,425] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 23: [2023-04-29 17:23:27,425] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 9: [2023-04-29 17:23:27,425] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 9: [2023-04-29 17:23:27,425] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 9: [2023-04-29 17:23:27,425] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 9: [2023-04-29 17:23:27,425] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 9: [2023-04-29 17:23:27,425] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 9: [2023-04-29 17:23:27,426] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 9: [2023-04-29 17:23:27,426] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 9: [2023-04-29 17:23:27,426] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 27: [2023-04-29 17:23:27,427] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 28: [2023-04-29 17:23:27,427] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 28: [2023-04-29 17:23:27,428] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 28: [2023-04-29 17:23:27,429] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 28: [2023-04-29 17:23:27,430] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 28: [2023-04-29 17:23:27,430] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 28: [2023-04-29 17:23:27,431] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 4: [2023-04-29 17:23:27,431] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 9: [2023-04-29 17:23:27,431] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 9: [2023-04-29 17:23:27,431] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 9: [2023-04-29 17:23:27,431] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 9: [2023-04-29 17:23:27,431] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 9: [2023-04-29 17:23:27,431] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 9: [2023-04-29 17:23:27,432] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 9: [2023-04-29 17:23:27,432] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 28: [2023-04-29 17:23:27,432] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 4: [2023-04-29 17:23:27,432] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 23: [2023-04-29 17:23:27,432] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 9: [2023-04-29 17:23:27,432] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 26: [2023-04-29 17:23:27,433] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 26: [2023-04-29 17:23:27,434] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 26: [2023-04-29 17:23:27,434] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 26: [2023-04-29 17:23:27,434] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 26: [2023-04-29 17:23:27,434] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 26: [2023-04-29 17:23:27,434] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 26: [2023-04-29 17:23:27,434] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 26: [2023-04-29 17:23:27,435] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 23: [2023-04-29 17:23:27,436] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 4: [2023-04-29 17:23:27,436] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 23: [2023-04-29 17:23:27,437] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 4: [2023-04-29 17:23:27,438] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 23: [2023-04-29 17:23:27,438] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 23: [2023-04-29 17:23:27,438] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 4: [2023-04-29 17:23:27,438] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 11: [2023-04-29 17:23:27,439] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 11: [2023-04-29 17:23:27,439] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 11: [2023-04-29 17:23:27,439] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 26: [2023-04-29 17:23:27,440] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 26: [2023-04-29 17:23:27,440] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 26: [2023-04-29 17:23:27,441] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 26: [2023-04-29 17:23:27,442] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 26: [2023-04-29 17:23:27,442] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 26: [2023-04-29 17:23:27,442] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 26: [2023-04-29 17:23:27,443] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 26: [2023-04-29 17:23:27,443] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 10: [2023-04-29 17:23:27,444] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 10: [2023-04-29 17:23:27,444] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 18: [2023-04-29 17:23:27,445] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 11: [2023-04-29 17:23:27,446] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 27: [2023-04-29 17:23:27,446] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 23: [2023-04-29 17:23:27,447] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 11: [2023-04-29 17:23:27,449] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 23: [2023-04-29 17:23:27,451] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 11: [2023-04-29 17:23:27,451] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 0: [2023-04-29 17:23:27,453] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 31: [2023-04-29 17:23:27,453] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 31: [2023-04-29 17:23:27,453] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 31: [2023-04-29 17:23:27,453] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 23: [2023-04-29 17:23:27,454] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 30: [2023-04-29 17:23:27,456] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 31: [2023-04-29 17:23:27,456] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 0: [2023-04-29 17:23:27,457] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 10: [2023-04-29 17:23:27,458] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 10: [2023-04-29 17:23:27,458] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 27: [2023-04-29 17:23:27,460] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 10: [2023-04-29 17:23:27,460] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 10: [2023-04-29 17:23:27,460] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 10: [2023-04-29 17:23:27,460] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 10: [2023-04-29 17:23:27,460] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 0: [2023-04-29 17:23:27,461] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 6: [2023-04-29 17:23:27,461] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 6: [2023-04-29 17:23:27,461] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 27: [2023-04-29 17:23:27,461] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 27: [2023-04-29 17:23:27,461] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 11: [2023-04-29 17:23:27,462] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 27: [2023-04-29 17:23:27,463] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 11: [2023-04-29 17:23:27,463] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 11: [2023-04-29 17:23:27,463] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 30: [2023-04-29 17:23:27,463] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 30: [2023-04-29 17:23:27,464] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 23: [2023-04-29 17:23:27,465] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 0: [2023-04-29 17:23:27,465] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 18: [2023-04-29 17:23:27,465] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 18: [2023-04-29 17:23:27,465] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 30: [2023-04-29 17:23:27,467] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 30: [2023-04-29 17:23:27,467] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 10: [2023-04-29 17:23:27,467] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 23: [2023-04-29 17:23:27,468] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 10: [2023-04-29 17:23:27,468] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 31: [2023-04-29 17:23:27,468] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 31: [2023-04-29 17:23:27,468] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 31: [2023-04-29 17:23:27,468] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 31: [2023-04-29 17:23:27,468] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 23: [2023-04-29 17:23:27,468] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 15: [2023-04-29 17:23:27,468] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 15: [2023-04-29 17:23:27,468] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 15: [2023-04-29 17:23:27,469] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 15: [2023-04-29 17:23:27,469] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 15: [2023-04-29 17:23:27,469] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 15: [2023-04-29 17:23:27,469] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 15: [2023-04-29 17:23:27,469] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 15: [2023-04-29 17:23:27,469] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 27: [2023-04-29 17:23:27,469] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 27: [2023-04-29 17:23:27,469] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 27: [2023-04-29 17:23:27,469] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 0: [2023-04-29 17:23:27,471] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 0: [2023-04-29 17:23:27,471] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 11: [2023-04-29 17:23:27,472] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 11: [2023-04-29 17:23:27,472] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 11: [2023-04-29 17:23:27,472] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 18: [2023-04-29 17:23:27,473] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 18: [2023-04-29 17:23:27,473] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 31: [2023-04-29 17:23:27,475] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 11: [2023-04-29 17:23:27,475] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 23: [2023-04-29 17:23:27,475] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 0: [2023-04-29 17:23:27,475] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 0: [2023-04-29 17:23:27,476] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 31: [2023-04-29 17:23:27,476] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 31: [2023-04-29 17:23:27,477] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 6: [2023-04-29 17:23:27,477] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 18: [2023-04-29 17:23:27,478] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 15: [2023-04-29 17:23:27,478] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 15: [2023-04-29 17:23:27,478] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 11: [2023-04-29 17:23:27,480] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 15: [2023-04-29 17:23:27,481] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 15: [2023-04-29 17:23:27,481] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 31: [2023-04-29 17:23:27,482] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 6: [2023-04-29 17:23:27,482] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 15: [2023-04-29 17:23:27,482] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 0: [2023-04-29 17:23:27,482] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 30: [2023-04-29 17:23:27,482] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 15: [2023-04-29 17:23:27,483] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 6: [2023-04-29 17:23:27,483] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 15: [2023-04-29 17:23:27,483] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 15: [2023-04-29 17:23:27,483] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt... 6: [2023-04-29 17:23:27,484] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 10: [2023-04-29 17:23:27,485] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 0: [2023-04-29 17:23:27,486] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 0: [2023-04-29 17:23:27,486] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 10: [2023-04-29 17:23:27,486] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 28: [2023-04-29 17:23:27,486] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 30: [2023-04-29 17:23:27,489] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 30: [2023-04-29 17:23:27,489] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 30: [2023-04-29 17:23:27,489] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 9: [2023-04-29 17:23:27,489] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 9: [2023-04-29 17:23:27,489] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 9: [2023-04-29 17:23:27,489] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 9: [2023-04-29 17:23:27,489] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 18: [2023-04-29 17:23:27,490] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 18: [2023-04-29 17:23:27,490] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 18: [2023-04-29 17:23:27,490] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 10: [2023-04-29 17:23:27,487] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 10: [2023-04-29 17:23:27,490] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 10: [2023-04-29 17:23:27,490] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 10: [2023-04-29 17:23:27,490] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 27: [2023-04-29 17:23:27,492] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 6: [2023-04-29 17:23:27,492] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 6: [2023-04-29 17:23:27,492] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 6: [2023-04-29 17:23:27,492] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 6: [2023-04-29 17:23:27,493] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 31: [2023-04-29 17:23:27,493] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 27: [2023-04-29 17:23:27,493] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 27: [2023-04-29 17:23:27,493] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 9: [2023-04-29 17:23:27,493] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 9: [2023-04-29 17:23:27,493] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 9: [2023-04-29 17:23:27,493] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 26: [2023-04-29 17:23:27,494] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 9: [2023-04-29 17:23:27,495] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 31: [2023-04-29 17:23:27,495] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 31: [2023-04-29 17:23:27,496] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 26: [2023-04-29 17:23:27,496] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 30: [2023-04-29 17:23:27,496] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 26: [2023-04-29 17:23:27,496] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 31: [2023-04-29 17:23:27,496] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 27: [2023-04-29 17:23:27,496] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 11: [2023-04-29 17:23:27,498] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 11: [2023-04-29 17:23:27,498] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 18: [2023-04-29 17:23:27,499] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 18: [2023-04-29 17:23:27,499] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 30: [2023-04-29 17:23:27,501] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 18: [2023-04-29 17:23:27,502] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 0: [2023-04-29 17:23:27,503] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 6: [2023-04-29 17:23:27,503] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 26: [2023-04-29 17:23:27,503] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 30: [2023-04-29 17:23:27,504] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 27: [2023-04-29 17:23:27,504] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 30: [2023-04-29 17:23:27,505] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 0: [2023-04-29 17:23:27,506] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 27: [2023-04-29 17:23:27,506] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 0: [2023-04-29 17:23:27,507] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 26: [2023-04-29 17:23:27,507] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 26: [2023-04-29 17:23:27,507] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 26: [2023-04-29 17:23:27,507] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 26: [2023-04-29 17:23:27,507] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 18: [2023-04-29 17:23:27,507] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 27: [2023-04-29 17:23:27,509] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 0: [2023-04-29 17:23:27,509] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 0: [2023-04-29 17:23:27,509] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 28: [2023-04-29 17:23:27,509] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 6: [2023-04-29 17:23:27,511] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 28: [2023-04-29 17:23:27,513] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 28: [2023-04-29 17:23:27,513] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 28: [2023-04-29 17:23:27,513] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 9: [2023-04-29 17:23:27,518] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 9: [2023-04-29 17:23:27,519] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 30: [2023-04-29 17:23:27,520] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 30: [2023-04-29 17:23:27,520] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 26: [2023-04-29 17:23:27,520] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 30: [2023-04-29 17:23:27,520] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 26: [2023-04-29 17:23:27,520] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 9: [2023-04-29 17:23:27,520] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 18: [2023-04-29 17:23:27,521] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 9: [2023-04-29 17:23:27,521] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 18: [2023-04-29 17:23:27,521] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 18: [2023-04-29 17:23:27,521] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 6: [2023-04-29 17:23:27,524] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 9: [2023-04-29 17:23:27,524] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 26: [2023-04-29 17:23:27,524] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 6: [2023-04-29 17:23:27,524] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 6: [2023-04-29 17:23:27,525] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 6: [2023-04-29 17:23:27,525] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 9: [2023-04-29 17:23:27,526] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 9: [2023-04-29 17:23:27,526] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 9: [2023-04-29 17:23:27,526] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 8: [2023-04-29 17:23:27,525] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 8: [2023-04-29 17:23:27,525] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 8: [2023-04-29 17:23:27,525] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 8: [2023-04-29 17:23:27,525] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 8: [2023-04-29 17:23:27,525] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 8: [2023-04-29 17:23:27,525] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 8: [2023-04-29 17:23:27,525] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 8: [2023-04-29 17:23:27,526] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 28: [2023-04-29 17:23:27,526] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 28: [2023-04-29 17:23:27,526] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 28: [2023-04-29 17:23:27,526] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 28: [2023-04-29 17:23:27,526] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 26: [2023-04-29 17:23:27,530] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 8: [2023-04-29 17:23:27,531] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 8: [2023-04-29 17:23:27,532] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 8: [2023-04-29 17:23:27,532] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 8: [2023-04-29 17:23:27,534] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 26: [2023-04-29 17:23:27,534] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 8: [2023-04-29 17:23:27,535] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 8: [2023-04-29 17:23:27,536] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 8: [2023-04-29 17:23:27,536] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 26: [2023-04-29 17:23:27,537] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 26: [2023-04-29 17:23:27,537] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 26: [2023-04-29 17:23:27,537] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 8: [2023-04-29 17:23:27,537] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 28: [2023-04-29 17:23:27,540] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 28: [2023-04-29 17:23:27,542] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 22: [2023-04-29 17:23:27,542] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 22: [2023-04-29 17:23:27,542] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 22: [2023-04-29 17:23:27,542] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 22: [2023-04-29 17:23:27,543] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 22: [2023-04-29 17:23:27,543] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 22: [2023-04-29 17:23:27,543] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 22: [2023-04-29 17:23:27,543] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 22: [2023-04-29 17:23:27,543] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 28: [2023-04-29 17:23:27,544] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 22: [2023-04-29 17:23:27,545] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 22: [2023-04-29 17:23:27,545] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 15: [2023-04-29 17:23:27,550] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 22: [2023-04-29 17:23:27,553] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 22: [2023-04-29 17:23:27,553] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 22: [2023-04-29 17:23:27,554] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 22: [2023-04-29 17:23:27,554] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 22: [2023-04-29 17:23:27,554] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 22: [2023-04-29 17:23:27,555] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 28: [2023-04-29 17:23:27,558] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 28: [2023-04-29 17:23:27,561] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 28: [2023-04-29 17:23:27,561] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 15: [2023-04-29 17:23:27,563] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 15: [2023-04-29 17:23:27,563] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 15: [2023-04-29 17:23:27,563] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 28: [2023-04-29 17:23:27,563] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 15: [2023-04-29 17:23:27,568] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 15: [2023-04-29 17:23:27,568] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 15: [2023-04-29 17:23:27,568] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 15: [2023-04-29 17:23:27,569] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_25-model_00-model_states.pt. 15: [2023-04-29 17:23:27,573] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 20: [2023-04-29 17:23:27,582] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 20: [2023-04-29 17:23:27,582] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 20: [2023-04-29 17:23:27,582] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 20: [2023-04-29 17:23:27,583] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 20: [2023-04-29 17:23:27,583] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 20: [2023-04-29 17:23:27,583] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 20: [2023-04-29 17:23:27,583] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 20: [2023-04-29 17:23:27,583] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 8: [2023-04-29 17:23:27,584] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 8: [2023-04-29 17:23:27,587] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 8: [2023-04-29 17:23:27,587] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 20: [2023-04-29 17:23:27,588] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 20: [2023-04-29 17:23:27,589] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 20: [2023-04-29 17:23:27,589] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 8: [2023-04-29 17:23:27,590] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 20: [2023-04-29 17:23:27,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 22: [2023-04-29 17:23:27,592] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 20: [2023-04-29 17:23:27,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 20: [2023-04-29 17:23:27,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 20: [2023-04-29 17:23:27,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 20: [2023-04-29 17:23:27,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 15: [2023-04-29 17:23:27,595] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 22: [2023-04-29 17:23:27,597] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 15: [2023-04-29 17:23:27,599] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 15: [2023-04-29 17:23:27,601] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 8: [2023-04-29 17:23:27,603] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 8: [2023-04-29 17:23:27,603] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 8: [2023-04-29 17:23:27,604] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 15: [2023-04-29 17:23:27,605] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 8: [2023-04-29 17:23:27,606] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 15: [2023-04-29 17:23:27,608] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 15: [2023-04-29 17:23:27,609] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 15: [2023-04-29 17:23:27,609] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 8: [2023-04-29 17:23:27,609] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 8: [2023-04-29 17:23:27,612] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 8: [2023-04-29 17:23:27,612] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 8: [2023-04-29 17:23:27,616] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 22: [2023-04-29 17:23:27,620] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 22: [2023-04-29 17:23:27,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 22: [2023-04-29 17:23:27,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 22: [2023-04-29 17:23:27,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 22: [2023-04-29 17:23:27,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 22: [2023-04-29 17:23:27,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 22: [2023-04-29 17:23:27,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 22: [2023-04-29 17:23:27,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 8: [2023-04-29 17:23:27,631] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 8: [2023-04-29 17:23:27,631] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 8: [2023-04-29 17:23:27,634] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 8: [2023-04-29 17:23:27,635] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 20: [2023-04-29 17:23:27,642] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 20: [2023-04-29 17:23:27,642] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 20: [2023-04-29 17:23:27,644] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 20: [2023-04-29 17:23:27,657] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 20: [2023-04-29 17:23:27,657] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 20: [2023-04-29 17:23:27,658] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 20: [2023-04-29 17:23:27,658] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 20: [2023-04-29 17:23:27,658] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 1: [2023-04-29 17:23:27,660] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 1: [2023-04-29 17:23:27,661] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 7: [2023-04-29 17:23:27,660] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 7: [2023-04-29 17:23:27,661] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 7: [2023-04-29 17:23:27,661] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 7: [2023-04-29 17:23:27,661] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 7: [2023-04-29 17:23:27,661] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 7: [2023-04-29 17:23:27,661] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 7: [2023-04-29 17:23:27,661] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 7: [2023-04-29 17:23:27,661] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 1: [2023-04-29 17:23:27,663] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 1: [2023-04-29 17:23:27,663] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 1: [2023-04-29 17:23:27,663] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 1: [2023-04-29 17:23:27,663] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 1: [2023-04-29 17:23:27,663] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 1: [2023-04-29 17:23:27,663] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 20: [2023-04-29 17:23:27,665] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 7: [2023-04-29 17:23:27,665] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 7: [2023-04-29 17:23:27,666] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 20: [2023-04-29 17:23:27,666] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 7: [2023-04-29 17:23:27,666] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 7: [2023-04-29 17:23:27,666] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 22: [2023-04-29 17:23:27,653] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 22: [2023-04-29 17:23:27,656] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 1: [2023-04-29 17:23:27,667] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 22: [2023-04-29 17:23:27,656] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 22: [2023-04-29 17:23:27,659] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 22: [2023-04-29 17:23:27,659] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 22: [2023-04-29 17:23:27,662] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 1: [2023-04-29 17:23:27,667] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 7: [2023-04-29 17:23:27,667] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 7: [2023-04-29 17:23:27,667] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 1: [2023-04-29 17:23:27,668] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 7: [2023-04-29 17:23:27,668] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 7: [2023-04-29 17:23:27,668] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 1: [2023-04-29 17:23:27,669] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 1: [2023-04-29 17:23:27,669] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 1: [2023-04-29 17:23:27,669] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 1: [2023-04-29 17:23:27,669] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 20: [2023-04-29 17:23:27,669] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 1: [2023-04-29 17:23:27,670] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 20: [2023-04-29 17:23:27,688] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 20: [2023-04-29 17:23:27,690] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 20: [2023-04-29 17:23:27,690] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 20: [2023-04-29 17:23:27,690] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 20: [2023-04-29 17:23:27,691] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 24: [2023-04-29 17:23:27,701] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 24: [2023-04-29 17:23:27,702] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 24: [2023-04-29 17:23:27,702] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 24: [2023-04-29 17:23:27,702] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 24: [2023-04-29 17:23:27,702] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 24: [2023-04-29 17:23:27,702] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 24: [2023-04-29 17:23:27,702] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 24: [2023-04-29 17:23:27,703] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 24: [2023-04-29 17:23:27,705] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 16: [2023-04-29 17:23:27,713] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 16: [2023-04-29 17:23:27,713] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 24: [2023-04-29 17:23:27,712] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 16: [2023-04-29 17:23:27,713] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 16: [2023-04-29 17:23:27,713] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 16: [2023-04-29 17:23:27,713] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 16: [2023-04-29 17:23:27,713] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 24: [2023-04-29 17:23:27,713] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 16: [2023-04-29 17:23:27,713] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 16: [2023-04-29 17:23:27,714] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 24: [2023-04-29 17:23:27,714] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 24: [2023-04-29 17:23:27,714] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 24: [2023-04-29 17:23:27,715] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 24: [2023-04-29 17:23:27,716] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 24: [2023-04-29 17:23:27,716] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 1: [2023-04-29 17:23:27,718] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 7: [2023-04-29 17:23:27,719] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 7: [2023-04-29 17:23:27,719] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 7: [2023-04-29 17:23:27,719] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 16: [2023-04-29 17:23:27,719] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 16: [2023-04-29 17:23:27,719] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 16: [2023-04-29 17:23:27,719] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 16: [2023-04-29 17:23:27,719] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 16: [2023-04-29 17:23:27,720] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 16: [2023-04-29 17:23:27,720] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 16: [2023-04-29 17:23:27,720] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 16: [2023-04-29 17:23:27,721] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 17: [2023-04-29 17:23:27,721] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 17: [2023-04-29 17:23:27,722] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 7: [2023-04-29 17:23:27,724] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 17: [2023-04-29 17:23:27,724] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 17: [2023-04-29 17:23:27,724] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 17: [2023-04-29 17:23:27,724] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 17: [2023-04-29 17:23:27,725] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 17: [2023-04-29 17:23:27,725] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 17: [2023-04-29 17:23:27,725] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 1: [2023-04-29 17:23:27,725] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 1: [2023-04-29 17:23:27,725] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 1: [2023-04-29 17:23:27,725] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 17: [2023-04-29 17:23:27,726] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 21: [2023-04-29 17:23:27,728] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 21: [2023-04-29 17:23:27,728] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 21: [2023-04-29 17:23:27,728] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 21: [2023-04-29 17:23:27,728] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 21: [2023-04-29 17:23:27,728] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 21: [2023-04-29 17:23:27,728] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 21: [2023-04-29 17:23:27,728] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 21: [2023-04-29 17:23:27,728] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 17: [2023-04-29 17:23:27,729] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 17: [2023-04-29 17:23:27,731] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 1: [2023-04-29 17:23:27,731] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 21: [2023-04-29 17:23:27,732] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 17: [2023-04-29 17:23:27,732] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 21: [2023-04-29 17:23:27,733] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 21: [2023-04-29 17:23:27,733] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 21: [2023-04-29 17:23:27,733] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 1: [2023-04-29 17:23:27,733] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 1: [2023-04-29 17:23:27,733] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 1: [2023-04-29 17:23:27,733] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 17: [2023-04-29 17:23:27,734] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 21: [2023-04-29 17:23:27,734] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 21: [2023-04-29 17:23:27,734] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 21: [2023-04-29 17:23:27,734] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 21: [2023-04-29 17:23:27,735] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 17: [2023-04-29 17:23:27,735] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 17: [2023-04-29 17:23:27,736] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 17: [2023-04-29 17:23:27,736] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 7: [2023-04-29 17:23:27,738] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 7: [2023-04-29 17:23:27,738] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 7: [2023-04-29 17:23:27,738] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 1: [2023-04-29 17:23:27,739] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 7: [2023-04-29 17:23:27,741] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 7: [2023-04-29 17:23:27,741] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 7: [2023-04-29 17:23:27,743] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 7: [2023-04-29 17:23:27,743] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 7: [2023-04-29 17:23:27,748] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 27: [2023-04-29 17:23:27,750] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 1: [2023-04-29 17:23:27,750] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 27: [2023-04-29 17:23:27,751] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 27: [2023-04-29 17:23:27,751] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 27: [2023-04-29 17:23:27,751] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 27: [2023-04-29 17:23:27,751] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 27: [2023-04-29 17:23:27,751] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 27: [2023-04-29 17:23:27,751] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 27: [2023-04-29 17:23:27,751] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 1: [2023-04-29 17:23:27,752] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 1: [2023-04-29 17:23:27,752] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 27: [2023-04-29 17:23:27,754] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 24: [2023-04-29 17:23:27,756] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 1: [2023-04-29 17:23:27,758] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 1: [2023-04-29 17:23:27,760] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 1: [2023-04-29 17:23:27,760] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 1: [2023-04-29 17:23:27,760] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 27: [2023-04-29 17:23:27,762] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 27: [2023-04-29 17:23:27,762] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 27: [2023-04-29 17:23:27,763] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 27: [2023-04-29 17:23:27,764] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 27: [2023-04-29 17:23:27,764] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 27: [2023-04-29 17:23:27,764] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 27: [2023-04-29 17:23:27,765] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 7: [2023-04-29 17:23:27,765] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 7: [2023-04-29 17:23:27,766] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 7: [2023-04-29 17:23:27,766] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 7: [2023-04-29 17:23:27,768] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 16: [2023-04-29 17:23:27,774] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 16: [2023-04-29 17:23:27,774] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 16: [2023-04-29 17:23:27,778] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 24: [2023-04-29 17:23:27,778] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 21: [2023-04-29 17:23:27,779] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 17: [2023-04-29 17:23:27,780] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 16: [2023-04-29 17:23:27,781] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 17: [2023-04-29 17:23:27,782] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 24: [2023-04-29 17:23:27,789] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 24: [2023-04-29 17:23:27,789] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 24: [2023-04-29 17:23:27,789] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 24: [2023-04-29 17:23:27,792] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 16: [2023-04-29 17:23:27,792] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 16: [2023-04-29 17:23:27,792] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 16: [2023-04-29 17:23:27,792] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 21: [2023-04-29 17:23:27,791] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 21: [2023-04-29 17:23:27,791] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 24: [2023-04-29 17:23:27,792] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 16: [2023-04-29 17:23:27,792] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 21: [2023-04-29 17:23:27,792] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 24: [2023-04-29 17:23:27,793] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 24: [2023-04-29 17:23:27,795] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 21: [2023-04-29 17:23:27,800] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 16: [2023-04-29 17:23:27,800] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 16: [2023-04-29 17:23:27,802] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 17: [2023-04-29 17:23:27,803] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 17: [2023-04-29 17:23:27,803] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 14: [2023-04-29 17:23:27,803] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 14: [2023-04-29 17:23:27,803] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 14: [2023-04-29 17:23:27,803] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 14: [2023-04-29 17:23:27,803] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 14: [2023-04-29 17:23:27,804] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 14: [2023-04-29 17:23:27,804] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 14: [2023-04-29 17:23:27,804] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 14: [2023-04-29 17:23:27,804] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 27: [2023-04-29 17:23:27,804] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 21: [2023-04-29 17:23:27,805] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 21: [2023-04-29 17:23:27,805] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 21: [2023-04-29 17:23:27,805] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 21: [2023-04-29 17:23:27,805] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 25: [2023-04-29 17:23:27,806] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 25: [2023-04-29 17:23:27,806] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 17: [2023-04-29 17:23:27,806] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 16: [2023-04-29 17:23:27,807] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 25: [2023-04-29 17:23:27,807] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 25: [2023-04-29 17:23:27,807] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 25: [2023-04-29 17:23:27,807] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 25: [2023-04-29 17:23:27,807] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 25: [2023-04-29 17:23:27,807] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 16: [2023-04-29 17:23:27,807] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 17: [2023-04-29 17:23:27,807] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 25: [2023-04-29 17:23:27,807] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 14: [2023-04-29 17:23:27,807] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 17: [2023-04-29 17:23:27,807] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 14: [2023-04-29 17:23:27,807] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 13: [2023-04-29 17:23:27,808] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 13: [2023-04-29 17:23:27,808] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 13: [2023-04-29 17:23:27,808] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 13: [2023-04-29 17:23:27,808] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 13: [2023-04-29 17:23:27,808] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 13: [2023-04-29 17:23:27,809] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 13: [2023-04-29 17:23:27,809] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 17: [2023-04-29 17:23:27,809] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 17: [2023-04-29 17:23:27,809] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 17: [2023-04-29 17:23:27,809] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 13: [2023-04-29 17:23:27,809] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 23: [2023-04-29 17:23:27,810] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 23: [2023-04-29 17:23:27,810] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 25: [2023-04-29 17:23:27,810] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 25: [2023-04-29 17:23:27,810] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 23: [2023-04-29 17:23:27,811] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 23: [2023-04-29 17:23:27,811] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 23: [2023-04-29 17:23:27,811] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 23: [2023-04-29 17:23:27,811] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 23: [2023-04-29 17:23:27,811] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 23: [2023-04-29 17:23:27,811] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 19: [2023-04-29 17:23:27,812] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 19: [2023-04-29 17:23:27,812] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 19: [2023-04-29 17:23:27,812] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 19: [2023-04-29 17:23:27,812] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 19: [2023-04-29 17:23:27,812] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 19: [2023-04-29 17:23:27,812] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 19: [2023-04-29 17:23:27,812] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 19: [2023-04-29 17:23:27,813] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 14: [2023-04-29 17:23:27,813] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 13: [2023-04-29 17:23:27,813] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 14: [2023-04-29 17:23:27,813] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 13: [2023-04-29 17:23:27,814] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 5: [2023-04-29 17:23:27,814] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 5: [2023-04-29 17:23:27,814] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 14: [2023-04-29 17:23:27,814] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 14: [2023-04-29 17:23:27,814] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 14: [2023-04-29 17:23:27,815] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 5: [2023-04-29 17:23:27,815] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 5: [2023-04-29 17:23:27,815] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 5: [2023-04-29 17:23:27,815] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 5: [2023-04-29 17:23:27,815] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 5: [2023-04-29 17:23:27,815] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 5: [2023-04-29 17:23:27,815] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 14: [2023-04-29 17:23:27,815] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 23: [2023-04-29 17:23:27,815] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 21: [2023-04-29 17:23:27,816] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 16: [2023-04-29 17:23:27,816] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 21: [2023-04-29 17:23:27,816] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 23: [2023-04-29 17:23:27,816] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 25: [2023-04-29 17:23:27,817] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 25: [2023-04-29 17:23:27,817] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 12: [2023-04-29 17:23:27,817] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 12: [2023-04-29 17:23:27,817] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 19: [2023-04-29 17:23:27,817] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 19: [2023-04-29 17:23:27,817] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 19: [2023-04-29 17:23:27,817] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 25: [2023-04-29 17:23:27,817] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 13: [2023-04-29 17:23:27,817] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 13: [2023-04-29 17:23:27,818] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 12: [2023-04-29 17:23:27,818] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 12: [2023-04-29 17:23:27,818] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 12: [2023-04-29 17:23:27,818] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 12: [2023-04-29 17:23:27,818] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 12: [2023-04-29 17:23:27,818] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 25: [2023-04-29 17:23:27,818] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 12: [2023-04-29 17:23:27,818] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 21: [2023-04-29 17:23:27,818] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 5: [2023-04-29 17:23:27,818] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 16: [2023-04-29 17:23:27,818] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 13: [2023-04-29 17:23:27,819] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 25: [2023-04-29 17:23:27,819] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 5: [2023-04-29 17:23:27,819] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 25: [2023-04-29 17:23:27,819] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 13: [2023-04-29 17:23:27,819] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 13: [2023-04-29 17:23:27,819] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 16: [2023-04-29 17:23:27,820] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 16: [2023-04-29 17:23:27,820] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 13: [2023-04-29 17:23:27,820] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 19: [2023-04-29 17:23:27,821] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 19: [2023-04-29 17:23:27,821] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 23: [2023-04-29 17:23:27,821] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 19: [2023-04-29 17:23:27,821] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 5: [2023-04-29 17:23:27,822] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 19: [2023-04-29 17:23:27,821] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 23: [2023-04-29 17:23:27,822] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 19: [2023-04-29 17:23:27,822] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 23: [2023-04-29 17:23:27,822] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 23: [2023-04-29 17:23:27,823] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 23: [2023-04-29 17:23:27,823] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 23: [2023-04-29 17:23:27,824] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 12: [2023-04-29 17:23:27,824] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 12: [2023-04-29 17:23:27,825] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 5: [2023-04-29 17:23:27,825] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 12: [2023-04-29 17:23:27,825] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 12: [2023-04-29 17:23:27,825] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 5: [2023-04-29 17:23:27,825] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 12: [2023-04-29 17:23:27,825] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 12: [2023-04-29 17:23:27,826] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 5: [2023-04-29 17:23:27,826] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 12: [2023-04-29 17:23:27,826] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 5: [2023-04-29 17:23:27,827] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 5: [2023-04-29 17:23:27,827] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 12: [2023-04-29 17:23:27,828] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 27: [2023-04-29 17:23:27,830] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 24: [2023-04-29 17:23:27,832] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 24: [2023-04-29 17:23:27,833] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 24: [2023-04-29 17:23:27,833] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 24: [2023-04-29 17:23:27,833] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 24: [2023-04-29 17:23:27,834] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 21: [2023-04-29 17:23:27,834] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 21: [2023-04-29 17:23:27,834] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 17: [2023-04-29 17:23:27,834] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 24: [2023-04-29 17:23:27,835] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 17: [2023-04-29 17:23:27,835] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 24: [2023-04-29 17:23:27,836] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 21: [2023-04-29 17:23:27,837] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 21: [2023-04-29 17:23:27,837] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 27: [2023-04-29 17:23:27,837] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 27: [2023-04-29 17:23:27,839] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 27: [2023-04-29 17:23:27,839] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 27: [2023-04-29 17:23:27,841] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 27: [2023-04-29 17:23:27,841] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 27: [2023-04-29 17:23:27,841] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 17: [2023-04-29 17:23:27,843] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 17: [2023-04-29 17:23:27,843] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 27: [2023-04-29 17:23:27,843] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 17: [2023-04-29 17:23:27,843] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 17: [2023-04-29 17:23:27,846] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 14: [2023-04-29 17:23:27,857] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 13: [2023-04-29 17:23:27,858] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 13: [2023-04-29 17:23:27,860] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 14: [2023-04-29 17:23:27,861] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 25: [2023-04-29 17:23:27,862] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 25: [2023-04-29 17:23:27,863] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 29: [2023-04-29 17:23:27,865] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 29: [2023-04-29 17:23:27,865] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 29: [2023-04-29 17:23:27,866] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 29: [2023-04-29 17:23:27,866] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 29: [2023-04-29 17:23:27,866] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 29: [2023-04-29 17:23:27,866] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 29: [2023-04-29 17:23:27,866] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 29: [2023-04-29 17:23:27,867] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 27: [2023-04-29 17:23:27,868] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 5: [2023-04-29 17:23:27,869] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 5: [2023-04-29 17:23:27,869] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 29: [2023-04-29 17:23:27,870] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 29: [2023-04-29 17:23:27,870] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 23: [2023-04-29 17:23:27,871] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 26: [2023-04-29 17:23:27,871] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 26: [2023-04-29 17:23:27,871] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 27: [2023-04-29 17:23:27,872] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 23: [2023-04-29 17:23:27,872] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 19: [2023-04-29 17:23:27,872] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 19: [2023-04-29 17:23:27,872] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 19: [2023-04-29 17:23:27,872] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 26: [2023-04-29 17:23:27,872] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 26: [2023-04-29 17:23:27,872] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 26: [2023-04-29 17:23:27,873] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 26: [2023-04-29 17:23:27,873] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 26: [2023-04-29 17:23:27,873] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 26: [2023-04-29 17:23:27,873] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 29: [2023-04-29 17:23:27,874] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 14: [2023-04-29 17:23:27,875] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 27: [2023-04-29 17:23:27,876] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 3: [2023-04-29 17:23:27,876] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 29: [2023-04-29 17:23:27,876] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 27: [2023-04-29 17:23:27,876] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 3: [2023-04-29 17:23:27,876] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 29: [2023-04-29 17:23:27,876] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 27: [2023-04-29 17:23:27,877] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 27: [2023-04-29 17:23:27,878] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 25: [2023-04-29 17:23:27,877] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 26: [2023-04-29 17:23:27,877] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 27: [2023-04-29 17:23:27,878] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 29: [2023-04-29 17:23:27,878] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 29: [2023-04-29 17:23:27,878] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 29: [2023-04-29 17:23:27,878] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 26: [2023-04-29 17:23:27,879] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 26: [2023-04-29 17:23:27,879] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 26: [2023-04-29 17:23:27,879] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 26: [2023-04-29 17:23:27,880] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 26: [2023-04-29 17:23:27,880] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 3: [2023-04-29 17:23:27,880] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 3: [2023-04-29 17:23:27,880] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 3: [2023-04-29 17:23:27,880] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 3: [2023-04-29 17:23:27,880] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 3: [2023-04-29 17:23:27,880] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 14: [2023-04-29 17:23:27,880] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 12: [2023-04-29 17:23:27,880] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 3: [2023-04-29 17:23:27,880] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 13: [2023-04-29 17:23:27,880] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 3: [2023-04-29 17:23:27,881] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 26: [2023-04-29 17:23:27,881] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 13: [2023-04-29 17:23:27,881] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 26: [2023-04-29 17:23:27,881] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 12: [2023-04-29 17:23:27,881] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 13: [2023-04-29 17:23:27,882] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 12: [2023-04-29 17:23:27,882] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 19: [2023-04-29 17:23:27,883] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 3: [2023-04-29 17:23:27,884] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 3: [2023-04-29 17:23:27,885] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 12: [2023-04-29 17:23:27,885] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 19: [2023-04-29 17:23:27,885] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 25: [2023-04-29 17:23:27,885] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 25: [2023-04-29 17:23:27,886] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 5: [2023-04-29 17:23:27,886] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 14: [2023-04-29 17:23:27,886] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 14: [2023-04-29 17:23:27,886] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 13: [2023-04-29 17:23:27,886] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 3: [2023-04-29 17:23:27,888] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 3: [2023-04-29 17:23:27,888] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 14: [2023-04-29 17:23:27,889] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 14: [2023-04-29 17:23:27,889] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 14: [2023-04-29 17:23:27,889] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 14: [2023-04-29 17:23:27,889] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 3: [2023-04-29 17:23:27,890] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 5: [2023-04-29 17:23:27,890] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 3: [2023-04-29 17:23:27,890] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 5: [2023-04-29 17:23:27,890] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 5: [2023-04-29 17:23:27,890] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 3: [2023-04-29 17:23:27,891] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 23: [2023-04-29 17:23:27,891] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 23: [2023-04-29 17:23:27,891] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 19: [2023-04-29 17:23:27,892] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 19: [2023-04-29 17:23:27,892] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 19: [2023-04-29 17:23:27,892] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 13: [2023-04-29 17:23:27,893] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 13: [2023-04-29 17:23:27,893] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 13: [2023-04-29 17:23:27,893] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 4: [2023-04-29 17:23:27,893] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 4: [2023-04-29 17:23:27,893] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 25: [2023-04-29 17:23:27,893] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 25: [2023-04-29 17:23:27,893] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 25: [2023-04-29 17:23:27,893] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 25: [2023-04-29 17:23:27,893] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 25: [2023-04-29 17:23:27,893] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 4: [2023-04-29 17:23:27,894] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 4: [2023-04-29 17:23:27,894] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 4: [2023-04-29 17:23:27,894] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 4: [2023-04-29 17:23:27,894] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 4: [2023-04-29 17:23:27,894] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 23: [2023-04-29 17:23:27,894] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 4: [2023-04-29 17:23:27,894] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 19: [2023-04-29 17:23:27,894] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 23: [2023-04-29 17:23:27,894] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 23: [2023-04-29 17:23:27,894] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 12: [2023-04-29 17:23:27,894] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 23: [2023-04-29 17:23:27,895] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 19: [2023-04-29 17:23:27,896] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 19: [2023-04-29 17:23:27,896] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 12: [2023-04-29 17:23:27,896] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 12: [2023-04-29 17:23:27,896] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 12: [2023-04-29 17:23:27,896] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 4: [2023-04-29 17:23:27,896] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 22: [2023-04-29 17:23:27,897] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 22: [2023-04-29 17:23:27,897] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 5: [2023-04-29 17:23:27,898] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 5: [2023-04-29 17:23:27,898] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 23: [2023-04-29 17:23:27,898] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 4: [2023-04-29 17:23:27,898] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 23: [2023-04-29 17:23:27,899] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 25: [2023-04-29 17:23:27,901] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 22: [2023-04-29 17:23:27,900] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 22: [2023-04-29 17:23:27,900] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 22: [2023-04-29 17:23:27,900] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 22: [2023-04-29 17:23:27,900] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 22: [2023-04-29 17:23:27,901] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 22: [2023-04-29 17:23:27,901] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 22: [2023-04-29 17:23:27,901] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 22: [2023-04-29 17:23:27,902] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 4: [2023-04-29 17:23:27,904] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 4: [2023-04-29 17:23:27,904] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 4: [2023-04-29 17:23:27,905] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 13: [2023-04-29 17:23:27,905] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 4: [2023-04-29 17:23:27,905] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 13: [2023-04-29 17:23:27,906] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 4: [2023-04-29 17:23:27,906] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 4: [2023-04-29 17:23:27,907] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 5: [2023-04-29 17:23:27,907] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 5: [2023-04-29 17:23:27,907] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 12: [2023-04-29 17:23:27,907] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 12: [2023-04-29 17:23:27,908] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 13: [2023-04-29 17:23:27,908] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 12: [2023-04-29 17:23:27,910] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 22: [2023-04-29 17:23:27,910] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 19: [2023-04-29 17:23:27,910] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 22: [2023-04-29 17:23:27,910] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 22: [2023-04-29 17:23:27,911] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 22: [2023-04-29 17:23:27,912] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 22: [2023-04-29 17:23:27,912] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 22: [2023-04-29 17:23:27,912] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 14: [2023-04-29 17:23:27,913] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 5: [2023-04-29 17:23:27,913] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 14: [2023-04-29 17:23:27,914] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 19: [2023-04-29 17:23:27,914] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 12: [2023-04-29 17:23:27,914] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 5: [2023-04-29 17:23:27,917] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 19: [2023-04-29 17:23:27,919] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 10: [2023-04-29 17:23:27,919] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 10: [2023-04-29 17:23:27,919] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 10: [2023-04-29 17:23:27,920] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 10: [2023-04-29 17:23:27,920] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 19: [2023-04-29 17:23:27,920] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 10: [2023-04-29 17:23:27,920] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 10: [2023-04-29 17:23:27,920] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 10: [2023-04-29 17:23:27,920] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 2: [2023-04-29 17:23:27,920] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 2: [2023-04-29 17:23:27,920] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 2: [2023-04-29 17:23:27,920] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 10: [2023-04-29 17:23:27,920] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 19: [2023-04-29 17:23:27,920] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 2: [2023-04-29 17:23:27,920] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 2: [2023-04-29 17:23:27,920] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 2: [2023-04-29 17:23:27,921] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 2: [2023-04-29 17:23:27,921] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 2: [2023-04-29 17:23:27,921] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 18: [2023-04-29 17:23:27,920] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 18: [2023-04-29 17:23:27,920] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 18: [2023-04-29 17:23:27,920] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 18: [2023-04-29 17:23:27,921] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 18: [2023-04-29 17:23:27,921] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 14: [2023-04-29 17:23:27,921] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 29: [2023-04-29 17:23:27,921] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 29: [2023-04-29 17:23:27,921] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 18: [2023-04-29 17:23:27,921] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 18: [2023-04-29 17:23:27,921] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 18: [2023-04-29 17:23:27,921] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 14: [2023-04-29 17:23:27,922] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 25: [2023-04-29 17:23:27,923] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 12: [2023-04-29 17:23:27,923] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 25: [2023-04-29 17:23:27,923] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 13: [2023-04-29 17:23:27,924] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 13: [2023-04-29 17:23:27,924] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 13: [2023-04-29 17:23:27,924] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 25: [2023-04-29 17:23:27,924] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 14: [2023-04-29 17:23:27,924] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 10: [2023-04-29 17:23:27,925] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 5: [2023-04-29 17:23:27,925] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 2: [2023-04-29 17:23:27,925] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 14: [2023-04-29 17:23:27,925] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 2: [2023-04-29 17:23:27,925] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 15: [2023-04-29 17:23:27,925] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 15: [2023-04-29 17:23:27,925] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 15: [2023-04-29 17:23:27,925] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 15: [2023-04-29 17:23:27,925] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 15: [2023-04-29 17:23:27,925] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 15: [2023-04-29 17:23:27,925] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 15: [2023-04-29 17:23:27,925] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 15: [2023-04-29 17:23:27,925] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 10: [2023-04-29 17:23:27,925] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 10: [2023-04-29 17:23:27,926] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 26: [2023-04-29 17:23:27,926] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 2: [2023-04-29 17:23:27,926] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 10: [2023-04-29 17:23:27,926] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 12: [2023-04-29 17:23:27,927] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 10: [2023-04-29 17:23:27,927] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 10: [2023-04-29 17:23:27,927] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 0: [2023-04-29 17:23:27,928] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 0: [2023-04-29 17:23:27,928] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 0: [2023-04-29 17:23:27,928] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 0: [2023-04-29 17:23:27,928] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 0: [2023-04-29 17:23:27,928] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 0: [2023-04-29 17:23:27,928] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 0: [2023-04-29 17:23:27,928] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 2: [2023-04-29 17:23:27,928] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 0: [2023-04-29 17:23:27,928] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 25: [2023-04-29 17:23:27,928] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 10: [2023-04-29 17:23:27,929] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 2: [2023-04-29 17:23:27,929] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 10: [2023-04-29 17:23:27,929] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 12: [2023-04-29 17:23:27,929] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 25: [2023-04-29 17:23:27,929] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 12: [2023-04-29 17:23:27,930] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 26: [2023-04-29 17:23:27,929] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 2: [2023-04-29 17:23:27,930] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 2: [2023-04-29 17:23:27,931] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 5: [2023-04-29 17:23:27,931] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 2: [2023-04-29 17:23:27,931] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 13: [2023-04-29 17:23:27,932] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 23: [2023-04-29 17:23:27,933] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 3: [2023-04-29 17:23:27,933] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 3: [2023-04-29 17:23:27,933] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 18: [2023-04-29 17:23:27,933] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 18: [2023-04-29 17:23:27,933] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 23: [2023-04-29 17:23:27,934] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 18: [2023-04-29 17:23:27,935] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 18: [2023-04-29 17:23:27,935] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 18: [2023-04-29 17:23:27,935] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 18: [2023-04-29 17:23:27,935] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 18: [2023-04-29 17:23:27,936] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 5: [2023-04-29 17:23:27,937] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 5: [2023-04-29 17:23:27,937] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 0: [2023-04-29 17:23:27,937] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 18: [2023-04-29 17:23:27,937] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 15: [2023-04-29 17:23:27,938] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 0: [2023-04-29 17:23:27,938] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 23: [2023-04-29 17:23:27,938] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 23: [2023-04-29 17:23:27,938] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 23: [2023-04-29 17:23:27,938] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 15: [2023-04-29 17:23:27,939] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 23: [2023-04-29 17:23:27,939] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 15: [2023-04-29 17:23:27,940] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 15: [2023-04-29 17:23:27,940] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 15: [2023-04-29 17:23:27,940] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 4: [2023-04-29 17:23:27,941] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 15: [2023-04-29 17:23:27,941] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 15: [2023-04-29 17:23:27,941] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 15: [2023-04-29 17:23:27,941] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 0: [2023-04-29 17:23:27,942] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 0: [2023-04-29 17:23:27,942] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 30: [2023-04-29 17:23:27,941] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 26: [2023-04-29 17:23:27,942] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 30: [2023-04-29 17:23:27,942] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 30: [2023-04-29 17:23:27,942] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 30: [2023-04-29 17:23:27,942] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 30: [2023-04-29 17:23:27,942] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 30: [2023-04-29 17:23:27,942] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 30: [2023-04-29 17:23:27,942] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 0: [2023-04-29 17:23:27,942] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 29: [2023-04-29 17:23:27,942] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 30: [2023-04-29 17:23:27,943] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 29: [2023-04-29 17:23:27,944] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 29: [2023-04-29 17:23:27,944] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 26: [2023-04-29 17:23:27,944] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 26: [2023-04-29 17:23:27,944] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 26: [2023-04-29 17:23:27,944] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 26: [2023-04-29 17:23:27,944] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 31: [2023-04-29 17:23:27,943] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 31: [2023-04-29 17:23:27,943] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 0: [2023-04-29 17:23:27,944] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 26: [2023-04-29 17:23:27,944] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 22: [2023-04-29 17:23:27,944] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 31: [2023-04-29 17:23:27,945] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 31: [2023-04-29 17:23:27,946] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 31: [2023-04-29 17:23:27,946] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 31: [2023-04-29 17:23:27,946] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 31: [2023-04-29 17:23:27,946] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 31: [2023-04-29 17:23:27,946] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 0: [2023-04-29 17:23:27,946] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 0: [2023-04-29 17:23:27,947] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 29: [2023-04-29 17:23:27,947] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 29: [2023-04-29 17:23:27,947] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 26: [2023-04-29 17:23:27,948] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 31: [2023-04-29 17:23:27,949] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 31: [2023-04-29 17:23:27,949] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 31: [2023-04-29 17:23:27,950] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 31: [2023-04-29 17:23:27,952] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 31: [2023-04-29 17:23:27,952] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 31: [2023-04-29 17:23:27,952] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 31: [2023-04-29 17:23:27,952] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 31: [2023-04-29 17:23:27,953] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 4: [2023-04-29 17:23:27,954] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 29: [2023-04-29 17:23:27,954] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 29: [2023-04-29 17:23:27,954] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 30: [2023-04-29 17:23:27,953] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 30: [2023-04-29 17:23:27,954] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 30: [2023-04-29 17:23:27,954] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 30: [2023-04-29 17:23:27,954] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 3: [2023-04-29 17:23:27,954] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 3: [2023-04-29 17:23:27,954] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 30: [2023-04-29 17:23:27,954] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 29: [2023-04-29 17:23:27,954] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 30: [2023-04-29 17:23:27,954] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 26: [2023-04-29 17:23:27,955] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 30: [2023-04-29 17:23:27,955] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 30: [2023-04-29 17:23:27,955] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 3: [2023-04-29 17:23:27,956] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 22: [2023-04-29 17:23:27,957] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 3: [2023-04-29 17:23:27,960] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 3: [2023-04-29 17:23:27,960] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 11: [2023-04-29 17:23:27,960] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 11: [2023-04-29 17:23:27,960] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 11: [2023-04-29 17:23:27,960] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 11: [2023-04-29 17:23:27,960] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 11: [2023-04-29 17:23:27,960] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 11: [2023-04-29 17:23:27,960] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 11: [2023-04-29 17:23:27,960] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 11: [2023-04-29 17:23:27,960] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 4: [2023-04-29 17:23:27,962] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 11: [2023-04-29 17:23:27,964] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 11: [2023-04-29 17:23:27,965] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 22: [2023-04-29 17:23:27,965] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 11: [2023-04-29 17:23:27,965] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 6: [2023-04-29 17:23:27,966] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 6: [2023-04-29 17:23:27,966] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 6: [2023-04-29 17:23:27,966] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 3: [2023-04-29 17:23:27,967] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 3: [2023-04-29 17:23:27,967] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 3: [2023-04-29 17:23:27,967] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 6: [2023-04-29 17:23:27,967] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 6: [2023-04-29 17:23:27,967] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 6: [2023-04-29 17:23:27,967] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 6: [2023-04-29 17:23:27,967] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 6: [2023-04-29 17:23:27,967] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 6: [2023-04-29 17:23:27,969] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 11: [2023-04-29 17:23:27,969] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 11: [2023-04-29 17:23:27,970] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 11: [2023-04-29 17:23:27,970] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 11: [2023-04-29 17:23:27,970] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 29: [2023-04-29 17:23:27,970] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 11: [2023-04-29 17:23:27,971] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 26: [2023-04-29 17:23:27,971] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 6: [2023-04-29 17:23:27,970] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 26: [2023-04-29 17:23:27,973] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 26: [2023-04-29 17:23:27,973] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 26: [2023-04-29 17:23:27,974] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 26: [2023-04-29 17:23:27,974] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 26: [2023-04-29 17:23:27,974] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 29: [2023-04-29 17:23:27,975] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 4: [2023-04-29 17:23:27,976] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 6: [2023-04-29 17:23:27,976] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 6: [2023-04-29 17:23:27,976] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 6: [2023-04-29 17:23:27,976] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 6: [2023-04-29 17:23:27,977] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 6: [2023-04-29 17:23:27,977] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 6: [2023-04-29 17:23:27,978] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 29: [2023-04-29 17:23:27,978] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 22: [2023-04-29 17:23:27,978] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 4: [2023-04-29 17:23:27,978] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 4: [2023-04-29 17:23:27,978] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 4: [2023-04-29 17:23:27,978] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 4: [2023-04-29 17:23:27,978] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 4: [2023-04-29 17:23:27,979] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 4: [2023-04-29 17:23:27,979] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 3: [2023-04-29 17:23:27,979] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 2: [2023-04-29 17:23:27,980] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 22: [2023-04-29 17:23:27,981] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 2: [2023-04-29 17:23:27,981] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 2: [2023-04-29 17:23:27,981] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 29: [2023-04-29 17:23:27,982] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 22: [2023-04-29 17:23:27,982] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 22: [2023-04-29 17:23:27,983] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 22: [2023-04-29 17:23:27,983] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 10: [2023-04-29 17:23:27,983] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 10: [2023-04-29 17:23:27,983] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 10: [2023-04-29 17:23:27,983] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 10: [2023-04-29 17:23:27,983] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 22: [2023-04-29 17:23:27,984] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 22: [2023-04-29 17:23:27,985] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 2: [2023-04-29 17:23:27,985] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 29: [2023-04-29 17:23:27,988] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 29: [2023-04-29 17:23:27,988] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 3: [2023-04-29 17:23:27,989] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 10: [2023-04-29 17:23:27,989] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 10: [2023-04-29 17:23:27,989] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 10: [2023-04-29 17:23:27,989] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 10: [2023-04-29 17:23:27,989] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 3: [2023-04-29 17:23:27,989] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 2: [2023-04-29 17:23:27,993] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 2: [2023-04-29 17:23:27,996] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 3: [2023-04-29 17:23:27,996] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 3: [2023-04-29 17:23:27,997] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 3: [2023-04-29 17:23:27,999] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 2: [2023-04-29 17:23:28,001] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 31: [2023-04-29 17:23:28,001] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 31: [2023-04-29 17:23:28,001] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 31: [2023-04-29 17:23:28,001] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 2: [2023-04-29 17:23:28,005] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 2: [2023-04-29 17:23:28,006] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 2: [2023-04-29 17:23:28,007] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 10: [2023-04-29 17:23:28,008] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 10: [2023-04-29 17:23:28,008] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 0: [2023-04-29 17:23:28,008] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 10: [2023-04-29 17:23:28,008] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 4: [2023-04-29 17:23:28,009] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 2: [2023-04-29 17:23:28,009] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 2: [2023-04-29 17:23:28,010] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 18: [2023-04-29 17:23:28,010] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 18: [2023-04-29 17:23:28,010] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 18: [2023-04-29 17:23:28,010] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 4: [2023-04-29 17:23:28,011] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 22: [2023-04-29 17:23:28,012] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 10: [2023-04-29 17:23:28,014] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 4: [2023-04-29 17:23:28,015] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 22: [2023-04-29 17:23:28,016] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 4: [2023-04-29 17:23:28,017] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 31: [2023-04-29 17:23:28,017] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 31: [2023-04-29 17:23:28,017] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 31: [2023-04-29 17:23:28,017] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 31: [2023-04-29 17:23:28,017] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 31: [2023-04-29 17:23:28,017] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 9: [2023-04-29 17:23:28,017] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 9: [2023-04-29 17:23:28,017] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 4: [2023-04-29 17:23:28,017] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 9: [2023-04-29 17:23:28,017] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 9: [2023-04-29 17:23:28,018] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 9: [2023-04-29 17:23:28,018] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 9: [2023-04-29 17:23:28,018] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 9: [2023-04-29 17:23:28,018] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 9: [2023-04-29 17:23:28,018] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 11: [2023-04-29 17:23:28,017] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 11: [2023-04-29 17:23:28,017] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 11: [2023-04-29 17:23:28,017] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 0: [2023-04-29 17:23:28,018] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 22: [2023-04-29 17:23:28,018] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 4: [2023-04-29 17:23:28,019] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 22: [2023-04-29 17:23:28,018] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 22: [2023-04-29 17:23:28,019] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 15: [2023-04-29 17:23:28,019] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 22: [2023-04-29 17:23:28,019] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 15: [2023-04-29 17:23:28,019] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 15: [2023-04-29 17:23:28,020] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 15: [2023-04-29 17:23:28,020] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 10: [2023-04-29 17:23:28,020] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 6: [2023-04-29 17:23:28,020] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 6: [2023-04-29 17:23:28,020] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 10: [2023-04-29 17:23:28,022] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 9: [2023-04-29 17:23:28,022] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 0: [2023-04-29 17:23:28,022] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 10: [2023-04-29 17:23:28,023] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 10: [2023-04-29 17:23:28,023] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 15: [2023-04-29 17:23:28,023] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 15: [2023-04-29 17:23:28,023] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 15: [2023-04-29 17:23:28,023] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 15: [2023-04-29 17:23:28,023] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 9: [2023-04-29 17:23:28,023] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 2: [2023-04-29 17:23:28,023] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 9: [2023-04-29 17:23:28,023] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 9: [2023-04-29 17:23:28,023] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 9: [2023-04-29 17:23:28,023] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 2: [2023-04-29 17:23:28,024] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 9: [2023-04-29 17:23:28,024] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 28: [2023-04-29 17:23:28,023] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 28: [2023-04-29 17:23:28,023] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 28: [2023-04-29 17:23:28,023] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 28: [2023-04-29 17:23:28,024] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 28: [2023-04-29 17:23:28,024] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 28: [2023-04-29 17:23:28,024] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 28: [2023-04-29 17:23:28,024] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 31: [2023-04-29 17:23:28,024] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 28: [2023-04-29 17:23:28,024] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 9: [2023-04-29 17:23:28,024] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 9: [2023-04-29 17:23:28,024] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 30: [2023-04-29 17:23:28,025] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 20: [2023-04-29 17:23:28,025] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 20: [2023-04-29 17:23:28,025] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 20: [2023-04-29 17:23:28,025] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 20: [2023-04-29 17:23:28,025] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 20: [2023-04-29 17:23:28,026] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 20: [2023-04-29 17:23:28,026] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 20: [2023-04-29 17:23:28,026] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 20: [2023-04-29 17:23:28,026] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 31: [2023-04-29 17:23:28,026] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 31: [2023-04-29 17:23:28,026] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 18: [2023-04-29 17:23:28,026] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 18: [2023-04-29 17:23:28,026] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 18: [2023-04-29 17:23:28,026] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 18: [2023-04-29 17:23:28,026] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 18: [2023-04-29 17:23:28,026] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 8: [2023-04-29 17:23:28,030] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 8: [2023-04-29 17:23:28,030] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 8: [2023-04-29 17:23:28,030] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 8: [2023-04-29 17:23:28,030] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 8: [2023-04-29 17:23:28,030] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 8: [2023-04-29 17:23:28,030] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 8: [2023-04-29 17:23:28,030] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 8: [2023-04-29 17:23:28,031] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 2: [2023-04-29 17:23:28,031] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 20: [2023-04-29 17:23:28,031] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 20: [2023-04-29 17:23:28,031] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 11: [2023-04-29 17:23:28,032] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 11: [2023-04-29 17:23:28,032] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 0: [2023-04-29 17:23:28,032] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 20: [2023-04-29 17:23:28,032] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 2: [2023-04-29 17:23:28,034] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 11: [2023-04-29 17:23:28,035] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 28: [2023-04-29 17:23:28,035] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 28: [2023-04-29 17:23:28,035] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 20: [2023-04-29 17:23:28,035] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 20: [2023-04-29 17:23:28,036] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 20: [2023-04-29 17:23:28,036] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 20: [2023-04-29 17:23:28,037] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 18: [2023-04-29 17:23:28,037] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 20: [2023-04-29 17:23:28,037] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 28: [2023-04-29 17:23:28,037] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 8: [2023-04-29 17:23:28,036] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 8: [2023-04-29 17:23:28,037] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 28: [2023-04-29 17:23:28,037] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 18: [2023-04-29 17:23:28,037] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 28: [2023-04-29 17:23:28,037] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 0: [2023-04-29 17:23:28,038] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 0: [2023-04-29 17:23:28,038] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 28: [2023-04-29 17:23:28,038] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 18: [2023-04-29 17:23:28,039] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 8: [2023-04-29 17:23:28,038] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 8: [2023-04-29 17:23:28,039] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 11: [2023-04-29 17:23:28,039] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 8: [2023-04-29 17:23:28,039] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 28: [2023-04-29 17:23:28,039] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 28: [2023-04-29 17:23:28,040] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt... 8: [2023-04-29 17:23:28,040] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 8: [2023-04-29 17:23:28,040] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 11: [2023-04-29 17:23:28,041] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 11: [2023-04-29 17:23:28,041] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 8: [2023-04-29 17:23:28,041] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 6: [2023-04-29 17:23:28,041] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 11: [2023-04-29 17:23:28,041] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 11: [2023-04-29 17:23:28,041] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 6: [2023-04-29 17:23:28,042] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 6: [2023-04-29 17:23:28,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 7: [2023-04-29 17:23:28,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 7: [2023-04-29 17:23:28,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 7: [2023-04-29 17:23:28,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 7: [2023-04-29 17:23:28,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 7: [2023-04-29 17:23:28,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 31: [2023-04-29 17:23:28,045] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 7: [2023-04-29 17:23:28,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 7: [2023-04-29 17:23:28,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 31: [2023-04-29 17:23:28,045] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 7: [2023-04-29 17:23:28,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 30: [2023-04-29 17:23:28,047] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 30: [2023-04-29 17:23:28,047] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 30: [2023-04-29 17:23:28,047] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 30: [2023-04-29 17:23:28,047] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 30: [2023-04-29 17:23:28,047] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 30: [2023-04-29 17:23:28,047] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 30: [2023-04-29 17:23:28,047] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 7: [2023-04-29 17:23:28,049] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 30: [2023-04-29 17:23:28,050] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 7: [2023-04-29 17:23:28,050] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 31: [2023-04-29 17:23:28,050] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 31: [2023-04-29 17:23:28,050] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 31: [2023-04-29 17:23:28,050] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 0: [2023-04-29 17:23:28,050] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 7: [2023-04-29 17:23:28,050] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 7: [2023-04-29 17:23:28,051] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 6: [2023-04-29 17:23:28,051] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 6: [2023-04-29 17:23:28,051] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 6: [2023-04-29 17:23:28,051] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 6: [2023-04-29 17:23:28,051] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 6: [2023-04-29 17:23:28,051] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 7: [2023-04-29 17:23:28,052] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 7: [2023-04-29 17:23:28,052] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 7: [2023-04-29 17:23:28,052] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 7: [2023-04-29 17:23:28,053] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 0: [2023-04-29 17:23:28,053] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 15: [2023-04-29 17:23:28,054] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 0: [2023-04-29 17:23:28,055] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 0: [2023-04-29 17:23:28,055] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 11: [2023-04-29 17:23:28,055] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 15: [2023-04-29 17:23:28,056] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 11: [2023-04-29 17:23:28,057] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 15: [2023-04-29 17:23:28,058] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 0: [2023-04-29 17:23:28,058] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 18: [2023-04-29 17:23:28,059] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 15: [2023-04-29 17:23:28,060] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 18: [2023-04-29 17:23:28,060] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 18: [2023-04-29 17:23:28,061] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 15: [2023-04-29 17:23:28,061] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 18: [2023-04-29 17:23:28,061] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 18: [2023-04-29 17:23:28,062] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 24: [2023-04-29 17:23:28,062] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 15: [2023-04-29 17:23:28,063] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 15: [2023-04-29 17:23:28,063] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 24: [2023-04-29 17:23:28,063] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 24: [2023-04-29 17:23:28,063] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 24: [2023-04-29 17:23:28,063] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 24: [2023-04-29 17:23:28,063] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 24: [2023-04-29 17:23:28,063] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 24: [2023-04-29 17:23:28,063] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 11: [2023-04-29 17:23:28,064] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 24: [2023-04-29 17:23:28,064] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 0: [2023-04-29 17:23:28,065] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 15: [2023-04-29 17:23:28,065] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 11: [2023-04-29 17:23:28,067] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 24: [2023-04-29 17:23:28,067] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 0: [2023-04-29 17:23:28,069] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 11: [2023-04-29 17:23:28,069] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 24: [2023-04-29 17:23:28,071] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 24: [2023-04-29 17:23:28,073] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 6: [2023-04-29 17:23:28,075] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 9: [2023-04-29 17:23:28,075] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 24: [2023-04-29 17:23:28,075] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 24: [2023-04-29 17:23:28,076] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 24: [2023-04-29 17:23:28,076] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 24: [2023-04-29 17:23:28,079] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 24: [2023-04-29 17:23:28,079] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 30: [2023-04-29 17:23:28,080] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 30: [2023-04-29 17:23:28,080] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 9: [2023-04-29 17:23:28,080] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 9: [2023-04-29 17:23:28,080] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 9: [2023-04-29 17:23:28,080] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 0: [2023-04-29 17:23:28,082] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 30: [2023-04-29 17:23:28,083] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 30: [2023-04-29 17:23:28,083] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 30: [2023-04-29 17:23:28,083] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 0: [2023-04-29 17:23:28,083] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 9: [2023-04-29 17:23:28,084] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 6: [2023-04-29 17:23:28,083] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 6: [2023-04-29 17:23:28,083] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 6: [2023-04-29 17:23:28,084] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 6: [2023-04-29 17:23:28,084] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 0: [2023-04-29 17:23:28,085] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 6: [2023-04-29 17:23:28,085] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 20: [2023-04-29 17:23:28,085] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 20: [2023-04-29 17:23:28,085] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 20: [2023-04-29 17:23:28,086] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 30: [2023-04-29 17:23:28,089] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 30: [2023-04-29 17:23:28,089] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 9: [2023-04-29 17:23:28,089] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 9: [2023-04-29 17:23:28,089] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 8: [2023-04-29 17:23:28,090] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 8: [2023-04-29 17:23:28,090] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 9: [2023-04-29 17:23:28,090] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 20: [2023-04-29 17:23:28,091] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 8: [2023-04-29 17:23:28,094] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 7: [2023-04-29 17:23:28,095] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 9: [2023-04-29 17:23:28,100] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 8: [2023-04-29 17:23:28,101] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 8: [2023-04-29 17:23:28,101] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 8: [2023-04-29 17:23:28,102] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 8: [2023-04-29 17:23:28,102] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 20: [2023-04-29 17:23:28,103] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 20: [2023-04-29 17:23:28,103] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 8: [2023-04-29 17:23:28,105] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 20: [2023-04-29 17:23:28,105] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 20: [2023-04-29 17:23:28,105] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 9: [2023-04-29 17:23:28,105] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 9: [2023-04-29 17:23:28,106] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 7: [2023-04-29 17:23:28,108] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 7: [2023-04-29 17:23:28,108] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 9: [2023-04-29 17:23:28,109] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 20: [2023-04-29 17:23:28,110] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 9: [2023-04-29 17:23:28,110] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 20: [2023-04-29 17:23:28,110] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 28: [2023-04-29 17:23:28,111] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 28: [2023-04-29 17:23:28,111] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 20: [2023-04-29 17:23:28,113] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 8: [2023-04-29 17:23:28,113] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 8: [2023-04-29 17:23:28,113] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 9: [2023-04-29 17:23:28,114] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 9: [2023-04-29 17:23:28,114] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 7: [2023-04-29 17:23:28,115] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 7: [2023-04-29 17:23:28,115] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 9: [2023-04-29 17:23:28,116] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 20: [2023-04-29 17:23:28,116] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 28: [2023-04-29 17:23:28,116] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 28: [2023-04-29 17:23:28,116] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 28: [2023-04-29 17:23:28,116] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 24: [2023-04-29 17:23:28,118] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 8: [2023-04-29 17:23:28,119] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 7: [2023-04-29 17:23:28,122] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 7: [2023-04-29 17:23:28,123] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 7: [2023-04-29 17:23:28,125] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 7: [2023-04-29 17:23:28,125] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 8: [2023-04-29 17:23:28,130] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 8: [2023-04-29 17:23:28,133] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 7: [2023-04-29 17:23:28,133] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 8: [2023-04-29 17:23:28,133] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 7: [2023-04-29 17:23:28,133] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 8: [2023-04-29 17:23:28,134] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 8: [2023-04-29 17:23:28,135] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 20: [2023-04-29 17:23:28,135] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 20: [2023-04-29 17:23:28,135] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 20: [2023-04-29 17:23:28,136] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 20: [2023-04-29 17:23:28,136] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 24: [2023-04-29 17:23:28,138] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 24: [2023-04-29 17:23:28,140] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 7: [2023-04-29 17:23:28,142] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 24: [2023-04-29 17:23:28,147] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 28: [2023-04-29 17:23:28,146] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 28: [2023-04-29 17:23:28,146] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 28: [2023-04-29 17:23:28,146] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_26-model_00-model_states.pt. 28: [2023-04-29 17:23:28,147] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 28: [2023-04-29 17:23:28,150] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 28: [2023-04-29 17:23:28,150] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 28: [2023-04-29 17:23:28,151] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 28: [2023-04-29 17:23:28,151] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 7: [2023-04-29 17:23:28,152] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 7: [2023-04-29 17:23:28,152] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 7: [2023-04-29 17:23:28,153] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 7: [2023-04-29 17:23:28,153] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 24: [2023-04-29 17:23:28,156] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 24: [2023-04-29 17:23:28,156] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 24: [2023-04-29 17:23:28,156] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 1: [2023-04-29 17:23:28,158] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 1: [2023-04-29 17:23:28,158] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 1: [2023-04-29 17:23:28,158] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 1: [2023-04-29 17:23:28,158] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 1: [2023-04-29 17:23:28,158] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 1: [2023-04-29 17:23:28,158] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 1: [2023-04-29 17:23:28,158] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 1: [2023-04-29 17:23:28,159] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 13: [2023-04-29 17:23:28,160] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 13: [2023-04-29 17:23:28,160] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 13: [2023-04-29 17:23:28,160] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 13: [2023-04-29 17:23:28,160] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 13: [2023-04-29 17:23:28,160] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 13: [2023-04-29 17:23:28,160] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 13: [2023-04-29 17:23:28,160] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 13: [2023-04-29 17:23:28,161] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 1: [2023-04-29 17:23:28,163] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 1: [2023-04-29 17:23:28,164] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 1: [2023-04-29 17:23:28,164] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 1: [2023-04-29 17:23:28,164] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 1: [2023-04-29 17:23:28,164] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 1: [2023-04-29 17:23:28,165] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 1: [2023-04-29 17:23:28,165] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 13: [2023-04-29 17:23:28,165] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 1: [2023-04-29 17:23:28,166] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 24: [2023-04-29 17:23:28,166] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 13: [2023-04-29 17:23:28,167] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 16: [2023-04-29 17:23:28,170] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 16: [2023-04-29 17:23:28,170] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 16: [2023-04-29 17:23:28,170] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 16: [2023-04-29 17:23:28,170] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 16: [2023-04-29 17:23:28,170] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 16: [2023-04-29 17:23:28,170] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 16: [2023-04-29 17:23:28,170] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 16: [2023-04-29 17:23:28,170] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 13: [2023-04-29 17:23:28,170] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 13: [2023-04-29 17:23:28,171] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 13: [2023-04-29 17:23:28,171] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 28: [2023-04-29 17:23:28,172] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 13: [2023-04-29 17:23:28,172] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 28: [2023-04-29 17:23:28,172] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 13: [2023-04-29 17:23:28,172] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 24: [2023-04-29 17:23:28,172] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 13: [2023-04-29 17:23:28,173] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 24: [2023-04-29 17:23:28,173] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 24: [2023-04-29 17:23:28,175] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 28: [2023-04-29 17:23:28,176] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 16: [2023-04-29 17:23:28,176] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 16: [2023-04-29 17:23:28,176] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 16: [2023-04-29 17:23:28,177] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 27: [2023-04-29 17:23:28,177] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 16: [2023-04-29 17:23:28,177] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 16: [2023-04-29 17:23:28,177] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 16: [2023-04-29 17:23:28,177] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 27: [2023-04-29 17:23:28,177] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 27: [2023-04-29 17:23:28,177] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 27: [2023-04-29 17:23:28,177] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 27: [2023-04-29 17:23:28,177] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 27: [2023-04-29 17:23:28,177] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 27: [2023-04-29 17:23:28,177] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 16: [2023-04-29 17:23:28,177] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 27: [2023-04-29 17:23:28,178] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 16: [2023-04-29 17:23:28,178] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 27: [2023-04-29 17:23:28,180] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 27: [2023-04-29 17:23:28,187] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 24: [2023-04-29 17:23:28,187] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 27: [2023-04-29 17:23:28,189] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 24: [2023-04-29 17:23:28,189] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 24: [2023-04-29 17:23:28,189] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 27: [2023-04-29 17:23:28,189] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 27: [2023-04-29 17:23:28,190] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 27: [2023-04-29 17:23:28,190] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 27: [2023-04-29 17:23:28,190] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 27: [2023-04-29 17:23:28,191] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 5: [2023-04-29 17:23:28,205] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 5: [2023-04-29 17:23:28,205] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 24: [2023-04-29 17:23:28,205] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 24: [2023-04-29 17:23:28,205] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 5: [2023-04-29 17:23:28,210] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 5: [2023-04-29 17:23:28,210] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 5: [2023-04-29 17:23:28,210] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 5: [2023-04-29 17:23:28,210] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 5: [2023-04-29 17:23:28,210] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 5: [2023-04-29 17:23:28,210] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 5: [2023-04-29 17:23:28,210] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 5: [2023-04-29 17:23:28,210] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 1: [2023-04-29 17:23:28,212] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 1: [2023-04-29 17:23:28,215] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 21: [2023-04-29 17:23:28,218] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 21: [2023-04-29 17:23:28,218] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 21: [2023-04-29 17:23:28,218] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 21: [2023-04-29 17:23:28,218] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 21: [2023-04-29 17:23:28,218] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 5: [2023-04-29 17:23:28,219] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 21: [2023-04-29 17:23:28,218] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 21: [2023-04-29 17:23:28,218] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 21: [2023-04-29 17:23:28,219] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 5: [2023-04-29 17:23:28,220] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 5: [2023-04-29 17:23:28,220] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 5: [2023-04-29 17:23:28,221] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 5: [2023-04-29 17:23:28,221] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 5: [2023-04-29 17:23:28,222] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 13: [2023-04-29 17:23:28,222] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 21: [2023-04-29 17:23:28,222] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 21: [2023-04-29 17:23:28,223] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 21: [2023-04-29 17:23:28,224] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 13: [2023-04-29 17:23:28,224] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 21: [2023-04-29 17:23:28,224] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 21: [2023-04-29 17:23:28,225] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 21: [2023-04-29 17:23:28,225] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 21: [2023-04-29 17:23:28,225] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 21: [2023-04-29 17:23:28,226] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 1: [2023-04-29 17:23:28,226] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 1: [2023-04-29 17:23:28,226] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 1: [2023-04-29 17:23:28,226] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 17: [2023-04-29 17:23:28,230] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 17: [2023-04-29 17:23:28,230] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 17: [2023-04-29 17:23:28,230] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 17: [2023-04-29 17:23:28,231] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 13: [2023-04-29 17:23:28,231] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 17: [2023-04-29 17:23:28,231] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 17: [2023-04-29 17:23:28,231] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 16: [2023-04-29 17:23:28,230] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 16: [2023-04-29 17:23:28,230] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 17: [2023-04-29 17:23:28,231] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 17: [2023-04-29 17:23:28,231] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 27: [2023-04-29 17:23:28,232] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 1: [2023-04-29 17:23:28,232] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 1: [2023-04-29 17:23:28,232] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 1: [2023-04-29 17:23:28,232] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 1: [2023-04-29 17:23:28,233] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 14: [2023-04-29 17:23:28,235] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 14: [2023-04-29 17:23:28,235] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 14: [2023-04-29 17:23:28,235] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 14: [2023-04-29 17:23:28,235] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 14: [2023-04-29 17:23:28,235] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 14: [2023-04-29 17:23:28,235] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 14: [2023-04-29 17:23:28,236] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 14: [2023-04-29 17:23:28,236] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 17: [2023-04-29 17:23:28,236] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 17: [2023-04-29 17:23:28,237] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 16: [2023-04-29 17:23:28,237] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 17: [2023-04-29 17:23:28,237] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 1: [2023-04-29 17:23:28,237] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 14: [2023-04-29 17:23:28,239] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 14: [2023-04-29 17:23:28,239] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 22: [2023-04-29 17:23:28,240] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 22: [2023-04-29 17:23:28,240] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 22: [2023-04-29 17:23:28,240] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 17: [2023-04-29 17:23:28,241] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 22: [2023-04-29 17:23:28,241] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 17: [2023-04-29 17:23:28,241] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 22: [2023-04-29 17:23:28,241] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 22: [2023-04-29 17:23:28,241] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 22: [2023-04-29 17:23:28,241] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 22: [2023-04-29 17:23:28,241] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 17: [2023-04-29 17:23:28,242] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 14: [2023-04-29 17:23:28,242] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 17: [2023-04-29 17:23:28,242] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 17: [2023-04-29 17:23:28,242] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 13: [2023-04-29 17:23:28,243] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 13: [2023-04-29 17:23:28,244] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 13: [2023-04-29 17:23:28,244] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 13: [2023-04-29 17:23:28,244] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 22: [2023-04-29 17:23:28,244] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 22: [2023-04-29 17:23:28,245] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 16: [2023-04-29 17:23:28,246] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 16: [2023-04-29 17:23:28,246] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 16: [2023-04-29 17:23:28,246] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 16: [2023-04-29 17:23:28,246] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 16: [2023-04-29 17:23:28,246] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 14: [2023-04-29 17:23:28,246] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 14: [2023-04-29 17:23:28,246] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 14: [2023-04-29 17:23:28,246] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 14: [2023-04-29 17:23:28,247] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 13: [2023-04-29 17:23:28,247] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 14: [2023-04-29 17:23:28,248] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 13: [2023-04-29 17:23:28,248] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 13: [2023-04-29 17:23:28,248] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 27: [2023-04-29 17:23:28,250] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 22: [2023-04-29 17:23:28,250] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 1: [2023-04-29 17:23:28,250] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 1: [2023-04-29 17:23:28,251] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 22: [2023-04-29 17:23:28,251] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 22: [2023-04-29 17:23:28,251] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 22: [2023-04-29 17:23:28,252] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 22: [2023-04-29 17:23:28,252] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 22: [2023-04-29 17:23:28,252] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 1: [2023-04-29 17:23:28,253] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 16: [2023-04-29 17:23:28,253] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 16: [2023-04-29 17:23:28,254] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 26: [2023-04-29 17:23:28,255] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 26: [2023-04-29 17:23:28,255] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 26: [2023-04-29 17:23:28,255] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 26: [2023-04-29 17:23:28,255] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 26: [2023-04-29 17:23:28,255] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 26: [2023-04-29 17:23:28,255] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 26: [2023-04-29 17:23:28,255] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 13: [2023-04-29 17:23:28,256] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 26: [2023-04-29 17:23:28,256] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 1: [2023-04-29 17:23:28,258] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 1: [2023-04-29 17:23:28,259] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 1: [2023-04-29 17:23:28,259] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 5: [2023-04-29 17:23:28,261] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 5: [2023-04-29 17:23:28,261] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 26: [2023-04-29 17:23:28,262] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 26: [2023-04-29 17:23:28,262] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 26: [2023-04-29 17:23:28,262] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 26: [2023-04-29 17:23:28,263] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 26: [2023-04-29 17:23:28,264] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 26: [2023-04-29 17:23:28,264] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 16: [2023-04-29 17:23:28,264] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 26: [2023-04-29 17:23:28,264] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 27: [2023-04-29 17:23:28,264] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 27: [2023-04-29 17:23:28,264] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 27: [2023-04-29 17:23:28,264] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 26: [2023-04-29 17:23:28,265] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 27: [2023-04-29 17:23:28,265] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 2: [2023-04-29 17:23:28,265] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 2: [2023-04-29 17:23:28,265] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 2: [2023-04-29 17:23:28,265] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 2: [2023-04-29 17:23:28,266] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 2: [2023-04-29 17:23:28,266] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 2: [2023-04-29 17:23:28,266] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 2: [2023-04-29 17:23:28,266] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 2: [2023-04-29 17:23:28,266] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 27: [2023-04-29 17:23:28,266] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 27: [2023-04-29 17:23:28,266] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 27: [2023-04-29 17:23:28,266] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 6: [2023-04-29 17:23:28,268] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 6: [2023-04-29 17:23:28,268] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 6: [2023-04-29 17:23:28,268] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 6: [2023-04-29 17:23:28,268] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 6: [2023-04-29 17:23:28,268] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 6: [2023-04-29 17:23:28,268] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 6: [2023-04-29 17:23:28,268] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 2: [2023-04-29 17:23:28,269] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 2: [2023-04-29 17:23:28,269] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 2: [2023-04-29 17:23:28,270] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 6: [2023-04-29 17:23:28,268] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 21: [2023-04-29 17:23:28,270] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 16: [2023-04-29 17:23:28,272] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 2: [2023-04-29 17:23:28,272] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 6: [2023-04-29 17:23:28,272] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 16: [2023-04-29 17:23:28,272] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 6: [2023-04-29 17:23:28,273] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 16: [2023-04-29 17:23:28,274] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 2: [2023-04-29 17:23:28,275] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 13: [2023-04-29 17:23:28,275] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 13: [2023-04-29 17:23:28,276] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 13: [2023-04-29 17:23:28,276] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 2: [2023-04-29 17:23:28,276] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 2: [2023-04-29 17:23:28,277] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 13: [2023-04-29 17:23:28,277] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 6: [2023-04-29 17:23:28,276] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 2: [2023-04-29 17:23:28,277] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 16: [2023-04-29 17:23:28,277] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 16: [2023-04-29 17:23:28,277] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 6: [2023-04-29 17:23:28,278] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 11: [2023-04-29 17:23:28,278] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 11: [2023-04-29 17:23:28,278] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 6: [2023-04-29 17:23:28,278] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 6: [2023-04-29 17:23:28,279] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 6: [2023-04-29 17:23:28,279] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 6: [2023-04-29 17:23:28,279] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 21: [2023-04-29 17:23:28,280] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 11: [2023-04-29 17:23:28,281] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 5: [2023-04-29 17:23:28,281] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 11: [2023-04-29 17:23:28,281] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 11: [2023-04-29 17:23:28,281] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 11: [2023-04-29 17:23:28,281] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 11: [2023-04-29 17:23:28,281] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 11: [2023-04-29 17:23:28,282] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 31: [2023-04-29 17:23:28,282] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 31: [2023-04-29 17:23:28,282] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 31: [2023-04-29 17:23:28,282] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 31: [2023-04-29 17:23:28,282] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 31: [2023-04-29 17:23:28,282] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 31: [2023-04-29 17:23:28,282] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 31: [2023-04-29 17:23:28,282] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 5: [2023-04-29 17:23:28,282] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 5: [2023-04-29 17:23:28,282] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 31: [2023-04-29 17:23:28,282] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 13: [2023-04-29 17:23:28,282] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 11: [2023-04-29 17:23:28,283] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 11: [2023-04-29 17:23:28,283] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 21: [2023-04-29 17:23:28,284] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 11: [2023-04-29 17:23:28,285] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 31: [2023-04-29 17:23:28,286] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 31: [2023-04-29 17:23:28,286] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 31: [2023-04-29 17:23:28,287] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 31: [2023-04-29 17:23:28,287] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 31: [2023-04-29 17:23:28,287] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 31: [2023-04-29 17:23:28,288] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 31: [2023-04-29 17:23:28,288] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 22: [2023-04-29 17:23:28,288] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 31: [2023-04-29 17:23:28,289] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 11: [2023-04-29 17:23:28,289] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 11: [2023-04-29 17:23:28,289] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 11: [2023-04-29 17:23:28,290] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 11: [2023-04-29 17:23:28,291] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 11: [2023-04-29 17:23:28,292] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 17: [2023-04-29 17:23:28,292] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 21: [2023-04-29 17:23:28,292] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 14: [2023-04-29 17:23:28,292] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 17: [2023-04-29 17:23:28,293] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 21: [2023-04-29 17:23:28,293] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 21: [2023-04-29 17:23:28,293] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 21: [2023-04-29 17:23:28,293] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 21: [2023-04-29 17:23:28,293] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 21: [2023-04-29 17:23:28,293] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 14: [2023-04-29 17:23:28,293] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 5: [2023-04-29 17:23:28,295] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 5: [2023-04-29 17:23:28,295] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 5: [2023-04-29 17:23:28,295] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 5: [2023-04-29 17:23:28,295] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 5: [2023-04-29 17:23:28,296] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 27: [2023-04-29 17:23:28,297] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 27: [2023-04-29 17:23:28,298] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 22: [2023-04-29 17:23:28,298] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 14: [2023-04-29 17:23:28,302] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 27: [2023-04-29 17:23:28,302] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 27: [2023-04-29 17:23:28,303] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 27: [2023-04-29 17:23:28,303] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 27: [2023-04-29 17:23:28,303] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 17: [2023-04-29 17:23:28,305] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 21: [2023-04-29 17:23:28,305] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 27: [2023-04-29 17:23:28,305] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 5: [2023-04-29 17:23:28,306] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 17: [2023-04-29 17:23:28,307] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 8: [2023-04-29 17:23:28,311] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 8: [2023-04-29 17:23:28,311] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 14: [2023-04-29 17:23:28,311] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 22: [2023-04-29 17:23:28,311] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 8: [2023-04-29 17:23:28,312] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 8: [2023-04-29 17:23:28,312] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 8: [2023-04-29 17:23:28,312] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 8: [2023-04-29 17:23:28,312] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 8: [2023-04-29 17:23:28,312] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 8: [2023-04-29 17:23:28,313] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 14: [2023-04-29 17:23:28,314] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 10: [2023-04-29 17:23:28,314] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 10: [2023-04-29 17:23:28,314] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 10: [2023-04-29 17:23:28,314] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 10: [2023-04-29 17:23:28,314] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 10: [2023-04-29 17:23:28,315] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 10: [2023-04-29 17:23:28,315] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 4: [2023-04-29 17:23:28,315] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 4: [2023-04-29 17:23:28,315] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 10: [2023-04-29 17:23:28,315] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 10: [2023-04-29 17:23:28,315] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 17: [2023-04-29 17:23:28,315] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 4: [2023-04-29 17:23:28,315] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 4: [2023-04-29 17:23:28,315] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 4: [2023-04-29 17:23:28,315] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 4: [2023-04-29 17:23:28,315] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 4: [2023-04-29 17:23:28,315] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 4: [2023-04-29 17:23:28,316] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 17: [2023-04-29 17:23:28,317] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 21: [2023-04-29 17:23:28,317] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 17: [2023-04-29 17:23:28,317] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 26: [2023-04-29 17:23:28,317] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 26: [2023-04-29 17:23:28,317] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 8: [2023-04-29 17:23:28,317] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 8: [2023-04-29 17:23:28,317] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 22: [2023-04-29 17:23:28,318] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 26: [2023-04-29 17:23:28,318] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 2: [2023-04-29 17:23:28,318] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 8: [2023-04-29 17:23:28,319] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 17: [2023-04-29 17:23:28,319] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 26: [2023-04-29 17:23:28,319] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 8: [2023-04-29 17:23:28,319] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 8: [2023-04-29 17:23:28,319] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 4: [2023-04-29 17:23:28,319] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 4: [2023-04-29 17:23:28,319] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 8: [2023-04-29 17:23:28,320] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 10: [2023-04-29 17:23:28,320] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 10: [2023-04-29 17:23:28,320] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 22: [2023-04-29 17:23:28,319] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 22: [2023-04-29 17:23:28,319] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 22: [2023-04-29 17:23:28,319] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 8: [2023-04-29 17:23:28,320] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 10: [2023-04-29 17:23:28,321] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 10: [2023-04-29 17:23:28,321] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 10: [2023-04-29 17:23:28,322] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 10: [2023-04-29 17:23:28,322] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 8: [2023-04-29 17:23:28,322] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 22: [2023-04-29 17:23:28,323] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 22: [2023-04-29 17:23:28,323] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 22: [2023-04-29 17:23:28,323] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 10: [2023-04-29 17:23:28,323] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 21: [2023-04-29 17:23:28,323] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 21: [2023-04-29 17:23:28,323] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 10: [2023-04-29 17:23:28,323] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 14: [2023-04-29 17:23:28,324] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 12: [2023-04-29 17:23:28,324] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 12: [2023-04-29 17:23:28,324] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 12: [2023-04-29 17:23:28,324] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 12: [2023-04-29 17:23:28,324] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 12: [2023-04-29 17:23:28,324] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 12: [2023-04-29 17:23:28,324] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 12: [2023-04-29 17:23:28,324] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 12: [2023-04-29 17:23:28,324] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 5: [2023-04-29 17:23:28,325] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 6: [2023-04-29 17:23:28,325] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 6: [2023-04-29 17:23:28,325] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 21: [2023-04-29 17:23:28,325] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 21: [2023-04-29 17:23:28,326] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 21: [2023-04-29 17:23:28,326] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 17: [2023-04-29 17:23:28,326] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 4: [2023-04-29 17:23:28,326] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 17: [2023-04-29 17:23:28,326] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 4: [2023-04-29 17:23:28,327] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 14: [2023-04-29 17:23:28,327] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 26: [2023-04-29 17:23:28,327] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 4: [2023-04-29 17:23:28,328] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 5: [2023-04-29 17:23:28,328] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 4: [2023-04-29 17:23:28,328] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 4: [2023-04-29 17:23:28,328] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 2: [2023-04-29 17:23:28,328] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 14: [2023-04-29 17:23:28,328] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 14: [2023-04-29 17:23:28,328] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 14: [2023-04-29 17:23:28,328] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 14: [2023-04-29 17:23:28,328] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 4: [2023-04-29 17:23:28,329] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 12: [2023-04-29 17:23:28,328] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 12: [2023-04-29 17:23:28,330] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 26: [2023-04-29 17:23:28,331] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 26: [2023-04-29 17:23:28,331] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 26: [2023-04-29 17:23:28,331] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 2: [2023-04-29 17:23:28,331] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 2: [2023-04-29 17:23:28,331] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 12: [2023-04-29 17:23:28,331] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 12: [2023-04-29 17:23:28,332] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 12: [2023-04-29 17:23:28,332] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 5: [2023-04-29 17:23:28,332] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 5: [2023-04-29 17:23:28,332] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 12: [2023-04-29 17:23:28,332] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 12: [2023-04-29 17:23:28,333] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 31: [2023-04-29 17:23:28,332] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 11: [2023-04-29 17:23:28,333] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 5: [2023-04-29 17:23:28,333] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 12: [2023-04-29 17:23:28,334] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 17: [2023-04-29 17:23:28,335] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 17: [2023-04-29 17:23:28,336] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 25: [2023-04-29 17:23:28,336] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 25: [2023-04-29 17:23:28,337] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 25: [2023-04-29 17:23:28,337] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 25: [2023-04-29 17:23:28,337] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 25: [2023-04-29 17:23:28,337] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 25: [2023-04-29 17:23:28,337] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 25: [2023-04-29 17:23:28,337] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 25: [2023-04-29 17:23:28,337] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 11: [2023-04-29 17:23:28,339] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 11: [2023-04-29 17:23:28,339] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 2: [2023-04-29 17:23:28,339] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 26: [2023-04-29 17:23:28,340] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 25: [2023-04-29 17:23:28,341] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 25: [2023-04-29 17:23:28,341] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 6: [2023-04-29 17:23:28,341] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 26: [2023-04-29 17:23:28,342] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 26: [2023-04-29 17:23:28,342] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 23: [2023-04-29 17:23:28,342] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 23: [2023-04-29 17:23:28,342] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 20: [2023-04-29 17:23:28,344] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 20: [2023-04-29 17:23:28,344] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 11: [2023-04-29 17:23:28,344] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 25: [2023-04-29 17:23:28,345] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 23: [2023-04-29 17:23:28,345] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 20: [2023-04-29 17:23:28,345] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 23: [2023-04-29 17:23:28,345] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 23: [2023-04-29 17:23:28,345] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 23: [2023-04-29 17:23:28,345] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 23: [2023-04-29 17:23:28,345] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 19: [2023-04-29 17:23:28,345] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 19: [2023-04-29 17:23:28,345] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 23: [2023-04-29 17:23:28,345] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 31: [2023-04-29 17:23:28,346] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 31: [2023-04-29 17:23:28,346] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 6: [2023-04-29 17:23:28,346] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 20: [2023-04-29 17:23:28,346] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 20: [2023-04-29 17:23:28,346] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 20: [2023-04-29 17:23:28,346] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 20: [2023-04-29 17:23:28,346] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 6: [2023-04-29 17:23:28,346] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 26: [2023-04-29 17:23:28,346] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 20: [2023-04-29 17:23:28,346] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 2: [2023-04-29 17:23:28,346] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 2: [2023-04-29 17:23:28,346] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 23: [2023-04-29 17:23:28,347] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 31: [2023-04-29 17:23:28,347] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 31: [2023-04-29 17:23:28,347] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 25: [2023-04-29 17:23:28,347] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 25: [2023-04-29 17:23:28,347] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 2: [2023-04-29 17:23:28,348] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 6: [2023-04-29 17:23:28,347] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 17: [2023-04-29 17:23:28,348] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 25: [2023-04-29 17:23:28,348] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 2: [2023-04-29 17:23:28,349] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 25: [2023-04-29 17:23:28,349] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 25: [2023-04-29 17:23:28,349] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 19: [2023-04-29 17:23:28,349] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 19: [2023-04-29 17:23:28,349] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 19: [2023-04-29 17:23:28,349] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 19: [2023-04-29 17:23:28,349] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 19: [2023-04-29 17:23:28,349] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 19: [2023-04-29 17:23:28,349] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 19: [2023-04-29 17:23:28,350] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 20: [2023-04-29 17:23:28,350] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 20: [2023-04-29 17:23:28,350] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 23: [2023-04-29 17:23:28,350] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 23: [2023-04-29 17:23:28,351] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 19: [2023-04-29 17:23:28,351] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 17: [2023-04-29 17:23:28,350] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 14: [2023-04-29 17:23:28,351] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 20: [2023-04-29 17:23:28,352] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 3: [2023-04-29 17:23:28,352] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 3: [2023-04-29 17:23:28,352] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 3: [2023-04-29 17:23:28,352] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 3: [2023-04-29 17:23:28,352] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 3: [2023-04-29 17:23:28,352] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 31: [2023-04-29 17:23:28,352] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 23: [2023-04-29 17:23:28,352] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 3: [2023-04-29 17:23:28,352] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 3: [2023-04-29 17:23:28,352] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 3: [2023-04-29 17:23:28,353] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 26: [2023-04-29 17:23:28,353] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 20: [2023-04-29 17:23:28,353] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 23: [2023-04-29 17:23:28,354] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 11: [2023-04-29 17:23:28,354] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 23: [2023-04-29 17:23:28,354] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 2: [2023-04-29 17:23:28,354] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 20: [2023-04-29 17:23:28,354] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 2: [2023-04-29 17:23:28,354] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 19: [2023-04-29 17:23:28,354] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 2: [2023-04-29 17:23:28,355] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 6: [2023-04-29 17:23:28,355] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 6: [2023-04-29 17:23:28,355] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 6: [2023-04-29 17:23:28,355] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 6: [2023-04-29 17:23:28,355] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 20: [2023-04-29 17:23:28,355] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 14: [2023-04-29 17:23:28,356] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 20: [2023-04-29 17:23:28,356] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 20: [2023-04-29 17:23:28,356] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 23: [2023-04-29 17:23:28,356] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 26: [2023-04-29 17:23:28,356] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 19: [2023-04-29 17:23:28,356] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 3: [2023-04-29 17:23:28,356] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 3: [2023-04-29 17:23:28,356] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 19: [2023-04-29 17:23:28,357] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 26: [2023-04-29 17:23:28,357] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 23: [2023-04-29 17:23:28,357] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 14: [2023-04-29 17:23:28,358] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 17: [2023-04-29 17:23:28,358] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 19: [2023-04-29 17:23:28,358] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 17: [2023-04-29 17:23:28,358] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 29: [2023-04-29 17:23:28,358] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 29: [2023-04-29 17:23:28,358] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 19: [2023-04-29 17:23:28,358] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 11: [2023-04-29 17:23:28,358] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 26: [2023-04-29 17:23:28,359] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 19: [2023-04-29 17:23:28,359] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 11: [2023-04-29 17:23:28,361] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 14: [2023-04-29 17:23:28,361] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 14: [2023-04-29 17:23:28,361] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 11: [2023-04-29 17:23:28,361] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 3: [2023-04-29 17:23:28,361] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 11: [2023-04-29 17:23:28,361] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 11: [2023-04-29 17:23:28,361] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 3: [2023-04-29 17:23:28,361] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 3: [2023-04-29 17:23:28,362] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 3: [2023-04-29 17:23:28,362] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 3: [2023-04-29 17:23:28,362] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 29: [2023-04-29 17:23:28,362] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 29: [2023-04-29 17:23:28,362] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 29: [2023-04-29 17:23:28,362] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 29: [2023-04-29 17:23:28,362] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 29: [2023-04-29 17:23:28,362] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 29: [2023-04-29 17:23:28,363] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 29: [2023-04-29 17:23:28,363] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 31: [2023-04-29 17:23:28,363] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 31: [2023-04-29 17:23:28,363] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 31: [2023-04-29 17:23:28,363] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 29: [2023-04-29 17:23:28,363] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 3: [2023-04-29 17:23:28,363] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 6: [2023-04-29 17:23:28,366] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 11: [2023-04-29 17:23:28,366] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 22: [2023-04-29 17:23:28,351] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 22: [2023-04-29 17:23:28,352] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 22: [2023-04-29 17:23:28,352] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 22: [2023-04-29 17:23:28,353] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 22: [2023-04-29 17:23:28,353] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 22: [2023-04-29 17:23:28,356] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 11: [2023-04-29 17:23:28,368] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 8: [2023-04-29 17:23:28,369] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 31: [2023-04-29 17:23:28,370] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 31: [2023-04-29 17:23:28,370] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 31: [2023-04-29 17:23:28,370] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 29: [2023-04-29 17:23:28,370] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 4: [2023-04-29 17:23:28,371] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 4: [2023-04-29 17:23:28,371] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 31: [2023-04-29 17:23:28,372] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 29: [2023-04-29 17:23:28,372] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 29: [2023-04-29 17:23:28,373] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 29: [2023-04-29 17:23:28,373] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 10: [2023-04-29 17:23:28,373] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 18: [2023-04-29 17:23:28,373] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 18: [2023-04-29 17:23:28,373] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 18: [2023-04-29 17:23:28,373] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 18: [2023-04-29 17:23:28,374] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 18: [2023-04-29 17:23:28,374] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 18: [2023-04-29 17:23:28,374] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 18: [2023-04-29 17:23:28,374] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 8: [2023-04-29 17:23:28,374] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 18: [2023-04-29 17:23:28,374] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 29: [2023-04-29 17:23:28,374] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 29: [2023-04-29 17:23:28,375] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 12: [2023-04-29 17:23:28,375] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 8: [2023-04-29 17:23:28,375] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 8: [2023-04-29 17:23:28,375] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 2: [2023-04-29 17:23:28,376] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 2: [2023-04-29 17:23:28,377] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 8: [2023-04-29 17:23:28,377] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 8: [2023-04-29 17:23:28,377] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 2: [2023-04-29 17:23:28,378] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 6: [2023-04-29 17:23:28,378] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 10: [2023-04-29 17:23:28,378] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 10: [2023-04-29 17:23:28,378] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 2: [2023-04-29 17:23:28,379] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 18: [2023-04-29 17:23:28,380] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 0: [2023-04-29 17:23:28,381] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 0: [2023-04-29 17:23:28,381] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 0: [2023-04-29 17:23:28,381] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 0: [2023-04-29 17:23:28,381] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 0: [2023-04-29 17:23:28,381] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 0: [2023-04-29 17:23:28,381] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 0: [2023-04-29 17:23:28,381] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 0: [2023-04-29 17:23:28,381] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 10: [2023-04-29 17:23:28,382] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 10: [2023-04-29 17:23:28,382] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 10: [2023-04-29 17:23:28,383] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 10: [2023-04-29 17:23:28,383] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 10: [2023-04-29 17:23:28,383] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 24: [2023-04-29 17:23:28,384] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 24: [2023-04-29 17:23:28,385] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 24: [2023-04-29 17:23:28,385] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 24: [2023-04-29 17:23:28,385] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 24: [2023-04-29 17:23:28,385] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 24: [2023-04-29 17:23:28,385] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 24: [2023-04-29 17:23:28,385] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 24: [2023-04-29 17:23:28,385] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 12: [2023-04-29 17:23:28,386] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 6: [2023-04-29 17:23:28,386] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 6: [2023-04-29 17:23:28,387] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 18: [2023-04-29 17:23:28,387] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 6: [2023-04-29 17:23:28,387] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 18: [2023-04-29 17:23:28,387] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 11: [2023-04-29 17:23:28,387] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 18: [2023-04-29 17:23:28,388] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 24: [2023-04-29 17:23:28,388] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 6: [2023-04-29 17:23:28,388] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 18: [2023-04-29 17:23:28,388] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 18: [2023-04-29 17:23:28,388] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 31: [2023-04-29 17:23:28,388] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 18: [2023-04-29 17:23:28,389] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 11: [2023-04-29 17:23:28,389] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 8: [2023-04-29 17:23:28,390] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 18: [2023-04-29 17:23:28,390] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 4: [2023-04-29 17:23:28,390] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 31: [2023-04-29 17:23:28,391] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 31: [2023-04-29 17:23:28,392] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 8: [2023-04-29 17:23:28,392] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 4: [2023-04-29 17:23:28,392] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 0: [2023-04-29 17:23:28,393] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 0: [2023-04-29 17:23:28,394] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 0: [2023-04-29 17:23:28,394] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 12: [2023-04-29 17:23:28,394] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 25: [2023-04-29 17:23:28,394] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 25: [2023-04-29 17:23:28,394] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 0: [2023-04-29 17:23:28,395] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 11: [2023-04-29 17:23:28,395] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 0: [2023-04-29 17:23:28,395] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 11: [2023-04-29 17:23:28,396] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 0: [2023-04-29 17:23:28,396] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 24: [2023-04-29 17:23:28,395] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 24: [2023-04-29 17:23:28,396] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 24: [2023-04-29 17:23:28,396] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 0: [2023-04-29 17:23:28,396] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 19: [2023-04-29 17:23:28,396] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 24: [2023-04-29 17:23:28,397] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 0: [2023-04-29 17:23:28,397] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 24: [2023-04-29 17:23:28,397] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 24: [2023-04-29 17:23:28,398] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 12: [2023-04-29 17:23:28,398] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 4: [2023-04-29 17:23:28,398] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 10: [2023-04-29 17:23:28,398] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 24: [2023-04-29 17:23:28,399] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 8: [2023-04-29 17:23:28,399] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 12: [2023-04-29 17:23:28,399] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 4: [2023-04-29 17:23:28,400] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 9: [2023-04-29 17:23:28,400] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 12: [2023-04-29 17:23:28,400] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 12: [2023-04-29 17:23:28,400] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 12: [2023-04-29 17:23:28,401] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 9: [2023-04-29 17:23:28,401] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 9: [2023-04-29 17:23:28,401] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 9: [2023-04-29 17:23:28,401] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 9: [2023-04-29 17:23:28,401] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 9: [2023-04-29 17:23:28,401] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 12: [2023-04-29 17:23:28,400] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 9: [2023-04-29 17:23:28,401] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 4: [2023-04-29 17:23:28,401] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 4: [2023-04-29 17:23:28,401] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 4: [2023-04-29 17:23:28,401] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 4: [2023-04-29 17:23:28,401] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 9: [2023-04-29 17:23:28,401] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 8: [2023-04-29 17:23:28,401] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 7: [2023-04-29 17:23:28,403] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 7: [2023-04-29 17:23:28,403] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 7: [2023-04-29 17:23:28,403] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 7: [2023-04-29 17:23:28,403] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 7: [2023-04-29 17:23:28,403] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 7: [2023-04-29 17:23:28,403] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 7: [2023-04-29 17:23:28,403] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 7: [2023-04-29 17:23:28,403] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 20: [2023-04-29 17:23:28,404] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 20: [2023-04-29 17:23:28,404] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 25: [2023-04-29 17:23:28,404] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 10: [2023-04-29 17:23:28,404] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 10: [2023-04-29 17:23:28,404] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 8: [2023-04-29 17:23:28,404] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 8: [2023-04-29 17:23:28,405] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 8: [2023-04-29 17:23:28,405] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 8: [2023-04-29 17:23:28,405] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 23: [2023-04-29 17:23:28,405] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 23: [2023-04-29 17:23:28,405] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 9: [2023-04-29 17:23:28,405] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 9: [2023-04-29 17:23:28,406] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 9: [2023-04-29 17:23:28,406] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 9: [2023-04-29 17:23:28,406] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 9: [2023-04-29 17:23:28,407] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 9: [2023-04-29 17:23:28,407] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 9: [2023-04-29 17:23:28,407] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 9: [2023-04-29 17:23:28,407] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 7: [2023-04-29 17:23:28,408] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 7: [2023-04-29 17:23:28,408] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 3: [2023-04-29 17:23:28,408] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 3: [2023-04-29 17:23:28,408] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 7: [2023-04-29 17:23:28,408] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 20: [2023-04-29 17:23:28,408] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 7: [2023-04-29 17:23:28,409] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 7: [2023-04-29 17:23:28,410] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 7: [2023-04-29 17:23:28,410] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 7: [2023-04-29 17:23:28,410] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 7: [2023-04-29 17:23:28,411] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 10: [2023-04-29 17:23:28,411] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 12: [2023-04-29 17:23:28,411] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 19: [2023-04-29 17:23:28,411] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 10: [2023-04-29 17:23:28,412] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 25: [2023-04-29 17:23:28,414] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 29: [2023-04-29 17:23:28,414] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 19: [2023-04-29 17:23:28,414] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 10: [2023-04-29 17:23:28,415] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 10: [2023-04-29 17:23:28,415] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 25: [2023-04-29 17:23:28,416] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 23: [2023-04-29 17:23:28,416] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 19: [2023-04-29 17:23:28,417] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 10: [2023-04-29 17:23:28,418] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 29: [2023-04-29 17:23:28,418] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 8: [2023-04-29 17:23:28,419] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 20: [2023-04-29 17:23:28,418] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 20: [2023-04-29 17:23:28,418] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 20: [2023-04-29 17:23:28,418] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 20: [2023-04-29 17:23:28,420] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 20: [2023-04-29 17:23:28,420] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 23: [2023-04-29 17:23:28,420] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 25: [2023-04-29 17:23:28,421] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 25: [2023-04-29 17:23:28,421] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 25: [2023-04-29 17:23:28,421] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 12: [2023-04-29 17:23:28,422] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 25: [2023-04-29 17:23:28,422] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 25: [2023-04-29 17:23:28,422] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 8: [2023-04-29 17:23:28,424] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 30: [2023-04-29 17:23:28,425] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 30: [2023-04-29 17:23:28,426] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 30: [2023-04-29 17:23:28,426] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 30: [2023-04-29 17:23:28,426] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 30: [2023-04-29 17:23:28,426] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 30: [2023-04-29 17:23:28,426] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 30: [2023-04-29 17:23:28,426] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 30: [2023-04-29 17:23:28,426] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 19: [2023-04-29 17:23:28,427] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 19: [2023-04-29 17:23:28,427] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 19: [2023-04-29 17:23:28,427] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 19: [2023-04-29 17:23:28,427] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 15: [2023-04-29 17:23:28,427] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 15: [2023-04-29 17:23:28,427] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 15: [2023-04-29 17:23:28,427] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 15: [2023-04-29 17:23:28,427] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 15: [2023-04-29 17:23:28,427] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 15: [2023-04-29 17:23:28,427] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 15: [2023-04-29 17:23:28,427] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 15: [2023-04-29 17:23:28,428] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 19: [2023-04-29 17:23:28,428] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 23: [2023-04-29 17:23:28,428] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 3: [2023-04-29 17:23:28,429] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 12: [2023-04-29 17:23:28,429] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 12: [2023-04-29 17:23:28,429] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 3: [2023-04-29 17:23:28,429] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 23: [2023-04-29 17:23:28,430] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 23: [2023-04-29 17:23:28,430] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 20: [2023-04-29 17:23:28,430] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 3: [2023-04-29 17:23:28,430] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 20: [2023-04-29 17:23:28,430] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 25: [2023-04-29 17:23:28,430] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 4: [2023-04-29 17:23:28,432] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 12: [2023-04-29 17:23:28,433] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 12: [2023-04-29 17:23:28,433] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 12: [2023-04-29 17:23:28,434] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 23: [2023-04-29 17:23:28,434] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 23: [2023-04-29 17:23:28,434] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 15: [2023-04-29 17:23:28,434] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 3: [2023-04-29 17:23:28,434] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 3: [2023-04-29 17:23:28,434] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 3: [2023-04-29 17:23:28,434] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 3: [2023-04-29 17:23:28,434] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 3: [2023-04-29 17:23:28,434] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 19: [2023-04-29 17:23:28,435] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 4: [2023-04-29 17:23:28,435] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 29: [2023-04-29 17:23:28,435] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 4: [2023-04-29 17:23:28,437] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 19: [2023-04-29 17:23:28,437] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 23: [2023-04-29 17:23:28,437] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 30: [2023-04-29 17:23:28,437] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 29: [2023-04-29 17:23:28,437] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 30: [2023-04-29 17:23:28,437] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 29: [2023-04-29 17:23:28,438] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 4: [2023-04-29 17:23:28,437] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 30: [2023-04-29 17:23:28,438] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 30: [2023-04-29 17:23:28,438] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 20: [2023-04-29 17:23:28,438] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 24: [2023-04-29 17:23:28,438] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 30: [2023-04-29 17:23:28,438] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 30: [2023-04-29 17:23:28,438] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 30: [2023-04-29 17:23:28,439] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 4: [2023-04-29 17:23:28,439] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 4: [2023-04-29 17:23:28,439] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 30: [2023-04-29 17:23:28,439] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 15: [2023-04-29 17:23:28,441] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 28: [2023-04-29 17:23:28,441] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 28: [2023-04-29 17:23:28,441] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 28: [2023-04-29 17:23:28,441] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 28: [2023-04-29 17:23:28,442] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 28: [2023-04-29 17:23:28,442] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 15: [2023-04-29 17:23:28,441] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 15: [2023-04-29 17:23:28,442] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 28: [2023-04-29 17:23:28,442] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 28: [2023-04-29 17:23:28,442] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 28: [2023-04-29 17:23:28,442] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 15: [2023-04-29 17:23:28,442] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 15: [2023-04-29 17:23:28,442] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 15: [2023-04-29 17:23:28,442] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 15: [2023-04-29 17:23:28,443] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 29: [2023-04-29 17:23:28,444] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 29: [2023-04-29 17:23:28,444] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 23: [2023-04-29 17:23:28,446] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 29: [2023-04-29 17:23:28,447] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 20: [2023-04-29 17:23:28,448] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 20: [2023-04-29 17:23:28,448] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 20: [2023-04-29 17:23:28,450] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 23: [2023-04-29 17:23:28,450] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 25: [2023-04-29 17:23:28,450] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 18: [2023-04-29 17:23:28,449] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 28: [2023-04-29 17:23:28,450] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 25: [2023-04-29 17:23:28,452] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 19: [2023-04-29 17:23:28,454] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 28: [2023-04-29 17:23:28,454] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 28: [2023-04-29 17:23:28,455] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 29: [2023-04-29 17:23:28,454] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 29: [2023-04-29 17:23:28,454] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 25: [2023-04-29 17:23:28,455] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 25: [2023-04-29 17:23:28,455] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 28: [2023-04-29 17:23:28,455] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 3: [2023-04-29 17:23:28,455] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 28: [2023-04-29 17:23:28,456] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 20: [2023-04-29 17:23:28,456] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 28: [2023-04-29 17:23:28,456] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 19: [2023-04-29 17:23:28,456] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 19: [2023-04-29 17:23:28,457] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 28: [2023-04-29 17:23:28,457] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 28: [2023-04-29 17:23:28,457] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt... 25: [2023-04-29 17:23:28,458] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 24: [2023-04-29 17:23:28,458] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 9: [2023-04-29 17:23:28,458] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 20: [2023-04-29 17:23:28,459] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 19: [2023-04-29 17:23:28,460] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 19: [2023-04-29 17:23:28,460] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 9: [2023-04-29 17:23:28,460] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 23: [2023-04-29 17:23:28,461] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 29: [2023-04-29 17:23:28,461] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 7: [2023-04-29 17:23:28,461] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 7: [2023-04-29 17:23:28,461] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 7: [2023-04-29 17:23:28,461] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 24: [2023-04-29 17:23:28,463] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 3: [2023-04-29 17:23:28,465] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 23: [2023-04-29 17:23:28,465] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 3: [2023-04-29 17:23:28,465] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 9: [2023-04-29 17:23:28,465] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 9: [2023-04-29 17:23:28,465] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 9: [2023-04-29 17:23:28,465] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 3: [2023-04-29 17:23:28,466] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 3: [2023-04-29 17:23:28,466] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 1: [2023-04-29 17:23:28,466] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 1: [2023-04-29 17:23:28,466] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 1: [2023-04-29 17:23:28,466] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 1: [2023-04-29 17:23:28,466] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 1: [2023-04-29 17:23:28,466] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 1: [2023-04-29 17:23:28,467] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 1: [2023-04-29 17:23:28,467] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 1: [2023-04-29 17:23:28,467] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 7: [2023-04-29 17:23:28,468] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 18: [2023-04-29 17:23:28,469] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 23: [2023-04-29 17:23:28,470] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 18: [2023-04-29 17:23:28,469] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 23: [2023-04-29 17:23:28,470] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 3: [2023-04-29 17:23:28,470] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 9: [2023-04-29 17:23:28,470] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 9: [2023-04-29 17:23:28,470] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 9: [2023-04-29 17:23:28,470] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 1: [2023-04-29 17:23:28,470] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 1: [2023-04-29 17:23:28,472] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 29: [2023-04-29 17:23:28,472] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 1: [2023-04-29 17:23:28,472] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 1: [2023-04-29 17:23:28,472] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 1: [2023-04-29 17:23:28,474] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 1: [2023-04-29 17:23:28,474] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 1: [2023-04-29 17:23:28,474] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 0: [2023-04-29 17:23:28,475] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 0: [2023-04-29 17:23:28,475] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 0: [2023-04-29 17:23:28,475] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 1: [2023-04-29 17:23:28,475] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 29: [2023-04-29 17:23:28,475] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 18: [2023-04-29 17:23:28,477] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 24: [2023-04-29 17:23:28,477] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 24: [2023-04-29 17:23:28,477] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 24: [2023-04-29 17:23:28,477] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 24: [2023-04-29 17:23:28,478] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 24: [2023-04-29 17:23:28,478] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 24: [2023-04-29 17:23:28,478] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 7: [2023-04-29 17:23:28,479] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 7: [2023-04-29 17:23:28,479] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 7: [2023-04-29 17:23:28,479] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 7: [2023-04-29 17:23:28,480] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 29: [2023-04-29 17:23:28,481] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 18: [2023-04-29 17:23:28,481] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 18: [2023-04-29 17:23:28,481] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 18: [2023-04-29 17:23:28,481] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 18: [2023-04-29 17:23:28,481] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 18: [2023-04-29 17:23:28,481] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 7: [2023-04-29 17:23:28,484] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 29: [2023-04-29 17:23:28,485] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 9: [2023-04-29 17:23:28,485] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 9: [2023-04-29 17:23:28,486] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 7: [2023-04-29 17:23:28,486] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 7: [2023-04-29 17:23:28,487] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 29: [2023-04-29 17:23:28,487] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 24: [2023-04-29 17:23:28,488] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 0: [2023-04-29 17:23:28,489] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 0: [2023-04-29 17:23:28,489] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 0: [2023-04-29 17:23:28,489] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 0: [2023-04-29 17:23:28,489] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 0: [2023-04-29 17:23:28,489] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 9: [2023-04-29 17:23:28,490] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 9: [2023-04-29 17:23:28,490] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 9: [2023-04-29 17:23:28,491] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 9: [2023-04-29 17:23:28,493] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 18: [2023-04-29 17:23:28,495] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 9: [2023-04-29 17:23:28,495] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 9: [2023-04-29 17:23:28,495] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 7: [2023-04-29 17:23:28,495] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 18: [2023-04-29 17:23:28,498] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 0: [2023-04-29 17:23:28,501] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 0: [2023-04-29 17:23:28,501] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 15: [2023-04-29 17:23:28,501] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 0: [2023-04-29 17:23:28,505] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 7: [2023-04-29 17:23:28,506] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 24: [2023-04-29 17:23:28,506] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 7: [2023-04-29 17:23:28,507] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 7: [2023-04-29 17:23:28,507] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 24: [2023-04-29 17:23:28,508] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 7: [2023-04-29 17:23:28,509] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 30: [2023-04-29 17:23:28,509] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 24: [2023-04-29 17:23:28,511] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 24: [2023-04-29 17:23:28,513] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 18: [2023-04-29 17:23:28,515] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 18: [2023-04-29 17:23:28,515] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 18: [2023-04-29 17:23:28,516] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 18: [2023-04-29 17:23:28,517] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 18: [2023-04-29 17:23:28,518] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 28: [2023-04-29 17:23:28,518] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 24: [2023-04-29 17:23:28,519] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 24: [2023-04-29 17:23:28,519] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 21: [2023-04-29 17:23:28,519] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 21: [2023-04-29 17:23:28,519] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 21: [2023-04-29 17:23:28,519] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 21: [2023-04-29 17:23:28,519] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 21: [2023-04-29 17:23:28,519] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 21: [2023-04-29 17:23:28,519] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 21: [2023-04-29 17:23:28,519] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 21: [2023-04-29 17:23:28,520] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 1: [2023-04-29 17:23:28,521] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 0: [2023-04-29 17:23:28,522] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 0: [2023-04-29 17:23:28,522] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 0: [2023-04-29 17:23:28,524] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 0: [2023-04-29 17:23:28,524] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 21: [2023-04-29 17:23:28,524] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 21: [2023-04-29 17:23:28,524] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 21: [2023-04-29 17:23:28,524] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 21: [2023-04-29 17:23:28,524] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 15: [2023-04-29 17:23:28,525] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 21: [2023-04-29 17:23:28,526] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 21: [2023-04-29 17:23:28,526] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 21: [2023-04-29 17:23:28,526] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 0: [2023-04-29 17:23:28,526] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 21: [2023-04-29 17:23:28,526] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 15: [2023-04-29 17:23:28,527] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 15: [2023-04-29 17:23:28,528] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 15: [2023-04-29 17:23:28,528] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 15: [2023-04-29 17:23:28,529] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 15: [2023-04-29 17:23:28,529] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 15: [2023-04-29 17:23:28,529] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 15: [2023-04-29 17:23:28,529] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 30: [2023-04-29 17:23:28,529] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 30: [2023-04-29 17:23:28,529] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 30: [2023-04-29 17:23:28,529] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 30: [2023-04-29 17:23:28,529] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 30: [2023-04-29 17:23:28,529] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 30: [2023-04-29 17:23:28,529] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 30: [2023-04-29 17:23:28,529] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 1: [2023-04-29 17:23:28,532] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 1: [2023-04-29 17:23:28,532] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 1: [2023-04-29 17:23:28,532] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 30: [2023-04-29 17:23:28,534] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 28: [2023-04-29 17:23:28,535] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 28: [2023-04-29 17:23:28,535] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 1: [2023-04-29 17:23:28,537] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 1: [2023-04-29 17:23:28,537] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 1: [2023-04-29 17:23:28,537] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 1: [2023-04-29 17:23:28,537] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 1: [2023-04-29 17:23:28,542] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 16: [2023-04-29 17:23:28,544] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 16: [2023-04-29 17:23:28,544] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 16: [2023-04-29 17:23:28,544] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 16: [2023-04-29 17:23:28,545] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 16: [2023-04-29 17:23:28,545] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 16: [2023-04-29 17:23:28,545] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 16: [2023-04-29 17:23:28,545] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 16: [2023-04-29 17:23:28,545] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 28: [2023-04-29 17:23:28,545] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 16: [2023-04-29 17:23:28,550] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 16: [2023-04-29 17:23:28,550] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 16: [2023-04-29 17:23:28,550] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 16: [2023-04-29 17:23:28,551] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 16: [2023-04-29 17:23:28,551] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 16: [2023-04-29 17:23:28,551] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 16: [2023-04-29 17:23:28,552] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 28: [2023-04-29 17:23:28,551] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 28: [2023-04-29 17:23:28,552] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 28: [2023-04-29 17:23:28,552] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 28: [2023-04-29 17:23:28,552] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 28: [2023-04-29 17:23:28,552] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_27-model_00-model_states.pt. 16: [2023-04-29 17:23:28,552] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 1: [2023-04-29 17:23:28,558] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 1: [2023-04-29 17:23:28,558] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 22: [2023-04-29 17:23:28,558] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 22: [2023-04-29 17:23:28,558] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 22: [2023-04-29 17:23:28,558] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 22: [2023-04-29 17:23:28,558] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 22: [2023-04-29 17:23:28,559] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 22: [2023-04-29 17:23:28,559] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 22: [2023-04-29 17:23:28,559] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 22: [2023-04-29 17:23:28,559] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 22: [2023-04-29 17:23:28,561] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 1: [2023-04-29 17:23:28,561] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 28: [2023-04-29 17:23:28,562] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 15: [2023-04-29 17:23:28,562] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 22: [2023-04-29 17:23:28,563] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 28: [2023-04-29 17:23:28,563] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 30: [2023-04-29 17:23:28,562] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 15: [2023-04-29 17:23:28,563] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 30: [2023-04-29 17:23:28,564] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 1: [2023-04-29 17:23:28,564] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 15: [2023-04-29 17:23:28,564] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 15: [2023-04-29 17:23:28,565] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 1: [2023-04-29 17:23:28,565] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 30: [2023-04-29 17:23:28,567] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 22: [2023-04-29 17:23:28,567] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 15: [2023-04-29 17:23:28,567] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 1: [2023-04-29 17:23:28,568] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 1: [2023-04-29 17:23:28,568] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 22: [2023-04-29 17:23:28,568] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 15: [2023-04-29 17:23:28,568] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 22: [2023-04-29 17:23:28,569] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 22: [2023-04-29 17:23:28,570] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 22: [2023-04-29 17:23:28,570] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 22: [2023-04-29 17:23:28,570] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 15: [2023-04-29 17:23:28,570] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 30: [2023-04-29 17:23:28,571] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 30: [2023-04-29 17:23:28,572] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 30: [2023-04-29 17:23:28,574] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 30: [2023-04-29 17:23:28,575] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 21: [2023-04-29 17:23:28,580] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 21: [2023-04-29 17:23:28,580] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 21: [2023-04-29 17:23:28,580] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 28: [2023-04-29 17:23:28,581] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 21: [2023-04-29 17:23:28,584] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 28: [2023-04-29 17:23:28,585] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 28: [2023-04-29 17:23:28,586] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 21: [2023-04-29 17:23:28,590] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 28: [2023-04-29 17:23:28,590] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 28: [2023-04-29 17:23:28,590] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 21: [2023-04-29 17:23:28,596] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 21: [2023-04-29 17:23:28,596] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 21: [2023-04-29 17:23:28,596] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 16: [2023-04-29 17:23:28,605] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 16: [2023-04-29 17:23:28,605] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 21: [2023-04-29 17:23:28,606] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 16: [2023-04-29 17:23:28,608] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 21: [2023-04-29 17:23:28,609] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 2: [2023-04-29 17:23:28,610] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 2: [2023-04-29 17:23:28,610] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 2: [2023-04-29 17:23:28,610] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 2: [2023-04-29 17:23:28,610] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 21: [2023-04-29 17:23:28,610] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 2: [2023-04-29 17:23:28,610] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 2: [2023-04-29 17:23:28,610] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 2: [2023-04-29 17:23:28,610] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 16: [2023-04-29 17:23:28,610] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 2: [2023-04-29 17:23:28,611] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 21: [2023-04-29 17:23:28,612] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 22: [2023-04-29 17:23:28,613] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 22: [2023-04-29 17:23:28,613] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 2: [2023-04-29 17:23:28,613] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 17: [2023-04-29 17:23:28,614] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 2: [2023-04-29 17:23:28,615] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 17: [2023-04-29 17:23:28,615] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 17: [2023-04-29 17:23:28,615] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 17: [2023-04-29 17:23:28,615] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 2: [2023-04-29 17:23:28,615] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 17: [2023-04-29 17:23:28,615] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 17: [2023-04-29 17:23:28,615] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 17: [2023-04-29 17:23:28,615] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 17: [2023-04-29 17:23:28,616] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 2: [2023-04-29 17:23:28,617] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 26: [2023-04-29 17:23:28,617] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 26: [2023-04-29 17:23:28,617] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 26: [2023-04-29 17:23:28,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 26: [2023-04-29 17:23:28,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 26: [2023-04-29 17:23:28,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 26: [2023-04-29 17:23:28,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 26: [2023-04-29 17:23:28,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 26: [2023-04-29 17:23:28,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 21: [2023-04-29 17:23:28,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 17: [2023-04-29 17:23:28,620] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 2: [2023-04-29 17:23:28,620] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 2: [2023-04-29 17:23:28,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 17: [2023-04-29 17:23:28,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 2: [2023-04-29 17:23:28,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 16: [2023-04-29 17:23:28,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 16: [2023-04-29 17:23:28,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 16: [2023-04-29 17:23:28,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 16: [2023-04-29 17:23:28,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 17: [2023-04-29 17:23:28,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 2: [2023-04-29 17:23:28,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 26: [2023-04-29 17:23:28,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 21: [2023-04-29 17:23:28,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 21: [2023-04-29 17:23:28,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 21: [2023-04-29 17:23:28,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 17: [2023-04-29 17:23:28,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 26: [2023-04-29 17:23:28,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 17: [2023-04-29 17:23:28,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 26: [2023-04-29 17:23:28,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 26: [2023-04-29 17:23:28,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 17: [2023-04-29 17:23:28,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 26: [2023-04-29 17:23:28,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 17: [2023-04-29 17:23:28,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 26: [2023-04-29 17:23:28,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 17: [2023-04-29 17:23:28,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 26: [2023-04-29 17:23:28,627] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 26: [2023-04-29 17:23:28,627] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 22: [2023-04-29 17:23:28,626] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 16: [2023-04-29 17:23:28,631] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 16: [2023-04-29 17:23:28,632] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 6: [2023-04-29 17:23:28,633] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 6: [2023-04-29 17:23:28,633] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 6: [2023-04-29 17:23:28,633] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 6: [2023-04-29 17:23:28,633] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 6: [2023-04-29 17:23:28,633] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 16: [2023-04-29 17:23:28,634] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 6: [2023-04-29 17:23:28,633] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 6: [2023-04-29 17:23:28,633] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 6: [2023-04-29 17:23:28,634] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 22: [2023-04-29 17:23:28,635] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 22: [2023-04-29 17:23:28,635] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 16: [2023-04-29 17:23:28,635] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 6: [2023-04-29 17:23:28,637] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 6: [2023-04-29 17:23:28,638] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 6: [2023-04-29 17:23:28,641] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 13: [2023-04-29 17:23:28,641] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 6: [2023-04-29 17:23:28,641] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 13: [2023-04-29 17:23:28,642] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 6: [2023-04-29 17:23:28,643] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 6: [2023-04-29 17:23:28,643] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 22: [2023-04-29 17:23:28,644] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 6: [2023-04-29 17:23:28,644] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 22: [2023-04-29 17:23:28,644] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 6: [2023-04-29 17:23:28,645] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 22: [2023-04-29 17:23:28,645] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 22: [2023-04-29 17:23:28,645] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 22: [2023-04-29 17:23:28,645] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 13: [2023-04-29 17:23:28,645] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 13: [2023-04-29 17:23:28,645] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 13: [2023-04-29 17:23:28,645] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 13: [2023-04-29 17:23:28,645] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 13: [2023-04-29 17:23:28,645] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 13: [2023-04-29 17:23:28,645] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 13: [2023-04-29 17:23:28,645] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 16: [2023-04-29 17:23:28,647] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 27: [2023-04-29 17:23:28,648] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 13: [2023-04-29 17:23:28,648] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 27: [2023-04-29 17:23:28,648] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 27: [2023-04-29 17:23:28,648] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 27: [2023-04-29 17:23:28,648] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 27: [2023-04-29 17:23:28,648] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 27: [2023-04-29 17:23:28,648] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 27: [2023-04-29 17:23:28,648] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 27: [2023-04-29 17:23:28,649] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 16: [2023-04-29 17:23:28,649] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 13: [2023-04-29 17:23:28,650] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 27: [2023-04-29 17:23:28,650] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 22: [2023-04-29 17:23:28,651] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 16: [2023-04-29 17:23:28,651] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 16: [2023-04-29 17:23:28,651] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 13: [2023-04-29 17:23:28,654] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 13: [2023-04-29 17:23:28,655] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 13: [2023-04-29 17:23:28,655] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 13: [2023-04-29 17:23:28,656] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 13: [2023-04-29 17:23:28,656] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 27: [2023-04-29 17:23:28,658] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 27: [2023-04-29 17:23:28,660] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 27: [2023-04-29 17:23:28,660] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 2: [2023-04-29 17:23:28,662] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 27: [2023-04-29 17:23:28,662] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 27: [2023-04-29 17:23:28,662] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 27: [2023-04-29 17:23:28,662] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 27: [2023-04-29 17:23:28,663] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 5: [2023-04-29 17:23:28,670] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 5: [2023-04-29 17:23:28,670] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 17: [2023-04-29 17:23:28,672] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 4: [2023-04-29 17:23:28,673] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 4: [2023-04-29 17:23:28,673] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 2: [2023-04-29 17:23:28,673] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 26: [2023-04-29 17:23:28,673] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 2: [2023-04-29 17:23:28,674] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 2: [2023-04-29 17:23:28,674] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 5: [2023-04-29 17:23:28,674] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 5: [2023-04-29 17:23:28,674] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 5: [2023-04-29 17:23:28,674] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 5: [2023-04-29 17:23:28,674] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 5: [2023-04-29 17:23:28,674] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 5: [2023-04-29 17:23:28,674] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 5: [2023-04-29 17:23:28,675] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 5: [2023-04-29 17:23:28,675] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 4: [2023-04-29 17:23:28,675] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 4: [2023-04-29 17:23:28,675] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 4: [2023-04-29 17:23:28,675] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 4: [2023-04-29 17:23:28,675] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 4: [2023-04-29 17:23:28,675] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 4: [2023-04-29 17:23:28,675] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 17: [2023-04-29 17:23:28,676] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 22: [2023-04-29 17:23:28,676] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 22: [2023-04-29 17:23:28,676] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 22: [2023-04-29 17:23:28,677] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 22: [2023-04-29 17:23:28,677] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 4: [2023-04-29 17:23:28,678] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 4: [2023-04-29 17:23:28,678] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 22: [2023-04-29 17:23:28,678] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 31: [2023-04-29 17:23:28,678] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 31: [2023-04-29 17:23:28,678] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 31: [2023-04-29 17:23:28,678] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 31: [2023-04-29 17:23:28,679] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 31: [2023-04-29 17:23:28,679] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 31: [2023-04-29 17:23:28,679] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 31: [2023-04-29 17:23:28,679] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 31: [2023-04-29 17:23:28,679] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 26: [2023-04-29 17:23:28,681] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 26: [2023-04-29 17:23:28,683] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 31: [2023-04-29 17:23:28,683] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 31: [2023-04-29 17:23:28,683] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 31: [2023-04-29 17:23:28,683] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 5: [2023-04-29 17:23:28,683] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 5: [2023-04-29 17:23:28,684] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 4: [2023-04-29 17:23:28,684] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 5: [2023-04-29 17:23:28,685] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 2: [2023-04-29 17:23:28,685] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 31: [2023-04-29 17:23:28,685] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 5: [2023-04-29 17:23:28,685] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 31: [2023-04-29 17:23:28,685] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 31: [2023-04-29 17:23:28,685] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 4: [2023-04-29 17:23:28,686] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 31: [2023-04-29 17:23:28,686] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 31: [2023-04-29 17:23:28,686] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 5: [2023-04-29 17:23:28,686] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 4: [2023-04-29 17:23:28,686] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 5: [2023-04-29 17:23:28,686] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 4: [2023-04-29 17:23:28,686] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 4: [2023-04-29 17:23:28,687] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 4: [2023-04-29 17:23:28,688] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 26: [2023-04-29 17:23:28,688] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 6: [2023-04-29 17:23:28,690] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 6: [2023-04-29 17:23:28,690] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 2: [2023-04-29 17:23:28,690] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 26: [2023-04-29 17:23:28,691] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 26: [2023-04-29 17:23:28,691] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 26: [2023-04-29 17:23:28,691] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 26: [2023-04-29 17:23:28,691] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 13: [2023-04-29 17:23:28,691] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 17: [2023-04-29 17:23:28,692] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 2: [2023-04-29 17:23:28,692] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 17: [2023-04-29 17:23:28,694] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 11: [2023-04-29 17:23:28,695] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 11: [2023-04-29 17:23:28,695] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 13: [2023-04-29 17:23:28,696] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 2: [2023-04-29 17:23:28,696] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 17: [2023-04-29 17:23:28,696] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 26: [2023-04-29 17:23:28,696] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 11: [2023-04-29 17:23:28,697] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 2: [2023-04-29 17:23:28,697] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 11: [2023-04-29 17:23:28,697] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 11: [2023-04-29 17:23:28,698] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 2: [2023-04-29 17:23:28,698] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 11: [2023-04-29 17:23:28,698] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 11: [2023-04-29 17:23:28,698] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 11: [2023-04-29 17:23:28,698] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 2: [2023-04-29 17:23:28,698] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 17: [2023-04-29 17:23:28,699] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 17: [2023-04-29 17:23:28,699] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 17: [2023-04-29 17:23:28,699] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 17: [2023-04-29 17:23:28,699] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 17: [2023-04-29 17:23:28,700] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 2: [2023-04-29 17:23:28,700] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 27: [2023-04-29 17:23:28,699] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 24: [2023-04-29 17:23:28,700] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 11: [2023-04-29 17:23:28,700] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 11: [2023-04-29 17:23:28,700] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 8: [2023-04-29 17:23:28,701] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 8: [2023-04-29 17:23:28,701] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 24: [2023-04-29 17:23:28,701] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 24: [2023-04-29 17:23:28,701] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 24: [2023-04-29 17:23:28,701] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 24: [2023-04-29 17:23:28,701] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 24: [2023-04-29 17:23:28,701] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 24: [2023-04-29 17:23:28,701] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 20: [2023-04-29 17:23:28,701] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 20: [2023-04-29 17:23:28,701] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 11: [2023-04-29 17:23:28,701] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 20: [2023-04-29 17:23:28,702] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 20: [2023-04-29 17:23:28,702] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 8: [2023-04-29 17:23:28,702] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 8: [2023-04-29 17:23:28,702] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 8: [2023-04-29 17:23:28,702] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 20: [2023-04-29 17:23:28,702] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 20: [2023-04-29 17:23:28,702] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 8: [2023-04-29 17:23:28,702] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 8: [2023-04-29 17:23:28,702] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 20: [2023-04-29 17:23:28,702] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 8: [2023-04-29 17:23:28,702] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 20: [2023-04-29 17:23:28,702] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 11: [2023-04-29 17:23:28,706] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 11: [2023-04-29 17:23:28,707] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 11: [2023-04-29 17:23:28,707] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 20: [2023-04-29 17:23:28,707] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 8: [2023-04-29 17:23:28,706] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 8: [2023-04-29 17:23:28,707] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 6: [2023-04-29 17:23:28,708] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 6: [2023-04-29 17:23:28,708] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 20: [2023-04-29 17:23:28,708] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 11: [2023-04-29 17:23:28,708] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 11: [2023-04-29 17:23:28,708] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 20: [2023-04-29 17:23:28,709] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 20: [2023-04-29 17:23:28,709] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 26: [2023-04-29 17:23:28,709] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 20: [2023-04-29 17:23:28,710] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 26: [2023-04-29 17:23:28,710] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 8: [2023-04-29 17:23:28,710] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 20: [2023-04-29 17:23:28,710] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 6: [2023-04-29 17:23:28,711] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 6: [2023-04-29 17:23:28,711] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 20: [2023-04-29 17:23:28,712] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 6: [2023-04-29 17:23:28,712] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 20: [2023-04-29 17:23:28,712] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 8: [2023-04-29 17:23:28,712] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 8: [2023-04-29 17:23:28,712] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 8: [2023-04-29 17:23:28,713] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 13: [2023-04-29 17:23:28,713] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 8: [2023-04-29 17:23:28,713] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 8: [2023-04-29 17:23:28,714] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 26: [2023-04-29 17:23:28,714] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 13: [2023-04-29 17:23:28,715] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 2: [2023-04-29 17:23:28,717] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 26: [2023-04-29 17:23:28,717] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 26: [2023-04-29 17:23:28,717] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 27: [2023-04-29 17:23:28,718] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 26: [2023-04-29 17:23:28,718] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 2: [2023-04-29 17:23:28,719] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 17: [2023-04-29 17:23:28,719] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 13: [2023-04-29 17:23:28,719] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 26: [2023-04-29 17:23:28,721] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 27: [2023-04-29 17:23:28,723] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 5: [2023-04-29 17:23:28,725] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 5: [2023-04-29 17:23:28,725] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 2: [2023-04-29 17:23:28,725] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 13: [2023-04-29 17:23:28,726] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 13: [2023-04-29 17:23:28,726] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 13: [2023-04-29 17:23:28,726] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 2: [2023-04-29 17:23:28,728] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 6: [2023-04-29 17:23:28,728] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 6: [2023-04-29 17:23:28,728] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 6: [2023-04-29 17:23:28,728] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 4: [2023-04-29 17:23:28,728] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 4: [2023-04-29 17:23:28,728] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 13: [2023-04-29 17:23:28,729] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 13: [2023-04-29 17:23:28,729] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 17: [2023-04-29 17:23:28,732] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 17: [2023-04-29 17:23:28,733] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 17: [2023-04-29 17:23:28,733] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 17: [2023-04-29 17:23:28,735] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 6: [2023-04-29 17:23:28,736] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 27: [2023-04-29 17:23:28,736] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 27: [2023-04-29 17:23:28,736] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 17: [2023-04-29 17:23:28,736] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 31: [2023-04-29 17:23:28,736] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 31: [2023-04-29 17:23:28,736] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 31: [2023-04-29 17:23:28,736] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 6: [2023-04-29 17:23:28,737] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 13: [2023-04-29 17:23:28,739] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 10: [2023-04-29 17:23:28,739] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 10: [2023-04-29 17:23:28,739] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 10: [2023-04-29 17:23:28,739] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 10: [2023-04-29 17:23:28,739] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 10: [2023-04-29 17:23:28,739] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 10: [2023-04-29 17:23:28,739] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 10: [2023-04-29 17:23:28,739] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 10: [2023-04-29 17:23:28,740] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 6: [2023-04-29 17:23:28,740] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 25: [2023-04-29 17:23:28,740] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 25: [2023-04-29 17:23:28,740] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 25: [2023-04-29 17:23:28,741] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 25: [2023-04-29 17:23:28,741] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 25: [2023-04-29 17:23:28,741] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 25: [2023-04-29 17:23:28,741] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 25: [2023-04-29 17:23:28,741] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 25: [2023-04-29 17:23:28,741] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 10: [2023-04-29 17:23:28,743] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 24: [2023-04-29 17:23:28,701] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 24: [2023-04-29 17:23:28,704] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 24: [2023-04-29 17:23:28,712] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 24: [2023-04-29 17:23:28,712] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 24: [2023-04-29 17:23:28,713] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 27: [2023-04-29 17:23:28,743] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 24: [2023-04-29 17:23:28,714] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 24: [2023-04-29 17:23:28,714] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 24: [2023-04-29 17:23:28,715] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 24: [2023-04-29 17:23:28,716] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 4: [2023-04-29 17:23:28,744] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 23: [2023-04-29 17:23:28,744] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 23: [2023-04-29 17:23:28,744] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 23: [2023-04-29 17:23:28,744] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 23: [2023-04-29 17:23:28,744] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 10: [2023-04-29 17:23:28,744] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 23: [2023-04-29 17:23:28,745] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 23: [2023-04-29 17:23:28,745] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 23: [2023-04-29 17:23:28,745] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 10: [2023-04-29 17:23:28,745] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 5: [2023-04-29 17:23:28,745] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 25: [2023-04-29 17:23:28,744] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 25: [2023-04-29 17:23:28,745] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 10: [2023-04-29 17:23:28,745] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 23: [2023-04-29 17:23:28,745] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 5: [2023-04-29 17:23:28,745] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 10: [2023-04-29 17:23:28,747] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 10: [2023-04-29 17:23:28,747] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 27: [2023-04-29 17:23:28,747] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 27: [2023-04-29 17:23:28,747] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 27: [2023-04-29 17:23:28,747] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 10: [2023-04-29 17:23:28,748] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 27: [2023-04-29 17:23:28,748] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 10: [2023-04-29 17:23:28,748] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 23: [2023-04-29 17:23:28,749] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 23: [2023-04-29 17:23:28,750] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 14: [2023-04-29 17:23:28,750] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 4: [2023-04-29 17:23:28,751] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 25: [2023-04-29 17:23:28,751] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 25: [2023-04-29 17:23:28,751] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 14: [2023-04-29 17:23:28,751] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 31: [2023-04-29 17:23:28,751] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 31: [2023-04-29 17:23:28,751] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 31: [2023-04-29 17:23:28,751] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 31: [2023-04-29 17:23:28,751] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 31: [2023-04-29 17:23:28,751] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 25: [2023-04-29 17:23:28,752] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 14: [2023-04-29 17:23:28,752] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 14: [2023-04-29 17:23:28,752] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 14: [2023-04-29 17:23:28,752] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 14: [2023-04-29 17:23:28,752] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 14: [2023-04-29 17:23:28,752] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 25: [2023-04-29 17:23:28,752] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 14: [2023-04-29 17:23:28,752] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 19: [2023-04-29 17:23:28,752] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 19: [2023-04-29 17:23:28,752] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 25: [2023-04-29 17:23:28,753] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 4: [2023-04-29 17:23:28,753] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 11: [2023-04-29 17:23:28,753] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 11: [2023-04-29 17:23:28,753] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 11: [2023-04-29 17:23:28,753] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 25: [2023-04-29 17:23:28,753] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 19: [2023-04-29 17:23:28,754] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 19: [2023-04-29 17:23:28,754] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 19: [2023-04-29 17:23:28,754] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 19: [2023-04-29 17:23:28,754] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 19: [2023-04-29 17:23:28,754] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 23: [2023-04-29 17:23:28,754] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 23: [2023-04-29 17:23:28,754] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 19: [2023-04-29 17:23:28,754] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 23: [2023-04-29 17:23:28,755] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 14: [2023-04-29 17:23:28,755] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 14: [2023-04-29 17:23:28,755] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 5: [2023-04-29 17:23:28,755] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 5: [2023-04-29 17:23:28,755] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 5: [2023-04-29 17:23:28,755] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 5: [2023-04-29 17:23:28,755] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 23: [2023-04-29 17:23:28,756] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 6: [2023-04-29 17:23:28,755] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 23: [2023-04-29 17:23:28,756] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 23: [2023-04-29 17:23:28,756] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 5: [2023-04-29 17:23:28,757] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 5: [2023-04-29 17:23:28,757] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 6: [2023-04-29 17:23:28,757] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 6: [2023-04-29 17:23:28,757] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 7: [2023-04-29 17:23:28,758] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 7: [2023-04-29 17:23:28,758] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 7: [2023-04-29 17:23:28,758] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 31: [2023-04-29 17:23:28,758] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 7: [2023-04-29 17:23:28,758] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 7: [2023-04-29 17:23:28,758] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 7: [2023-04-29 17:23:28,758] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 7: [2023-04-29 17:23:28,758] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 7: [2023-04-29 17:23:28,758] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 31: [2023-04-29 17:23:28,759] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 19: [2023-04-29 17:23:28,759] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 13: [2023-04-29 17:23:28,759] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 19: [2023-04-29 17:23:28,760] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 19: [2023-04-29 17:23:28,760] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 13: [2023-04-29 17:23:28,760] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 19: [2023-04-29 17:23:28,760] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 4: [2023-04-29 17:23:28,760] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 19: [2023-04-29 17:23:28,761] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 13: [2023-04-29 17:23:28,761] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 13: [2023-04-29 17:23:28,761] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 14: [2023-04-29 17:23:28,761] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 19: [2023-04-29 17:23:28,761] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 14: [2023-04-29 17:23:28,762] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 14: [2023-04-29 17:23:28,762] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 20: [2023-04-29 17:23:28,762] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 20: [2023-04-29 17:23:28,762] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 14: [2023-04-29 17:23:28,763] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 19: [2023-04-29 17:23:28,763] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 8: [2023-04-29 17:23:28,762] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 8: [2023-04-29 17:23:28,762] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 4: [2023-04-29 17:23:28,763] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 4: [2023-04-29 17:23:28,763] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 4: [2023-04-29 17:23:28,763] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 4: [2023-04-29 17:23:28,763] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 19: [2023-04-29 17:23:28,763] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 7: [2023-04-29 17:23:28,763] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 7: [2023-04-29 17:23:28,763] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 7: [2023-04-29 17:23:28,763] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 14: [2023-04-29 17:23:28,763] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 7: [2023-04-29 17:23:28,764] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 14: [2023-04-29 17:23:28,764] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 13: [2023-04-29 17:23:28,764] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 20: [2023-04-29 17:23:28,764] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 20: [2023-04-29 17:23:28,764] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 27: [2023-04-29 17:23:28,764] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 7: [2023-04-29 17:23:28,765] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 7: [2023-04-29 17:23:28,765] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 7: [2023-04-29 17:23:28,765] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 11: [2023-04-29 17:23:28,765] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 31: [2023-04-29 17:23:28,765] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 27: [2023-04-29 17:23:28,766] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 7: [2023-04-29 17:23:28,766] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 8: [2023-04-29 17:23:28,766] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 4: [2023-04-29 17:23:28,768] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 9: [2023-04-29 17:23:28,767] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 9: [2023-04-29 17:23:28,768] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 9: [2023-04-29 17:23:28,768] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 9: [2023-04-29 17:23:28,768] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 9: [2023-04-29 17:23:28,768] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 9: [2023-04-29 17:23:28,768] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 9: [2023-04-29 17:23:28,768] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 9: [2023-04-29 17:23:28,769] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 11: [2023-04-29 17:23:28,770] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 11: [2023-04-29 17:23:28,770] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 1: [2023-04-29 17:23:28,774] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 9: [2023-04-29 17:23:28,773] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 27: [2023-04-29 17:23:28,773] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 9: [2023-04-29 17:23:28,774] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 1: [2023-04-29 17:23:28,774] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 11: [2023-04-29 17:23:28,774] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 9: [2023-04-29 17:23:28,774] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 1: [2023-04-29 17:23:28,774] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 9: [2023-04-29 17:23:28,774] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 1: [2023-04-29 17:23:28,774] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 9: [2023-04-29 17:23:28,774] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 1: [2023-04-29 17:23:28,774] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 1: [2023-04-29 17:23:28,774] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 1: [2023-04-29 17:23:28,774] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 9: [2023-04-29 17:23:28,774] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 9: [2023-04-29 17:23:28,774] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 9: [2023-04-29 17:23:28,775] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 12: [2023-04-29 17:23:28,775] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 12: [2023-04-29 17:23:28,775] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 11: [2023-04-29 17:23:28,775] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 11: [2023-04-29 17:23:28,775] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 12: [2023-04-29 17:23:28,775] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 8: [2023-04-29 17:23:28,775] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 12: [2023-04-29 17:23:28,776] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 12: [2023-04-29 17:23:28,776] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 12: [2023-04-29 17:23:28,776] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 12: [2023-04-29 17:23:28,776] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 8: [2023-04-29 17:23:28,776] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 12: [2023-04-29 17:23:28,776] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 18: [2023-04-29 17:23:28,776] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 18: [2023-04-29 17:23:28,776] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 18: [2023-04-29 17:23:28,776] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 8: [2023-04-29 17:23:28,777] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 11: [2023-04-29 17:23:28,777] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 18: [2023-04-29 17:23:28,777] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 18: [2023-04-29 17:23:28,777] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 18: [2023-04-29 17:23:28,777] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 18: [2023-04-29 17:23:28,777] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 8: [2023-04-29 17:23:28,777] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 8: [2023-04-29 17:23:28,777] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 29: [2023-04-29 17:23:28,777] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 29: [2023-04-29 17:23:28,777] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 27: [2023-04-29 17:23:28,777] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 18: [2023-04-29 17:23:28,777] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 31: [2023-04-29 17:23:28,777] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 31: [2023-04-29 17:23:28,778] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 20: [2023-04-29 17:23:28,779] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 20: [2023-04-29 17:23:28,779] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 27: [2023-04-29 17:23:28,780] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 20: [2023-04-29 17:23:28,780] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 27: [2023-04-29 17:23:28,780] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 12: [2023-04-29 17:23:28,780] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 20: [2023-04-29 17:23:28,781] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 12: [2023-04-29 17:23:28,782] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 29: [2023-04-29 17:23:28,782] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 29: [2023-04-29 17:23:28,782] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 12: [2023-04-29 17:23:28,783] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 12: [2023-04-29 17:23:28,783] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 31: [2023-04-29 17:23:28,784] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 31: [2023-04-29 17:23:28,784] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 31: [2023-04-29 17:23:28,784] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 12: [2023-04-29 17:23:28,784] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 12: [2023-04-29 17:23:28,784] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 12: [2023-04-29 17:23:28,784] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 0: [2023-04-29 17:23:28,785] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 0: [2023-04-29 17:23:28,785] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 0: [2023-04-29 17:23:28,785] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 0: [2023-04-29 17:23:28,785] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 0: [2023-04-29 17:23:28,785] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 0: [2023-04-29 17:23:28,785] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 11: [2023-04-29 17:23:28,785] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 0: [2023-04-29 17:23:28,785] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 18: [2023-04-29 17:23:28,785] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 0: [2023-04-29 17:23:28,785] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 12: [2023-04-29 17:23:28,785] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 29: [2023-04-29 17:23:28,785] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 29: [2023-04-29 17:23:28,785] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 29: [2023-04-29 17:23:28,785] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 29: [2023-04-29 17:23:28,785] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 29: [2023-04-29 17:23:28,785] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 29: [2023-04-29 17:23:28,785] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 8: [2023-04-29 17:23:28,785] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 8: [2023-04-29 17:23:28,785] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 24: [2023-04-29 17:23:28,754] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 24: [2023-04-29 17:23:28,775] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 24: [2023-04-29 17:23:28,783] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 24: [2023-04-29 17:23:28,783] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 20: [2023-04-29 17:23:28,788] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 18: [2023-04-29 17:23:28,788] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 18: [2023-04-29 17:23:28,789] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 20: [2023-04-29 17:23:28,789] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 18: [2023-04-29 17:23:28,790] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 5: [2023-04-29 17:23:28,790] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 18: [2023-04-29 17:23:28,790] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 20: [2023-04-29 17:23:28,790] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 20: [2023-04-29 17:23:28,790] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 18: [2023-04-29 17:23:28,790] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 18: [2023-04-29 17:23:28,791] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 29: [2023-04-29 17:23:28,791] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 0: [2023-04-29 17:23:28,793] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 18: [2023-04-29 17:23:28,793] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 11: [2023-04-29 17:23:28,793] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 24: [2023-04-29 17:23:28,794] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 24: [2023-04-29 17:23:28,794] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 24: [2023-04-29 17:23:28,794] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 5: [2023-04-29 17:23:28,794] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 8: [2023-04-29 17:23:28,794] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 4: [2023-04-29 17:23:28,795] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 11: [2023-04-29 17:23:28,795] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 5: [2023-04-29 17:23:28,795] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 5: [2023-04-29 17:23:28,795] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 29: [2023-04-29 17:23:28,795] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 29: [2023-04-29 17:23:28,796] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 25: [2023-04-29 17:23:28,796] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 29: [2023-04-29 17:23:28,796] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 29: [2023-04-29 17:23:28,797] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 5: [2023-04-29 17:23:28,797] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 29: [2023-04-29 17:23:28,797] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 4: [2023-04-29 17:23:28,797] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 4: [2023-04-29 17:23:28,798] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 5: [2023-04-29 17:23:28,798] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 0: [2023-04-29 17:23:28,799] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 0: [2023-04-29 17:23:28,799] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 11: [2023-04-29 17:23:28,799] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 25: [2023-04-29 17:23:28,799] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 0: [2023-04-29 17:23:28,799] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 3: [2023-04-29 17:23:28,799] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 3: [2023-04-29 17:23:28,799] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 4: [2023-04-29 17:23:28,801] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 4: [2023-04-29 17:23:28,801] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 0: [2023-04-29 17:23:28,801] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 0: [2023-04-29 17:23:28,801] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 0: [2023-04-29 17:23:28,801] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 10: [2023-04-29 17:23:28,801] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 10: [2023-04-29 17:23:28,801] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 10: [2023-04-29 17:23:28,801] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 10: [2023-04-29 17:23:28,801] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 3: [2023-04-29 17:23:28,802] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 3: [2023-04-29 17:23:28,802] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 3: [2023-04-29 17:23:28,802] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 3: [2023-04-29 17:23:28,802] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 3: [2023-04-29 17:23:28,802] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 0: [2023-04-29 17:23:28,803] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 3: [2023-04-29 17:23:28,803] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 3: [2023-04-29 17:23:28,804] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 3: [2023-04-29 17:23:28,804] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 21: [2023-04-29 17:23:28,804] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 21: [2023-04-29 17:23:28,804] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 23: [2023-04-29 17:23:28,804] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 21: [2023-04-29 17:23:28,804] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 21: [2023-04-29 17:23:28,804] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 21: [2023-04-29 17:23:28,804] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 15: [2023-04-29 17:23:28,804] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 15: [2023-04-29 17:23:28,804] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 15: [2023-04-29 17:23:28,804] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 15: [2023-04-29 17:23:28,804] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 15: [2023-04-29 17:23:28,804] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 15: [2023-04-29 17:23:28,804] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 15: [2023-04-29 17:23:28,804] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 21: [2023-04-29 17:23:28,804] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 21: [2023-04-29 17:23:28,804] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 15: [2023-04-29 17:23:28,805] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 21: [2023-04-29 17:23:28,805] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 23: [2023-04-29 17:23:28,805] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 24: [2023-04-29 17:23:28,804] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 24: [2023-04-29 17:23:28,806] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 14: [2023-04-29 17:23:28,806] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 14: [2023-04-29 17:23:28,806] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 11: [2023-04-29 17:23:28,806] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 20: [2023-04-29 17:23:28,807] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 10: [2023-04-29 17:23:28,808] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 10: [2023-04-29 17:23:28,808] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 10: [2023-04-29 17:23:28,808] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 10: [2023-04-29 17:23:28,808] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 21: [2023-04-29 17:23:28,808] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 20: [2023-04-29 17:23:28,808] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 20: [2023-04-29 17:23:28,809] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 21: [2023-04-29 17:23:28,810] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 11: [2023-04-29 17:23:28,810] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 21: [2023-04-29 17:23:28,810] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 21: [2023-04-29 17:23:28,810] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 21: [2023-04-29 17:23:28,810] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 20: [2023-04-29 17:23:28,810] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 24: [2023-04-29 17:23:28,811] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 24: [2023-04-29 17:23:28,811] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 21: [2023-04-29 17:23:28,811] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 25: [2023-04-29 17:23:28,811] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 21: [2023-04-29 17:23:28,811] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 21: [2023-04-29 17:23:28,812] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 3: [2023-04-29 17:23:28,812] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 3: [2023-04-29 17:23:28,812] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 3: [2023-04-29 17:23:28,812] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 3: [2023-04-29 17:23:28,813] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 3: [2023-04-29 17:23:28,813] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 8: [2023-04-29 17:23:28,813] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 8: [2023-04-29 17:23:28,813] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 8: [2023-04-29 17:23:28,813] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 8: [2023-04-29 17:23:28,814] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 8: [2023-04-29 17:23:28,814] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 3: [2023-04-29 17:23:28,814] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 1: [2023-04-29 17:23:28,774] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 1: [2023-04-29 17:23:28,779] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 1: [2023-04-29 17:23:28,780] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 1: [2023-04-29 17:23:28,780] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 1: [2023-04-29 17:23:28,780] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 1: [2023-04-29 17:23:28,780] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 1: [2023-04-29 17:23:28,781] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 1: [2023-04-29 17:23:28,781] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 1: [2023-04-29 17:23:28,781] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 19: [2023-04-29 17:23:28,815] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 19: [2023-04-29 17:23:28,815] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 15: [2023-04-29 17:23:28,815] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 19: [2023-04-29 17:23:28,816] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 16: [2023-04-29 17:23:28,816] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 16: [2023-04-29 17:23:28,816] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 16: [2023-04-29 17:23:28,816] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 16: [2023-04-29 17:23:28,816] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 16: [2023-04-29 17:23:28,816] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 16: [2023-04-29 17:23:28,816] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 16: [2023-04-29 17:23:28,816] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 16: [2023-04-29 17:23:28,817] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 23: [2023-04-29 17:23:28,817] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 15: [2023-04-29 17:23:28,817] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 15: [2023-04-29 17:23:28,817] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 28: [2023-04-29 17:23:28,817] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 28: [2023-04-29 17:23:28,818] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 28: [2023-04-29 17:23:28,818] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 15: [2023-04-29 17:23:28,818] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 28: [2023-04-29 17:23:28,818] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 28: [2023-04-29 17:23:28,818] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 28: [2023-04-29 17:23:28,818] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 28: [2023-04-29 17:23:28,818] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 25: [2023-04-29 17:23:28,818] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 28: [2023-04-29 17:23:28,818] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 15: [2023-04-29 17:23:28,819] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 15: [2023-04-29 17:23:28,819] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 25: [2023-04-29 17:23:28,819] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 15: [2023-04-29 17:23:28,819] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 7: [2023-04-29 17:23:28,819] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 7: [2023-04-29 17:23:28,819] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 15: [2023-04-29 17:23:28,819] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 24: [2023-04-29 17:23:28,821] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 7: [2023-04-29 17:23:28,821] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 16: [2023-04-29 17:23:28,821] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 16: [2023-04-29 17:23:28,822] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 16: [2023-04-29 17:23:28,822] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 16: [2023-04-29 17:23:28,823] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 16: [2023-04-29 17:23:28,823] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 16: [2023-04-29 17:23:28,823] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 16: [2023-04-29 17:23:28,824] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 16: [2023-04-29 17:23:28,824] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 7: [2023-04-29 17:23:28,824] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 14: [2023-04-29 17:23:28,825] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 14: [2023-04-29 17:23:28,825] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 12: [2023-04-29 17:23:28,826] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 25: [2023-04-29 17:23:28,826] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 25: [2023-04-29 17:23:28,826] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 25: [2023-04-29 17:23:28,826] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 25: [2023-04-29 17:23:28,827] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 23: [2023-04-29 17:23:28,827] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 25: [2023-04-29 17:23:28,828] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 24: [2023-04-29 17:23:28,828] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 24: [2023-04-29 17:23:28,828] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 19: [2023-04-29 17:23:28,828] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 19: [2023-04-29 17:23:28,828] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 19: [2023-04-29 17:23:28,828] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 19: [2023-04-29 17:23:28,828] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 23: [2023-04-29 17:23:28,828] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 23: [2023-04-29 17:23:28,828] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 23: [2023-04-29 17:23:28,829] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 19: [2023-04-29 17:23:28,829] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 29: [2023-04-29 17:23:28,830] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 28: [2023-04-29 17:23:28,830] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 28: [2023-04-29 17:23:28,830] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 28: [2023-04-29 17:23:28,831] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 29: [2023-04-29 17:23:28,832] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 28: [2023-04-29 17:23:28,832] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 28: [2023-04-29 17:23:28,832] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 10: [2023-04-29 17:23:28,832] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 10: [2023-04-29 17:23:28,832] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 28: [2023-04-29 17:23:28,833] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 23: [2023-04-29 17:23:28,833] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 23: [2023-04-29 17:23:28,833] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 28: [2023-04-29 17:23:28,833] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 28: [2023-04-29 17:23:28,834] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 14: [2023-04-29 17:23:28,834] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 9: [2023-04-29 17:23:28,834] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 9: [2023-04-29 17:23:28,834] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 9: [2023-04-29 17:23:28,834] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 9: [2023-04-29 17:23:28,834] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 25: [2023-04-29 17:23:28,834] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 9: [2023-04-29 17:23:28,835] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 9: [2023-04-29 17:23:28,835] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 9: [2023-04-29 17:23:28,835] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 9: [2023-04-29 17:23:28,835] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 23: [2023-04-29 17:23:28,835] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 24: [2023-04-29 17:23:28,835] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 10: [2023-04-29 17:23:28,835] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 10: [2023-04-29 17:23:28,835] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 7: [2023-04-29 17:23:28,836] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 7: [2023-04-29 17:23:28,836] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 7: [2023-04-29 17:23:28,836] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 7: [2023-04-29 17:23:28,836] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 19: [2023-04-29 17:23:28,836] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 24: [2023-04-29 17:23:28,836] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 14: [2023-04-29 17:23:28,837] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 14: [2023-04-29 17:23:28,837] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 14: [2023-04-29 17:23:28,837] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 14: [2023-04-29 17:23:28,837] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 14: [2023-04-29 17:23:28,837] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 19: [2023-04-29 17:23:28,841] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 10: [2023-04-29 17:23:28,841] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 7: [2023-04-29 17:23:28,842] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 10: [2023-04-29 17:23:28,842] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 10: [2023-04-29 17:23:28,842] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 10: [2023-04-29 17:23:28,842] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 12: [2023-04-29 17:23:28,842] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 23: [2023-04-29 17:23:28,842] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 7: [2023-04-29 17:23:28,844] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 7: [2023-04-29 17:23:28,844] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 19: [2023-04-29 17:23:28,844] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 12: [2023-04-29 17:23:28,845] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 12: [2023-04-29 17:23:28,848] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 30: [2023-04-29 17:23:28,849] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 30: [2023-04-29 17:23:28,850] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 30: [2023-04-29 17:23:28,850] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 30: [2023-04-29 17:23:28,850] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 30: [2023-04-29 17:23:28,850] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 30: [2023-04-29 17:23:28,850] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 30: [2023-04-29 17:23:28,850] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 30: [2023-04-29 17:23:28,850] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 29: [2023-04-29 17:23:28,851] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 12: [2023-04-29 17:23:28,851] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 29: [2023-04-29 17:23:28,852] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 12: [2023-04-29 17:23:28,852] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 12: [2023-04-29 17:23:28,852] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 12: [2023-04-29 17:23:28,852] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 12: [2023-04-29 17:23:28,852] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 7: [2023-04-29 17:23:28,853] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 29: [2023-04-29 17:23:28,854] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 21: [2023-04-29 17:23:28,855] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 3: [2023-04-29 17:23:28,855] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 3: [2023-04-29 17:23:28,855] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 23: [2023-04-29 17:23:28,855] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 23: [2023-04-29 17:23:28,857] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 25: [2023-04-29 17:23:28,857] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 25: [2023-04-29 17:23:28,858] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 25: [2023-04-29 17:23:28,858] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 1: [2023-04-29 17:23:28,829] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 9: [2023-04-29 17:23:28,859] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 1: [2023-04-29 17:23:28,843] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 1: [2023-04-29 17:23:28,843] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 1: [2023-04-29 17:23:28,843] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 1: [2023-04-29 17:23:28,843] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 1: [2023-04-29 17:23:28,848] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 1: [2023-04-29 17:23:28,848] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 1: [2023-04-29 17:23:28,848] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 1: [2023-04-29 17:23:28,850] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 25: [2023-04-29 17:23:28,860] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 9: [2023-04-29 17:23:28,860] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 9: [2023-04-29 17:23:28,860] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 14: [2023-04-29 17:23:28,860] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 0: [2023-04-29 17:23:28,860] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 9: [2023-04-29 17:23:28,861] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 25: [2023-04-29 17:23:28,861] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 9: [2023-04-29 17:23:28,861] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 30: [2023-04-29 17:23:28,861] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 30: [2023-04-29 17:23:28,861] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 30: [2023-04-29 17:23:28,862] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 30: [2023-04-29 17:23:28,862] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 9: [2023-04-29 17:23:28,862] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 30: [2023-04-29 17:23:28,862] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 19: [2023-04-29 17:23:28,862] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 30: [2023-04-29 17:23:28,862] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 30: [2023-04-29 17:23:28,863] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 9: [2023-04-29 17:23:28,864] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 19: [2023-04-29 17:23:28,864] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 30: [2023-04-29 17:23:28,864] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt... 9: [2023-04-29 17:23:28,864] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 19: [2023-04-29 17:23:28,865] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 18: [2023-04-29 17:23:28,865] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 18: [2023-04-29 17:23:28,865] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 7: [2023-04-29 17:23:28,865] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 7: [2023-04-29 17:23:28,865] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 7: [2023-04-29 17:23:28,865] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 7: [2023-04-29 17:23:28,865] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 18: [2023-04-29 17:23:28,866] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 23: [2023-04-29 17:23:28,867] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 1: [2023-04-29 17:23:28,867] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 1: [2023-04-29 17:23:28,867] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 23: [2023-04-29 17:23:28,868] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 21: [2023-04-29 17:23:28,868] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 23: [2023-04-29 17:23:28,868] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 2: [2023-04-29 17:23:28,869] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 2: [2023-04-29 17:23:28,869] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 19: [2023-04-29 17:23:28,869] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 18: [2023-04-29 17:23:28,869] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 18: [2023-04-29 17:23:28,869] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 1: [2023-04-29 17:23:28,870] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 2: [2023-04-29 17:23:28,870] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 1: [2023-04-29 17:23:28,870] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 19: [2023-04-29 17:23:28,870] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 12: [2023-04-29 17:23:28,870] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 2: [2023-04-29 17:23:28,871] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 2: [2023-04-29 17:23:28,871] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 2: [2023-04-29 17:23:28,871] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 2: [2023-04-29 17:23:28,871] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 14: [2023-04-29 17:23:28,871] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 2: [2023-04-29 17:23:28,871] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 12: [2023-04-29 17:23:28,871] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 14: [2023-04-29 17:23:28,872] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 14: [2023-04-29 17:23:28,872] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 14: [2023-04-29 17:23:28,872] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 29: [2023-04-29 17:23:28,873] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 21: [2023-04-29 17:23:28,874] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 1: [2023-04-29 17:23:28,874] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 21: [2023-04-29 17:23:28,874] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 2: [2023-04-29 17:23:28,874] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 2: [2023-04-29 17:23:28,874] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 2: [2023-04-29 17:23:28,874] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 1: [2023-04-29 17:23:28,874] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 1: [2023-04-29 17:23:28,875] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 14: [2023-04-29 17:23:28,875] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 21: [2023-04-29 17:23:28,876] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 3: [2023-04-29 17:23:28,876] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 16: [2023-04-29 17:23:28,876] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 16: [2023-04-29 17:23:28,876] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 3: [2023-04-29 17:23:28,877] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 29: [2023-04-29 17:23:28,877] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 29: [2023-04-29 17:23:28,877] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 29: [2023-04-29 17:23:28,877] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 29: [2023-04-29 17:23:28,878] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 2: [2023-04-29 17:23:28,878] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 2: [2023-04-29 17:23:28,879] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 21: [2023-04-29 17:23:28,879] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 21: [2023-04-29 17:23:28,879] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 21: [2023-04-29 17:23:28,879] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 21: [2023-04-29 17:23:28,879] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 3: [2023-04-29 17:23:28,879] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 2: [2023-04-29 17:23:28,880] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 29: [2023-04-29 17:23:28,880] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 0: [2023-04-29 17:23:28,880] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 2: [2023-04-29 17:23:28,880] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 2: [2023-04-29 17:23:28,881] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 16: [2023-04-29 17:23:28,881] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 12: [2023-04-29 17:23:28,884] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 12: [2023-04-29 17:23:28,885] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 12: [2023-04-29 17:23:28,885] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 12: [2023-04-29 17:23:28,885] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 3: [2023-04-29 17:23:28,885] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 3: [2023-04-29 17:23:28,885] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 3: [2023-04-29 17:23:28,885] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 3: [2023-04-29 17:23:28,885] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 17: [2023-04-29 17:23:28,885] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 17: [2023-04-29 17:23:28,885] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 17: [2023-04-29 17:23:28,885] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 17: [2023-04-29 17:23:28,885] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 12: [2023-04-29 17:23:28,886] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 17: [2023-04-29 17:23:28,886] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 0: [2023-04-29 17:23:28,886] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 17: [2023-04-29 17:23:28,886] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 17: [2023-04-29 17:23:28,886] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 17: [2023-04-29 17:23:28,886] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 0: [2023-04-29 17:23:28,887] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 0: [2023-04-29 17:23:28,887] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 15: [2023-04-29 17:23:28,891] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 3: [2023-04-29 17:23:28,891] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 16: [2023-04-29 17:23:28,891] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 16: [2023-04-29 17:23:28,891] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 17: [2023-04-29 17:23:28,891] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 16: [2023-04-29 17:23:28,891] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 16: [2023-04-29 17:23:28,891] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 16: [2023-04-29 17:23:28,891] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 17: [2023-04-29 17:23:28,892] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 17: [2023-04-29 17:23:28,892] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 17: [2023-04-29 17:23:28,895] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 17: [2023-04-29 17:23:28,895] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 21: [2023-04-29 17:23:28,895] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 17: [2023-04-29 17:23:28,896] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 17: [2023-04-29 17:23:28,898] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 15: [2023-04-29 17:23:28,898] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 17: [2023-04-29 17:23:28,898] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 21: [2023-04-29 17:23:28,898] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 16: [2023-04-29 17:23:28,900] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 18: [2023-04-29 17:23:28,900] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 21: [2023-04-29 17:23:28,901] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 18: [2023-04-29 17:23:28,901] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 18: [2023-04-29 17:23:28,901] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 18: [2023-04-29 17:23:28,901] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 18: [2023-04-29 17:23:28,901] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 18: [2023-04-29 17:23:28,901] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 16: [2023-04-29 17:23:28,902] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 15: [2023-04-29 17:23:28,902] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 15: [2023-04-29 17:23:28,902] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 15: [2023-04-29 17:23:28,902] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 13: [2023-04-29 17:23:28,902] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 15: [2023-04-29 17:23:28,902] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 13: [2023-04-29 17:23:28,902] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 13: [2023-04-29 17:23:28,902] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 13: [2023-04-29 17:23:28,902] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 13: [2023-04-29 17:23:28,902] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 29: [2023-04-29 17:23:28,902] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 13: [2023-04-29 17:23:28,903] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 13: [2023-04-29 17:23:28,903] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 13: [2023-04-29 17:23:28,903] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 0: [2023-04-29 17:23:28,903] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 0: [2023-04-29 17:23:28,904] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 0: [2023-04-29 17:23:28,904] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 18: [2023-04-29 17:23:28,904] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 3: [2023-04-29 17:23:28,904] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 18: [2023-04-29 17:23:28,905] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 29: [2023-04-29 17:23:28,906] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 21: [2023-04-29 17:23:28,906] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 21: [2023-04-29 17:23:28,907] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 13: [2023-04-29 17:23:28,906] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 29: [2023-04-29 17:23:28,907] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 28: [2023-04-29 17:23:28,907] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 13: [2023-04-29 17:23:28,908] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 21: [2023-04-29 17:23:28,908] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 15: [2023-04-29 17:23:28,908] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 15: [2023-04-29 17:23:28,908] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 21: [2023-04-29 17:23:28,908] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 0: [2023-04-29 17:23:28,909] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 28: [2023-04-29 17:23:28,909] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 28: [2023-04-29 17:23:28,909] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 29: [2023-04-29 17:23:28,909] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 29: [2023-04-29 17:23:28,910] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 16: [2023-04-29 17:23:28,910] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 0: [2023-04-29 17:23:28,911] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 13: [2023-04-29 17:23:28,911] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 28: [2023-04-29 17:23:28,912] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 13: [2023-04-29 17:23:28,912] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 13: [2023-04-29 17:23:28,913] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 13: [2023-04-29 17:23:28,913] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 13: [2023-04-29 17:23:28,914] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 15: [2023-04-29 17:23:28,914] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 13: [2023-04-29 17:23:28,915] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 3: [2023-04-29 17:23:28,916] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 0: [2023-04-29 17:23:28,916] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 3: [2023-04-29 17:23:28,917] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 0: [2023-04-29 17:23:28,917] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 3: [2023-04-29 17:23:28,917] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 3: [2023-04-29 17:23:28,919] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 16: [2023-04-29 17:23:28,919] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 16: [2023-04-29 17:23:28,920] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 16: [2023-04-29 17:23:28,921] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 3: [2023-04-29 17:23:28,922] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 2: [2023-04-29 17:23:28,922] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 16: [2023-04-29 17:23:28,924] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 16: [2023-04-29 17:23:28,924] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 15: [2023-04-29 17:23:28,930] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 18: [2023-04-29 17:23:28,930] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 18: [2023-04-29 17:23:28,930] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 18: [2023-04-29 17:23:28,931] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 2: [2023-04-29 17:23:28,933] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 2: [2023-04-29 17:23:28,933] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 15: [2023-04-29 17:23:28,933] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 30: [2023-04-29 17:23:28,934] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 2: [2023-04-29 17:23:28,935] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 28: [2023-04-29 17:23:28,935] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 28: [2023-04-29 17:23:28,936] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 28: [2023-04-29 17:23:28,936] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 28: [2023-04-29 17:23:28,936] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 28: [2023-04-29 17:23:28,936] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 15: [2023-04-29 17:23:28,938] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 28: [2023-04-29 17:23:28,939] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 15: [2023-04-29 17:23:28,939] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 0: [2023-04-29 17:23:28,939] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 28: [2023-04-29 17:23:28,939] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 15: [2023-04-29 17:23:28,941] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 0: [2023-04-29 17:23:28,942] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 0: [2023-04-29 17:23:28,942] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 0: [2023-04-29 17:23:28,942] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 2: [2023-04-29 17:23:28,942] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 2: [2023-04-29 17:23:28,944] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 28: [2023-04-29 17:23:28,944] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 15: [2023-04-29 17:23:28,944] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 17: [2023-04-29 17:23:28,946] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 15: [2023-04-29 17:23:28,946] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 17: [2023-04-29 17:23:28,947] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 17: [2023-04-29 17:23:28,949] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 2: [2023-04-29 17:23:28,952] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 30: [2023-04-29 17:23:28,953] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 30: [2023-04-29 17:23:28,953] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 30: [2023-04-29 17:23:28,953] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 30: [2023-04-29 17:23:28,953] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 30: [2023-04-29 17:23:28,953] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 30: [2023-04-29 17:23:28,953] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 30: [2023-04-29 17:23:28,953] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_28-model_00-model_states.pt. 2: [2023-04-29 17:23:28,955] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 2: [2023-04-29 17:23:28,955] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 2: [2023-04-29 17:23:28,957] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 2: [2023-04-29 17:23:28,957] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 30: [2023-04-29 17:23:28,958] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 4: [2023-04-29 17:23:28,961] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 4: [2023-04-29 17:23:28,961] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 4: [2023-04-29 17:23:28,961] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 4: [2023-04-29 17:23:28,961] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 4: [2023-04-29 17:23:28,961] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 13: [2023-04-29 17:23:28,960] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 4: [2023-04-29 17:23:28,961] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 4: [2023-04-29 17:23:28,961] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 2: [2023-04-29 17:23:28,961] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 4: [2023-04-29 17:23:28,961] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 17: [2023-04-29 17:23:28,962] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 13: [2023-04-29 17:23:28,963] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 4: [2023-04-29 17:23:28,965] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 4: [2023-04-29 17:23:28,965] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 28: [2023-04-29 17:23:28,965] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 28: [2023-04-29 17:23:28,966] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 17: [2023-04-29 17:23:28,968] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 4: [2023-04-29 17:23:28,969] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 28: [2023-04-29 17:23:28,969] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 2: [2023-04-29 17:23:28,970] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 28: [2023-04-29 17:23:28,970] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 4: [2023-04-29 17:23:28,971] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 4: [2023-04-29 17:23:28,971] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 4: [2023-04-29 17:23:28,971] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 17: [2023-04-29 17:23:28,972] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 4: [2023-04-29 17:23:28,973] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 4: [2023-04-29 17:23:28,973] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 26: [2023-04-29 17:23:28,974] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 26: [2023-04-29 17:23:28,974] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 26: [2023-04-29 17:23:28,974] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 26: [2023-04-29 17:23:28,974] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 22: [2023-04-29 17:23:28,974] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 22: [2023-04-29 17:23:28,974] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 22: [2023-04-29 17:23:28,974] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 22: [2023-04-29 17:23:28,974] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 26: [2023-04-29 17:23:28,974] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 26: [2023-04-29 17:23:28,974] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 22: [2023-04-29 17:23:28,974] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 26: [2023-04-29 17:23:28,974] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 22: [2023-04-29 17:23:28,975] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 22: [2023-04-29 17:23:28,975] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 22: [2023-04-29 17:23:28,975] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 26: [2023-04-29 17:23:28,975] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 13: [2023-04-29 17:23:28,975] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 17: [2023-04-29 17:23:28,977] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 17: [2023-04-29 17:23:28,978] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 17: [2023-04-29 17:23:28,978] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 26: [2023-04-29 17:23:28,978] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 22: [2023-04-29 17:23:28,979] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 22: [2023-04-29 17:23:28,979] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 17: [2023-04-29 17:23:28,980] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 13: [2023-04-29 17:23:28,981] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 26: [2023-04-29 17:23:28,980] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 26: [2023-04-29 17:23:28,981] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 26: [2023-04-29 17:23:28,981] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 17: [2023-04-29 17:23:28,982] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 26: [2023-04-29 17:23:28,982] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 26: [2023-04-29 17:23:28,982] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 2: [2023-04-29 17:23:28,982] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 26: [2023-04-29 17:23:28,983] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 26: [2023-04-29 17:23:28,983] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 22: [2023-04-29 17:23:28,984] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 22: [2023-04-29 17:23:28,984] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 2: [2023-04-29 17:23:28,984] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 13: [2023-04-29 17:23:28,984] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 22: [2023-04-29 17:23:28,985] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 5: [2023-04-29 17:23:28,985] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 5: [2023-04-29 17:23:28,985] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 22: [2023-04-29 17:23:28,985] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 2: [2023-04-29 17:23:28,985] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 22: [2023-04-29 17:23:28,986] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 22: [2023-04-29 17:23:28,986] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 13: [2023-04-29 17:23:28,988] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 13: [2023-04-29 17:23:28,988] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 13: [2023-04-29 17:23:28,988] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 5: [2023-04-29 17:23:28,988] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 5: [2023-04-29 17:23:28,988] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 5: [2023-04-29 17:23:28,988] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 5: [2023-04-29 17:23:28,988] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 5: [2023-04-29 17:23:28,988] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 5: [2023-04-29 17:23:28,988] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 13: [2023-04-29 17:23:28,989] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 13: [2023-04-29 17:23:28,989] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 17: [2023-04-29 17:23:28,989] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 5: [2023-04-29 17:23:28,989] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 5: [2023-04-29 17:23:28,990] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 30: [2023-04-29 17:23:28,990] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 30: [2023-04-29 17:23:28,991] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 30: [2023-04-29 17:23:28,991] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 30: [2023-04-29 17:23:28,995] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 30: [2023-04-29 17:23:28,995] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 30: [2023-04-29 17:23:28,997] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 30: [2023-04-29 17:23:28,997] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 5: [2023-04-29 17:23:28,997] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 5: [2023-04-29 17:23:28,998] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 5: [2023-04-29 17:23:28,998] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 13: [2023-04-29 17:23:28,999] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 5: [2023-04-29 17:23:28,999] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 5: [2023-04-29 17:23:29,000] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 5: [2023-04-29 17:23:29,000] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 17: [2023-04-29 17:23:29,010] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 17: [2023-04-29 17:23:29,011] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 17: [2023-04-29 17:23:29,013] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 17: [2023-04-29 17:23:29,013] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 13: [2023-04-29 17:23:29,017] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 4: [2023-04-29 17:23:29,018] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 4: [2023-04-29 17:23:29,020] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 14: [2023-04-29 17:23:29,021] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 13: [2023-04-29 17:23:29,021] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 31: [2023-04-29 17:23:29,021] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 31: [2023-04-29 17:23:29,021] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 31: [2023-04-29 17:23:29,021] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 14: [2023-04-29 17:23:29,021] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 31: [2023-04-29 17:23:29,021] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 31: [2023-04-29 17:23:29,021] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 31: [2023-04-29 17:23:29,022] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 31: [2023-04-29 17:23:29,022] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 14: [2023-04-29 17:23:29,022] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 14: [2023-04-29 17:23:29,022] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 14: [2023-04-29 17:23:29,022] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 13: [2023-04-29 17:23:29,022] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 31: [2023-04-29 17:23:29,022] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 11: [2023-04-29 17:23:29,022] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 11: [2023-04-29 17:23:29,022] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 14: [2023-04-29 17:23:29,022] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 14: [2023-04-29 17:23:29,022] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 14: [2023-04-29 17:23:29,022] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 13: [2023-04-29 17:23:29,022] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 11: [2023-04-29 17:23:29,022] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 11: [2023-04-29 17:23:29,023] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 11: [2023-04-29 17:23:29,023] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 11: [2023-04-29 17:23:29,023] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 11: [2023-04-29 17:23:29,023] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 13: [2023-04-29 17:23:29,023] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 11: [2023-04-29 17:23:29,024] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 14: [2023-04-29 17:23:29,024] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 11: [2023-04-29 17:23:29,025] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 31: [2023-04-29 17:23:29,025] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 14: [2023-04-29 17:23:29,025] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 31: [2023-04-29 17:23:29,026] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 31: [2023-04-29 17:23:29,026] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 11: [2023-04-29 17:23:29,026] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 31: [2023-04-29 17:23:29,027] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 11: [2023-04-29 17:23:29,027] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 31: [2023-04-29 17:23:29,028] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 26: [2023-04-29 17:23:29,027] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 14: [2023-04-29 17:23:29,028] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 31: [2023-04-29 17:23:29,028] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 31: [2023-04-29 17:23:29,028] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 31: [2023-04-29 17:23:29,029] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 14: [2023-04-29 17:23:29,029] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 11: [2023-04-29 17:23:29,030] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 11: [2023-04-29 17:23:29,031] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 14: [2023-04-29 17:23:29,031] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 22: [2023-04-29 17:23:29,031] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 22: [2023-04-29 17:23:29,031] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 26: [2023-04-29 17:23:29,032] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 14: [2023-04-29 17:23:29,032] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 14: [2023-04-29 17:23:29,033] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 11: [2023-04-29 17:23:29,033] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 14: [2023-04-29 17:23:29,033] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 11: [2023-04-29 17:23:29,033] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 11: [2023-04-29 17:23:29,034] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 4: [2023-04-29 17:23:29,034] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 4: [2023-04-29 17:23:29,035] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 5: [2023-04-29 17:23:29,041] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 5: [2023-04-29 17:23:29,041] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 26: [2023-04-29 17:23:29,042] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 4: [2023-04-29 17:23:29,043] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 26: [2023-04-29 17:23:29,044] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 4: [2023-04-29 17:23:29,044] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 12: [2023-04-29 17:23:29,046] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 12: [2023-04-29 17:23:29,046] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 12: [2023-04-29 17:23:29,046] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 12: [2023-04-29 17:23:29,047] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 12: [2023-04-29 17:23:29,047] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 12: [2023-04-29 17:23:29,047] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 12: [2023-04-29 17:23:29,047] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 12: [2023-04-29 17:23:29,047] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 26: [2023-04-29 17:23:29,049] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 26: [2023-04-29 17:23:29,049] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 26: [2023-04-29 17:23:29,049] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 26: [2023-04-29 17:23:29,049] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 4: [2023-04-29 17:23:29,049] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 23: [2023-04-29 17:23:29,050] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 23: [2023-04-29 17:23:29,050] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 12: [2023-04-29 17:23:29,051] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 26: [2023-04-29 17:23:29,052] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 22: [2023-04-29 17:23:29,052] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 22: [2023-04-29 17:23:29,052] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 22: [2023-04-29 17:23:29,052] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 22: [2023-04-29 17:23:29,052] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 23: [2023-04-29 17:23:29,052] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 23: [2023-04-29 17:23:29,053] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 22: [2023-04-29 17:23:29,053] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 23: [2023-04-29 17:23:29,053] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 12: [2023-04-29 17:23:29,053] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 23: [2023-04-29 17:23:29,053] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 23: [2023-04-29 17:23:29,053] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 23: [2023-04-29 17:23:29,053] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 12: [2023-04-29 17:23:29,054] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 4: [2023-04-29 17:23:29,054] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 4: [2023-04-29 17:23:29,054] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 4: [2023-04-29 17:23:29,054] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 12: [2023-04-29 17:23:29,054] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 12: [2023-04-29 17:23:29,055] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 12: [2023-04-29 17:23:29,055] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 12: [2023-04-29 17:23:29,055] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 12: [2023-04-29 17:23:29,056] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 26: [2023-04-29 17:23:29,057] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 22: [2023-04-29 17:23:29,057] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 22: [2023-04-29 17:23:29,057] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 22: [2023-04-29 17:23:29,057] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 25: [2023-04-29 17:23:29,058] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 25: [2023-04-29 17:23:29,058] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 23: [2023-04-29 17:23:29,058] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 23: [2023-04-29 17:23:29,059] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 23: [2023-04-29 17:23:29,059] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 23: [2023-04-29 17:23:29,061] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 4: [2023-04-29 17:23:29,061] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 5: [2023-04-29 17:23:29,061] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 5: [2023-04-29 17:23:29,062] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 25: [2023-04-29 17:23:29,062] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 25: [2023-04-29 17:23:29,062] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 25: [2023-04-29 17:23:29,062] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 25: [2023-04-29 17:23:29,062] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 25: [2023-04-29 17:23:29,062] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 25: [2023-04-29 17:23:29,062] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 25: [2023-04-29 17:23:29,062] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 23: [2023-04-29 17:23:29,063] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 25: [2023-04-29 17:23:29,063] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 5: [2023-04-29 17:23:29,063] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 23: [2023-04-29 17:23:29,064] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 23: [2023-04-29 17:23:29,064] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 23: [2023-04-29 17:23:29,065] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 4: [2023-04-29 17:23:29,066] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 6: [2023-04-29 17:23:29,067] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 6: [2023-04-29 17:23:29,067] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 6: [2023-04-29 17:23:29,067] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 6: [2023-04-29 17:23:29,068] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 6: [2023-04-29 17:23:29,068] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 6: [2023-04-29 17:23:29,068] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 6: [2023-04-29 17:23:29,068] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 6: [2023-04-29 17:23:29,068] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 27: [2023-04-29 17:23:29,068] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 27: [2023-04-29 17:23:29,069] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 27: [2023-04-29 17:23:29,069] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 27: [2023-04-29 17:23:29,069] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 27: [2023-04-29 17:23:29,069] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 27: [2023-04-29 17:23:29,069] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 27: [2023-04-29 17:23:29,069] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 27: [2023-04-29 17:23:29,070] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 6: [2023-04-29 17:23:29,072] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 5: [2023-04-29 17:23:29,071] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 5: [2023-04-29 17:23:29,071] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 5: [2023-04-29 17:23:29,071] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 27: [2023-04-29 17:23:29,071] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 31: [2023-04-29 17:23:29,071] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 6: [2023-04-29 17:23:29,072] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 26: [2023-04-29 17:23:29,072] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 11: [2023-04-29 17:23:29,072] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 25: [2023-04-29 17:23:29,073] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 25: [2023-04-29 17:23:29,073] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 5: [2023-04-29 17:23:29,073] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 25: [2023-04-29 17:23:29,073] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 25: [2023-04-29 17:23:29,075] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 4: [2023-04-29 17:23:29,075] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 25: [2023-04-29 17:23:29,075] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 25: [2023-04-29 17:23:29,075] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 6: [2023-04-29 17:23:29,076] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 22: [2023-04-29 17:23:29,077] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 5: [2023-04-29 17:23:29,077] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 6: [2023-04-29 17:23:29,077] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 29: [2023-04-29 17:23:29,077] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 6: [2023-04-29 17:23:29,078] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 29: [2023-04-29 17:23:29,078] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 6: [2023-04-29 17:23:29,078] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 27: [2023-04-29 17:23:29,078] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 6: [2023-04-29 17:23:29,078] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 14: [2023-04-29 17:23:29,078] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 26: [2023-04-29 17:23:29,080] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 6: [2023-04-29 17:23:29,080] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 22: [2023-04-29 17:23:29,081] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 22: [2023-04-29 17:23:29,081] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 29: [2023-04-29 17:23:29,081] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 29: [2023-04-29 17:23:29,081] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 27: [2023-04-29 17:23:29,081] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 27: [2023-04-29 17:23:29,081] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 29: [2023-04-29 17:23:29,081] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 29: [2023-04-29 17:23:29,081] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 29: [2023-04-29 17:23:29,081] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 27: [2023-04-29 17:23:29,081] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 14: [2023-04-29 17:23:29,081] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 29: [2023-04-29 17:23:29,081] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 27: [2023-04-29 17:23:29,082] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 31: [2023-04-29 17:23:29,082] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 31: [2023-04-29 17:23:29,082] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 29: [2023-04-29 17:23:29,082] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 29: [2023-04-29 17:23:29,082] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 26: [2023-04-29 17:23:29,083] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 26: [2023-04-29 17:23:29,083] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 26: [2023-04-29 17:23:29,083] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 27: [2023-04-29 17:23:29,083] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 27: [2023-04-29 17:23:29,083] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 24: [2023-04-29 17:23:29,084] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 26: [2023-04-29 17:23:29,085] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 11: [2023-04-29 17:23:29,084] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 4: [2023-04-29 17:23:29,085] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 4: [2023-04-29 17:23:29,085] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 24: [2023-04-29 17:23:29,085] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 24: [2023-04-29 17:23:29,085] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 24: [2023-04-29 17:23:29,085] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 24: [2023-04-29 17:23:29,085] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 24: [2023-04-29 17:23:29,085] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 24: [2023-04-29 17:23:29,085] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 11: [2023-04-29 17:23:29,085] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 11: [2023-04-29 17:23:29,085] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 19: [2023-04-29 17:23:29,085] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 19: [2023-04-29 17:23:29,085] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 24: [2023-04-29 17:23:29,085] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 31: [2023-04-29 17:23:29,087] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 19: [2023-04-29 17:23:29,087] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 4: [2023-04-29 17:23:29,087] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 19: [2023-04-29 17:23:29,087] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 19: [2023-04-29 17:23:29,087] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 19: [2023-04-29 17:23:29,087] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 19: [2023-04-29 17:23:29,087] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 24: [2023-04-29 17:23:29,088] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 19: [2023-04-29 17:23:29,088] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 5: [2023-04-29 17:23:29,089] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 22: [2023-04-29 17:23:29,089] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 22: [2023-04-29 17:23:29,089] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 19: [2023-04-29 17:23:29,089] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 14: [2023-04-29 17:23:29,090] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 14: [2023-04-29 17:23:29,091] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 19: [2023-04-29 17:23:29,091] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 22: [2023-04-29 17:23:29,091] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 31: [2023-04-29 17:23:29,092] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 11: [2023-04-29 17:23:29,092] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 19: [2023-04-29 17:23:29,092] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 24: [2023-04-29 17:23:29,093] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 24: [2023-04-29 17:23:29,093] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 29: [2023-04-29 17:23:29,090] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 29: [2023-04-29 17:23:29,090] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 29: [2023-04-29 17:23:29,092] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 29: [2023-04-29 17:23:29,092] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 29: [2023-04-29 17:23:29,094] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 29: [2023-04-29 17:23:29,094] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 19: [2023-04-29 17:23:29,095] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 19: [2023-04-29 17:23:29,096] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 19: [2023-04-29 17:23:29,096] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 19: [2023-04-29 17:23:29,097] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 24: [2023-04-29 17:23:29,096] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 24: [2023-04-29 17:23:29,097] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 14: [2023-04-29 17:23:29,097] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 24: [2023-04-29 17:23:29,097] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 19: [2023-04-29 17:23:29,098] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 24: [2023-04-29 17:23:29,098] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 11: [2023-04-29 17:23:29,098] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 24: [2023-04-29 17:23:29,098] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 10: [2023-04-29 17:23:29,098] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 10: [2023-04-29 17:23:29,098] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 10: [2023-04-29 17:23:29,099] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 10: [2023-04-29 17:23:29,099] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 31: [2023-04-29 17:23:29,099] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 31: [2023-04-29 17:23:29,099] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 31: [2023-04-29 17:23:29,099] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 31: [2023-04-29 17:23:29,099] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 10: [2023-04-29 17:23:29,099] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 10: [2023-04-29 17:23:29,099] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 10: [2023-04-29 17:23:29,099] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 10: [2023-04-29 17:23:29,099] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 14: [2023-04-29 17:23:29,100] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 12: [2023-04-29 17:23:29,100] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 8: [2023-04-29 17:23:29,101] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 8: [2023-04-29 17:23:29,101] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 8: [2023-04-29 17:23:29,101] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 8: [2023-04-29 17:23:29,101] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 8: [2023-04-29 17:23:29,101] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 8: [2023-04-29 17:23:29,102] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 8: [2023-04-29 17:23:29,102] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 5: [2023-04-29 17:23:29,102] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 8: [2023-04-29 17:23:29,102] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 10: [2023-04-29 17:23:29,104] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 10: [2023-04-29 17:23:29,104] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 11: [2023-04-29 17:23:29,104] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 10: [2023-04-29 17:23:29,104] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 10: [2023-04-29 17:23:29,105] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 31: [2023-04-29 17:23:29,106] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 31: [2023-04-29 17:23:29,106] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 3: [2023-04-29 17:23:29,106] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 3: [2023-04-29 17:23:29,106] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 3: [2023-04-29 17:23:29,106] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 5: [2023-04-29 17:23:29,106] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 25: [2023-04-29 17:23:29,106] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 10: [2023-04-29 17:23:29,106] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 3: [2023-04-29 17:23:29,106] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 3: [2023-04-29 17:23:29,106] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 3: [2023-04-29 17:23:29,106] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 3: [2023-04-29 17:23:29,107] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 5: [2023-04-29 17:23:29,107] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 3: [2023-04-29 17:23:29,107] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 11: [2023-04-29 17:23:29,107] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 11: [2023-04-29 17:23:29,107] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 8: [2023-04-29 17:23:29,107] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 10: [2023-04-29 17:23:29,107] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 10: [2023-04-29 17:23:29,108] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 10: [2023-04-29 17:23:29,108] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 8: [2023-04-29 17:23:29,109] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 8: [2023-04-29 17:23:29,109] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 8: [2023-04-29 17:23:29,110] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 8: [2023-04-29 17:23:29,110] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 31: [2023-04-29 17:23:29,110] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 12: [2023-04-29 17:23:29,110] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 3: [2023-04-29 17:23:29,110] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 3: [2023-04-29 17:23:29,111] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 8: [2023-04-29 17:23:29,111] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 5: [2023-04-29 17:23:29,112] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 8: [2023-04-29 17:23:29,112] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 8: [2023-04-29 17:23:29,112] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 12: [2023-04-29 17:23:29,113] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 7: [2023-04-29 17:23:29,115] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 5: [2023-04-29 17:23:29,115] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 11: [2023-04-29 17:23:29,115] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 7: [2023-04-29 17:23:29,115] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 7: [2023-04-29 17:23:29,115] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 7: [2023-04-29 17:23:29,115] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 7: [2023-04-29 17:23:29,115] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 7: [2023-04-29 17:23:29,115] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 7: [2023-04-29 17:23:29,115] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 23: [2023-04-29 17:23:29,115] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 23: [2023-04-29 17:23:29,115] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 14: [2023-04-29 17:23:29,115] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 7: [2023-04-29 17:23:29,115] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 14: [2023-04-29 17:23:29,116] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 3: [2023-04-29 17:23:29,116] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 3: [2023-04-29 17:23:29,116] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 25: [2023-04-29 17:23:29,116] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 3: [2023-04-29 17:23:29,117] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 3: [2023-04-29 17:23:29,117] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 3: [2023-04-29 17:23:29,117] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 11: [2023-04-29 17:23:29,117] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 11: [2023-04-29 17:23:29,117] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 14: [2023-04-29 17:23:29,117] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 14: [2023-04-29 17:23:29,117] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 14: [2023-04-29 17:23:29,117] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 14: [2023-04-29 17:23:29,117] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 3: [2023-04-29 17:23:29,118] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 7: [2023-04-29 17:23:29,119] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 7: [2023-04-29 17:23:29,119] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 7: [2023-04-29 17:23:29,120] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 27: [2023-04-29 17:23:29,120] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 12: [2023-04-29 17:23:29,120] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 7: [2023-04-29 17:23:29,121] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 12: [2023-04-29 17:23:29,121] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 7: [2023-04-29 17:23:29,122] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 7: [2023-04-29 17:23:29,122] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 12: [2023-04-29 17:23:29,122] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 7: [2023-04-29 17:23:29,123] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 7: [2023-04-29 17:23:29,123] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 11: [2023-04-29 17:23:29,124] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 6: [2023-04-29 17:23:29,124] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 6: [2023-04-29 17:23:29,124] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 31: [2023-04-29 17:23:29,124] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 31: [2023-04-29 17:23:29,126] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 12: [2023-04-29 17:23:29,126] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 12: [2023-04-29 17:23:29,126] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 12: [2023-04-29 17:23:29,126] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 25: [2023-04-29 17:23:29,126] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 31: [2023-04-29 17:23:29,127] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 31: [2023-04-29 17:23:29,129] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 0: [2023-04-29 17:23:29,129] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 0: [2023-04-29 17:23:29,129] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 0: [2023-04-29 17:23:29,129] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 0: [2023-04-29 17:23:29,129] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 0: [2023-04-29 17:23:29,129] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 0: [2023-04-29 17:23:29,129] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 0: [2023-04-29 17:23:29,129] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 0: [2023-04-29 17:23:29,129] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 23: [2023-04-29 17:23:29,132] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 23: [2023-04-29 17:23:29,132] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 23: [2023-04-29 17:23:29,133] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 12: [2023-04-29 17:23:29,134] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 11: [2023-04-29 17:23:29,134] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 29: [2023-04-29 17:23:29,134] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 29: [2023-04-29 17:23:29,134] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 11: [2023-04-29 17:23:29,135] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 11: [2023-04-29 17:23:29,136] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 23: [2023-04-29 17:23:29,136] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 19: [2023-04-29 17:23:29,136] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 25: [2023-04-29 17:23:29,138] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 27: [2023-04-29 17:23:29,138] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 23: [2023-04-29 17:23:29,138] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 23: [2023-04-29 17:23:29,138] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 0: [2023-04-29 17:23:29,138] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 24: [2023-04-29 17:23:29,138] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 12: [2023-04-29 17:23:29,139] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 23: [2023-04-29 17:23:29,139] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 23: [2023-04-29 17:23:29,141] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 0: [2023-04-29 17:23:29,141] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 0: [2023-04-29 17:23:29,142] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 0: [2023-04-29 17:23:29,142] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 6: [2023-04-29 17:23:29,142] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 0: [2023-04-29 17:23:29,143] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 0: [2023-04-29 17:23:29,143] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 27: [2023-04-29 17:23:29,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 14: [2023-04-29 17:23:29,143] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 0: [2023-04-29 17:23:29,144] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 18: [2023-04-29 17:23:29,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 18: [2023-04-29 17:23:29,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 18: [2023-04-29 17:23:29,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 18: [2023-04-29 17:23:29,144] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 18: [2023-04-29 17:23:29,144] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 18: [2023-04-29 17:23:29,144] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 18: [2023-04-29 17:23:29,144] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 14: [2023-04-29 17:23:29,144] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 18: [2023-04-29 17:23:29,144] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 6: [2023-04-29 17:23:29,145] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 6: [2023-04-29 17:23:29,145] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 0: [2023-04-29 17:23:29,145] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 25: [2023-04-29 17:23:29,146] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 25: [2023-04-29 17:23:29,146] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 25: [2023-04-29 17:23:29,146] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 25: [2023-04-29 17:23:29,146] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 25: [2023-04-29 17:23:29,146] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 25: [2023-04-29 17:23:29,146] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 14: [2023-04-29 17:23:29,148] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 14: [2023-04-29 17:23:29,148] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 6: [2023-04-29 17:23:29,148] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 12: [2023-04-29 17:23:29,150] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 12: [2023-04-29 17:23:29,150] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 19: [2023-04-29 17:23:29,152] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 19: [2023-04-29 17:23:29,152] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 12: [2023-04-29 17:23:29,153] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 27: [2023-04-29 17:23:29,153] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 29: [2023-04-29 17:23:29,154] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 15: [2023-04-29 17:23:29,153] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 15: [2023-04-29 17:23:29,153] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 15: [2023-04-29 17:23:29,153] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 15: [2023-04-29 17:23:29,153] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 15: [2023-04-29 17:23:29,153] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 15: [2023-04-29 17:23:29,153] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 15: [2023-04-29 17:23:29,153] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 15: [2023-04-29 17:23:29,154] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 29: [2023-04-29 17:23:29,154] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 20: [2023-04-29 17:23:29,154] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 20: [2023-04-29 17:23:29,154] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 20: [2023-04-29 17:23:29,154] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 20: [2023-04-29 17:23:29,155] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 20: [2023-04-29 17:23:29,155] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 9: [2023-04-29 17:23:29,155] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 9: [2023-04-29 17:23:29,155] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 9: [2023-04-29 17:23:29,155] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 20: [2023-04-29 17:23:29,155] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 20: [2023-04-29 17:23:29,155] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 9: [2023-04-29 17:23:29,155] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 9: [2023-04-29 17:23:29,155] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 9: [2023-04-29 17:23:29,155] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 9: [2023-04-29 17:23:29,155] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 20: [2023-04-29 17:23:29,155] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 9: [2023-04-29 17:23:29,155] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 6: [2023-04-29 17:23:29,155] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 6: [2023-04-29 17:23:29,155] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 6: [2023-04-29 17:23:29,155] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 6: [2023-04-29 17:23:29,155] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 12: [2023-04-29 17:23:29,156] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 12: [2023-04-29 17:23:29,156] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 29: [2023-04-29 17:23:29,156] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 29: [2023-04-29 17:23:29,156] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 18: [2023-04-29 17:23:29,157] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 18: [2023-04-29 17:23:29,157] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 18: [2023-04-29 17:23:29,157] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 18: [2023-04-29 17:23:29,158] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 24: [2023-04-29 17:23:29,158] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 18: [2023-04-29 17:23:29,159] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 18: [2023-04-29 17:23:29,159] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 9: [2023-04-29 17:23:29,159] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 24: [2023-04-29 17:23:29,159] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 19: [2023-04-29 17:23:29,160] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 18: [2023-04-29 17:23:29,160] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 9: [2023-04-29 17:23:29,160] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 9: [2023-04-29 17:23:29,160] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 18: [2023-04-29 17:23:29,160] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 27: [2023-04-29 17:23:29,160] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 9: [2023-04-29 17:23:29,161] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 27: [2023-04-29 17:23:29,161] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 20: [2023-04-29 17:23:29,160] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 20: [2023-04-29 17:23:29,161] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 9: [2023-04-29 17:23:29,161] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 9: [2023-04-29 17:23:29,161] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 9: [2023-04-29 17:23:29,161] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 8: [2023-04-29 17:23:29,160] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 9: [2023-04-29 17:23:29,161] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 20: [2023-04-29 17:23:29,162] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 20: [2023-04-29 17:23:29,162] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 3: [2023-04-29 17:23:29,162] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 3: [2023-04-29 17:23:29,162] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 15: [2023-04-29 17:23:29,163] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 10: [2023-04-29 17:23:29,162] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 10: [2023-04-29 17:23:29,162] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 10: [2023-04-29 17:23:29,162] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 10: [2023-04-29 17:23:29,162] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 20: [2023-04-29 17:23:29,163] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 29: [2023-04-29 17:23:29,163] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 29: [2023-04-29 17:23:29,164] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 20: [2023-04-29 17:23:29,164] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 23: [2023-04-29 17:23:29,164] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 20: [2023-04-29 17:23:29,164] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 23: [2023-04-29 17:23:29,164] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 20: [2023-04-29 17:23:29,165] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 8: [2023-04-29 17:23:29,165] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 8: [2023-04-29 17:23:29,165] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 19: [2023-04-29 17:23:29,165] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 19: [2023-04-29 17:23:29,165] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 19: [2023-04-29 17:23:29,165] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 8: [2023-04-29 17:23:29,166] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 19: [2023-04-29 17:23:29,166] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 19: [2023-04-29 17:23:29,167] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 15: [2023-04-29 17:23:29,167] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 15: [2023-04-29 17:23:29,167] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 7: [2023-04-29 17:23:29,167] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 15: [2023-04-29 17:23:29,168] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 27: [2023-04-29 17:23:29,168] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 23: [2023-04-29 17:23:29,168] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 15: [2023-04-29 17:23:29,168] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 10: [2023-04-29 17:23:29,168] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 10: [2023-04-29 17:23:29,168] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 10: [2023-04-29 17:23:29,168] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 10: [2023-04-29 17:23:29,168] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 23: [2023-04-29 17:23:29,168] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 15: [2023-04-29 17:23:29,169] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 15: [2023-04-29 17:23:29,170] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 6: [2023-04-29 17:23:29,170] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 15: [2023-04-29 17:23:29,170] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 23: [2023-04-29 17:23:29,170] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 27: [2023-04-29 17:23:29,171] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 27: [2023-04-29 17:23:29,171] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 7: [2023-04-29 17:23:29,173] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 7: [2023-04-29 17:23:29,173] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 23: [2023-04-29 17:23:29,174] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 27: [2023-04-29 17:23:29,174] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 24: [2023-04-29 17:23:29,175] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 19: [2023-04-29 17:23:29,175] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 19: [2023-04-29 17:23:29,176] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 6: [2023-04-29 17:23:29,179] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 25: [2023-04-29 17:23:29,178] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 25: [2023-04-29 17:23:29,179] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 24: [2023-04-29 17:23:29,180] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 24: [2023-04-29 17:23:29,180] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 24: [2023-04-29 17:23:29,180] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 8: [2023-04-29 17:23:29,180] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 8: [2023-04-29 17:23:29,180] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 8: [2023-04-29 17:23:29,180] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 8: [2023-04-29 17:23:29,180] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 25: [2023-04-29 17:23:29,181] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 24: [2023-04-29 17:23:29,181] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 25: [2023-04-29 17:23:29,181] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 29: [2023-04-29 17:23:29,181] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 27: [2023-04-29 17:23:29,181] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 24: [2023-04-29 17:23:29,182] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 25: [2023-04-29 17:23:29,182] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 3: [2023-04-29 17:23:29,182] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 25: [2023-04-29 17:23:29,183] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 3: [2023-04-29 17:23:29,183] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 6: [2023-04-29 17:23:29,184] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 24: [2023-04-29 17:23:29,184] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 3: [2023-04-29 17:23:29,184] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 6: [2023-04-29 17:23:29,184] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 29: [2023-04-29 17:23:29,184] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 8: [2023-04-29 17:23:29,185] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 29: [2023-04-29 17:23:29,186] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 7: [2023-04-29 17:23:29,186] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 6: [2023-04-29 17:23:29,187] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 6: [2023-04-29 17:23:29,188] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 3: [2023-04-29 17:23:29,188] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 3: [2023-04-29 17:23:29,188] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 3: [2023-04-29 17:23:29,188] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 3: [2023-04-29 17:23:29,188] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 7: [2023-04-29 17:23:29,188] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 3: [2023-04-29 17:23:29,188] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 29: [2023-04-29 17:23:29,188] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 10: [2023-04-29 17:23:29,189] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 8: [2023-04-29 17:23:29,190] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 8: [2023-04-29 17:23:29,190] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 10: [2023-04-29 17:23:29,191] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 10: [2023-04-29 17:23:29,191] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 10: [2023-04-29 17:23:29,191] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 27: [2023-04-29 17:23:29,192] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 27: [2023-04-29 17:23:29,192] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 29: [2023-04-29 17:23:29,194] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 29: [2023-04-29 17:23:29,194] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 7: [2023-04-29 17:23:29,194] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 7: [2023-04-29 17:23:29,194] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 7: [2023-04-29 17:23:29,194] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 7: [2023-04-29 17:23:29,195] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 8: [2023-04-29 17:23:29,195] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 7: [2023-04-29 17:23:29,195] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 19: [2023-04-29 17:23:29,196] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 10: [2023-04-29 17:23:29,196] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 7: [2023-04-29 17:23:29,196] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 19: [2023-04-29 17:23:29,198] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 19: [2023-04-29 17:23:29,198] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 19: [2023-04-29 17:23:29,198] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 10: [2023-04-29 17:23:29,199] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 19: [2023-04-29 17:23:29,199] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 10: [2023-04-29 17:23:29,199] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 10: [2023-04-29 17:23:29,199] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 28: [2023-04-29 17:23:29,199] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 28: [2023-04-29 17:23:29,199] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 28: [2023-04-29 17:23:29,199] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 28: [2023-04-29 17:23:29,199] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 28: [2023-04-29 17:23:29,199] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 28: [2023-04-29 17:23:29,199] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 28: [2023-04-29 17:23:29,199] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 28: [2023-04-29 17:23:29,200] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 27: [2023-04-29 17:23:29,201] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 27: [2023-04-29 17:23:29,202] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 27: [2023-04-29 17:23:29,206] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 0: [2023-04-29 17:23:29,206] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 28: [2023-04-29 17:23:29,207] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 28: [2023-04-29 17:23:29,207] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 8: [2023-04-29 17:23:29,208] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 3: [2023-04-29 17:23:29,208] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 8: [2023-04-29 17:23:29,208] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 7: [2023-04-29 17:23:29,210] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 9: [2023-04-29 17:23:29,210] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 24: [2023-04-29 17:23:29,211] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 8: [2023-04-29 17:23:29,211] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 24: [2023-04-29 17:23:29,211] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 24: [2023-04-29 17:23:29,211] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 8: [2023-04-29 17:23:29,211] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 29: [2023-04-29 17:23:29,212] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 24: [2023-04-29 17:23:29,212] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 29: [2023-04-29 17:23:29,213] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 28: [2023-04-29 17:23:29,213] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 28: [2023-04-29 17:23:29,213] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 28: [2023-04-29 17:23:29,213] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 28: [2023-04-29 17:23:29,213] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 28: [2023-04-29 17:23:29,214] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 9: [2023-04-29 17:23:29,214] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 20: [2023-04-29 17:23:29,214] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 24: [2023-04-29 17:23:29,215] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 20: [2023-04-29 17:23:29,214] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 20: [2023-04-29 17:23:29,214] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 1: [2023-04-29 17:23:29,215] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 1: [2023-04-29 17:23:29,215] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 1: [2023-04-29 17:23:29,215] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 1: [2023-04-29 17:23:29,215] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 1: [2023-04-29 17:23:29,215] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 1: [2023-04-29 17:23:29,215] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 1: [2023-04-29 17:23:29,215] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 1: [2023-04-29 17:23:29,215] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 20: [2023-04-29 17:23:29,215] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 28: [2023-04-29 17:23:29,215] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 3: [2023-04-29 17:23:29,216] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 30: [2023-04-29 17:23:29,216] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 30: [2023-04-29 17:23:29,217] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 30: [2023-04-29 17:23:29,217] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 30: [2023-04-29 17:23:29,217] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 30: [2023-04-29 17:23:29,217] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 30: [2023-04-29 17:23:29,217] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 30: [2023-04-29 17:23:29,217] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 30: [2023-04-29 17:23:29,218] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 1: [2023-04-29 17:23:29,219] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 1: [2023-04-29 17:23:29,219] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 24: [2023-04-29 17:23:29,220] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 1: [2023-04-29 17:23:29,221] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 1: [2023-04-29 17:23:29,221] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 3: [2023-04-29 17:23:29,222] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 1: [2023-04-29 17:23:29,223] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 1: [2023-04-29 17:23:29,223] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 1: [2023-04-29 17:23:29,223] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 1: [2023-04-29 17:23:29,223] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 9: [2023-04-29 17:23:29,224] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 9: [2023-04-29 17:23:29,224] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 7: [2023-04-29 17:23:29,224] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 7: [2023-04-29 17:23:29,224] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 7: [2023-04-29 17:23:29,226] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 9: [2023-04-29 17:23:29,226] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 3: [2023-04-29 17:23:29,227] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 3: [2023-04-29 17:23:29,227] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 7: [2023-04-29 17:23:29,227] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 9: [2023-04-29 17:23:29,227] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 9: [2023-04-29 17:23:29,227] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 9: [2023-04-29 17:23:29,227] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 0: [2023-04-29 17:23:29,228] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 30: [2023-04-29 17:23:29,229] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 30: [2023-04-29 17:23:29,229] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 30: [2023-04-29 17:23:29,229] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 3: [2023-04-29 17:23:29,229] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 30: [2023-04-29 17:23:29,230] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 30: [2023-04-29 17:23:29,230] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 30: [2023-04-29 17:23:29,230] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 30: [2023-04-29 17:23:29,231] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 20: [2023-04-29 17:23:29,231] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 30: [2023-04-29 17:23:29,232] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt... 20: [2023-04-29 17:23:29,232] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 20: [2023-04-29 17:23:29,232] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 20: [2023-04-29 17:23:29,232] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 0: [2023-04-29 17:23:29,233] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 9: [2023-04-29 17:23:29,233] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 0: [2023-04-29 17:23:29,234] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 18: [2023-04-29 17:23:29,235] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 18: [2023-04-29 17:23:29,235] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 18: [2023-04-29 17:23:29,235] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 0: [2023-04-29 17:23:29,237] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 0: [2023-04-29 17:23:29,237] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 0: [2023-04-29 17:23:29,237] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 9: [2023-04-29 17:23:29,238] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 20: [2023-04-29 17:23:29,238] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 20: [2023-04-29 17:23:29,240] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 20: [2023-04-29 17:23:29,240] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 20: [2023-04-29 17:23:29,242] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 0: [2023-04-29 17:23:29,243] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 0: [2023-04-29 17:23:29,243] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 15: [2023-04-29 17:23:29,245] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 15: [2023-04-29 17:23:29,245] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 15: [2023-04-29 17:23:29,248] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 18: [2023-04-29 17:23:29,248] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 18: [2023-04-29 17:23:29,248] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 18: [2023-04-29 17:23:29,248] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 18: [2023-04-29 17:23:29,248] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 18: [2023-04-29 17:23:29,248] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 9: [2023-04-29 17:23:29,249] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 15: [2023-04-29 17:23:29,251] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 15: [2023-04-29 17:23:29,251] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 15: [2023-04-29 17:23:29,252] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 15: [2023-04-29 17:23:29,252] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 9: [2023-04-29 17:23:29,253] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 9: [2023-04-29 17:23:29,253] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 9: [2023-04-29 17:23:29,255] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 9: [2023-04-29 17:23:29,255] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 9: [2023-04-29 17:23:29,256] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 20: [2023-04-29 17:23:29,260] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 0: [2023-04-29 17:23:29,261] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 0: [2023-04-29 17:23:29,261] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 20: [2023-04-29 17:23:29,261] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 20: [2023-04-29 17:23:29,261] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 20: [2023-04-29 17:23:29,261] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 15: [2023-04-29 17:23:29,262] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 18: [2023-04-29 17:23:29,263] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 18: [2023-04-29 17:23:29,265] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 18: [2023-04-29 17:23:29,267] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 0: [2023-04-29 17:23:29,271] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 1: [2023-04-29 17:23:29,271] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 2: [2023-04-29 17:23:29,271] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 2: [2023-04-29 17:23:29,271] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 15: [2023-04-29 17:23:29,272] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 2: [2023-04-29 17:23:29,272] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 2: [2023-04-29 17:23:29,273] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 2: [2023-04-29 17:23:29,273] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 2: [2023-04-29 17:23:29,273] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 2: [2023-04-29 17:23:29,273] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 2: [2023-04-29 17:23:29,274] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 13: [2023-04-29 17:23:29,273] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 13: [2023-04-29 17:23:29,273] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 13: [2023-04-29 17:23:29,273] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 13: [2023-04-29 17:23:29,273] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 13: [2023-04-29 17:23:29,273] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 13: [2023-04-29 17:23:29,274] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 13: [2023-04-29 17:23:29,274] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 13: [2023-04-29 17:23:29,274] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 1: [2023-04-29 17:23:29,274] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 2: [2023-04-29 17:23:29,275] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 0: [2023-04-29 17:23:29,275] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 28: [2023-04-29 17:23:29,275] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 28: [2023-04-29 17:23:29,275] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 15: [2023-04-29 17:23:29,276] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 2: [2023-04-29 17:23:29,277] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 2: [2023-04-29 17:23:29,277] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 0: [2023-04-29 17:23:29,278] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 13: [2023-04-29 17:23:29,278] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 0: [2023-04-29 17:23:29,278] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 13: [2023-04-29 17:23:29,278] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 2: [2023-04-29 17:23:29,280] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 18: [2023-04-29 17:23:29,281] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 0: [2023-04-29 17:23:29,281] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 18: [2023-04-29 17:23:29,283] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 1: [2023-04-29 17:23:29,283] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 13: [2023-04-29 17:23:29,282] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 18: [2023-04-29 17:23:29,283] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 2: [2023-04-29 17:23:29,283] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 2: [2023-04-29 17:23:29,283] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 2: [2023-04-29 17:23:29,284] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 13: [2023-04-29 17:23:29,284] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 15: [2023-04-29 17:23:29,284] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 13: [2023-04-29 17:23:29,284] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 1: [2023-04-29 17:23:29,284] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 1: [2023-04-29 17:23:29,284] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 1: [2023-04-29 17:23:29,284] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 13: [2023-04-29 17:23:29,284] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 2: [2023-04-29 17:23:29,284] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 13: [2023-04-29 17:23:29,285] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 13: [2023-04-29 17:23:29,285] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 18: [2023-04-29 17:23:29,286] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 18: [2023-04-29 17:23:29,286] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 1: [2023-04-29 17:23:29,286] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 15: [2023-04-29 17:23:29,288] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 15: [2023-04-29 17:23:29,288] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 1: [2023-04-29 17:23:29,290] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 15: [2023-04-29 17:23:29,293] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 15: [2023-04-29 17:23:29,293] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 1: [2023-04-29 17:23:29,295] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 15: [2023-04-29 17:23:29,296] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 28: [2023-04-29 17:23:29,296] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 1: [2023-04-29 17:23:29,300] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 30: [2023-04-29 17:23:29,302] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 28: [2023-04-29 17:23:29,302] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 28: [2023-04-29 17:23:29,302] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 17: [2023-04-29 17:23:29,305] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 17: [2023-04-29 17:23:29,305] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 17: [2023-04-29 17:23:29,307] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 17: [2023-04-29 17:23:29,307] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 17: [2023-04-29 17:23:29,308] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 17: [2023-04-29 17:23:29,308] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 17: [2023-04-29 17:23:29,308] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 17: [2023-04-29 17:23:29,308] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 28: [2023-04-29 17:23:29,308] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 28: [2023-04-29 17:23:29,308] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 28: [2023-04-29 17:23:29,308] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 28: [2023-04-29 17:23:29,308] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 28: [2023-04-29 17:23:29,308] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 17: [2023-04-29 17:23:29,310] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 1: [2023-04-29 17:23:29,310] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 17: [2023-04-29 17:23:29,313] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 1: [2023-04-29 17:23:29,313] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 1: [2023-04-29 17:23:29,313] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 1: [2023-04-29 17:23:29,313] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 17: [2023-04-29 17:23:29,315] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 1: [2023-04-29 17:23:29,316] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 17: [2023-04-29 17:23:29,316] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 1: [2023-04-29 17:23:29,316] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 17: [2023-04-29 17:23:29,316] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 17: [2023-04-29 17:23:29,317] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 17: [2023-04-29 17:23:29,317] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 17: [2023-04-29 17:23:29,318] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 30: [2023-04-29 17:23:29,321] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 30: [2023-04-29 17:23:29,321] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 30: [2023-04-29 17:23:29,321] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 30: [2023-04-29 17:23:29,321] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 30: [2023-04-29 17:23:29,321] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 30: [2023-04-29 17:23:29,321] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 30: [2023-04-29 17:23:29,321] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_29-model_00-model_states.pt. 2: [2023-04-29 17:23:29,322] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 13: [2023-04-29 17:23:29,323] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 28: [2023-04-29 17:23:29,325] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 13: [2023-04-29 17:23:29,325] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 30: [2023-04-29 17:23:29,329] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 2: [2023-04-29 17:23:29,337] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 2: [2023-04-29 17:23:29,337] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 28: [2023-04-29 17:23:29,341] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 28: [2023-04-29 17:23:29,341] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 21: [2023-04-29 17:23:29,344] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 21: [2023-04-29 17:23:29,344] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 21: [2023-04-29 17:23:29,344] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 21: [2023-04-29 17:23:29,344] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 21: [2023-04-29 17:23:29,344] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 21: [2023-04-29 17:23:29,344] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 21: [2023-04-29 17:23:29,344] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 2: [2023-04-29 17:23:29,344] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 21: [2023-04-29 17:23:29,344] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 28: [2023-04-29 17:23:29,344] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 28: [2023-04-29 17:23:29,344] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 13: [2023-04-29 17:23:29,346] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 2: [2023-04-29 17:23:29,347] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 13: [2023-04-29 17:23:29,348] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 21: [2023-04-29 17:23:29,349] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 21: [2023-04-29 17:23:29,349] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 5: [2023-04-29 17:23:29,349] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 5: [2023-04-29 17:23:29,349] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 21: [2023-04-29 17:23:29,349] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 2: [2023-04-29 17:23:29,349] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 2: [2023-04-29 17:23:29,349] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 21: [2023-04-29 17:23:29,349] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 21: [2023-04-29 17:23:29,350] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 28: [2023-04-29 17:23:29,350] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 5: [2023-04-29 17:23:29,350] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 5: [2023-04-29 17:23:29,350] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 5: [2023-04-29 17:23:29,350] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 5: [2023-04-29 17:23:29,350] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 21: [2023-04-29 17:23:29,350] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 5: [2023-04-29 17:23:29,350] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 13: [2023-04-29 17:23:29,350] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 21: [2023-04-29 17:23:29,351] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 5: [2023-04-29 17:23:29,351] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 21: [2023-04-29 17:23:29,351] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 2: [2023-04-29 17:23:29,352] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 2: [2023-04-29 17:23:29,352] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 5: [2023-04-29 17:23:29,353] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 5: [2023-04-29 17:23:29,354] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 30: [2023-04-29 17:23:29,356] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 13: [2023-04-29 17:23:29,357] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 13: [2023-04-29 17:23:29,358] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 13: [2023-04-29 17:23:29,358] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 30: [2023-04-29 17:23:29,359] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 13: [2023-04-29 17:23:29,359] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 13: [2023-04-29 17:23:29,359] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 30: [2023-04-29 17:23:29,359] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 30: [2023-04-29 17:23:29,359] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 2: [2023-04-29 17:23:29,359] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 30: [2023-04-29 17:23:29,360] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 5: [2023-04-29 17:23:29,359] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 2: [2023-04-29 17:23:29,360] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 5: [2023-04-29 17:23:29,361] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 30: [2023-04-29 17:23:29,361] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 5: [2023-04-29 17:23:29,361] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 5: [2023-04-29 17:23:29,361] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 5: [2023-04-29 17:23:29,362] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 30: [2023-04-29 17:23:29,362] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 5: [2023-04-29 17:23:29,362] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 17: [2023-04-29 17:23:29,366] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 17: [2023-04-29 17:23:29,366] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 14: [2023-04-29 17:23:29,366] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 14: [2023-04-29 17:23:29,367] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 14: [2023-04-29 17:23:29,367] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 14: [2023-04-29 17:23:29,367] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 14: [2023-04-29 17:23:29,367] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 14: [2023-04-29 17:23:29,367] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 14: [2023-04-29 17:23:29,367] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 14: [2023-04-29 17:23:29,367] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 14: [2023-04-29 17:23:29,370] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 14: [2023-04-29 17:23:29,371] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 2: [2023-04-29 17:23:29,372] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 13: [2023-04-29 17:23:29,372] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 14: [2023-04-29 17:23:29,375] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 17: [2023-04-29 17:23:29,376] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 14: [2023-04-29 17:23:29,377] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 14: [2023-04-29 17:23:29,377] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 14: [2023-04-29 17:23:29,378] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 14: [2023-04-29 17:23:29,378] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 14: [2023-04-29 17:23:29,379] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 2: [2023-04-29 17:23:29,380] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 2: [2023-04-29 17:23:29,380] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 2: [2023-04-29 17:23:29,385] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 17: [2023-04-29 17:23:29,386] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 2: [2023-04-29 17:23:29,388] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 17: [2023-04-29 17:23:29,388] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 17: [2023-04-29 17:23:29,390] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 13: [2023-04-29 17:23:29,394] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 13: [2023-04-29 17:23:29,394] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 13: [2023-04-29 17:23:29,394] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 13: [2023-04-29 17:23:29,395] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 17: [2023-04-29 17:23:29,395] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 13: [2023-04-29 17:23:29,396] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 17: [2023-04-29 17:23:29,400] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 17: [2023-04-29 17:23:29,402] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 17: [2023-04-29 17:23:29,402] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 17: [2023-04-29 17:23:29,402] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 5: [2023-04-29 17:23:29,405] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 5: [2023-04-29 17:23:29,405] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 21: [2023-04-29 17:23:29,406] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 21: [2023-04-29 17:23:29,406] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 21: [2023-04-29 17:23:29,406] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 21: [2023-04-29 17:23:29,407] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 16: [2023-04-29 17:23:29,408] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 16: [2023-04-29 17:23:29,408] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 16: [2023-04-29 17:23:29,408] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 16: [2023-04-29 17:23:29,409] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 16: [2023-04-29 17:23:29,409] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 16: [2023-04-29 17:23:29,409] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 16: [2023-04-29 17:23:29,409] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 16: [2023-04-29 17:23:29,409] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 16: [2023-04-29 17:23:29,414] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 16: [2023-04-29 17:23:29,415] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 17: [2023-04-29 17:23:29,415] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 16: [2023-04-29 17:23:29,415] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 4: [2023-04-29 17:23:29,415] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 4: [2023-04-29 17:23:29,415] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 4: [2023-04-29 17:23:29,415] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 16: [2023-04-29 17:23:29,415] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 16: [2023-04-29 17:23:29,415] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 4: [2023-04-29 17:23:29,415] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 4: [2023-04-29 17:23:29,415] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 4: [2023-04-29 17:23:29,415] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 4: [2023-04-29 17:23:29,415] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 14: [2023-04-29 17:23:29,415] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 4: [2023-04-29 17:23:29,416] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 16: [2023-04-29 17:23:29,416] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 16: [2023-04-29 17:23:29,416] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 16: [2023-04-29 17:23:29,416] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 4: [2023-04-29 17:23:29,419] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 4: [2023-04-29 17:23:29,419] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 21: [2023-04-29 17:23:29,419] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 21: [2023-04-29 17:23:29,419] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 21: [2023-04-29 17:23:29,419] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 21: [2023-04-29 17:23:29,419] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 14: [2023-04-29 17:23:29,420] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 5: [2023-04-29 17:23:29,421] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 17: [2023-04-29 17:23:29,424] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 5: [2023-04-29 17:23:29,425] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 5: [2023-04-29 17:23:29,425] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 4: [2023-04-29 17:23:29,426] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 4: [2023-04-29 17:23:29,426] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 5: [2023-04-29 17:23:29,426] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 4: [2023-04-29 17:23:29,426] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 4: [2023-04-29 17:23:29,427] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 4: [2023-04-29 17:23:29,427] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 4: [2023-04-29 17:23:29,428] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 31: [2023-04-29 17:23:29,427] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 31: [2023-04-29 17:23:29,427] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 31: [2023-04-29 17:23:29,427] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 31: [2023-04-29 17:23:29,428] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 31: [2023-04-29 17:23:29,428] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 11: [2023-04-29 17:23:29,427] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 11: [2023-04-29 17:23:29,427] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 11: [2023-04-29 17:23:29,427] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 11: [2023-04-29 17:23:29,428] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 11: [2023-04-29 17:23:29,428] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 31: [2023-04-29 17:23:29,428] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 31: [2023-04-29 17:23:29,428] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 11: [2023-04-29 17:23:29,428] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 11: [2023-04-29 17:23:29,428] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 31: [2023-04-29 17:23:29,428] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 11: [2023-04-29 17:23:29,428] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 21: [2023-04-29 17:23:29,429] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 17: [2023-04-29 17:23:29,430] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 21: [2023-04-29 17:23:29,431] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 21: [2023-04-29 17:23:29,431] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 17: [2023-04-29 17:23:29,432] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 11: [2023-04-29 17:23:29,432] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 11: [2023-04-29 17:23:29,432] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 11: [2023-04-29 17:23:29,433] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 31: [2023-04-29 17:23:29,432] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 31: [2023-04-29 17:23:29,432] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 31: [2023-04-29 17:23:29,433] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 17: [2023-04-29 17:23:29,433] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 21: [2023-04-29 17:23:29,433] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 31: [2023-04-29 17:23:29,433] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 31: [2023-04-29 17:23:29,433] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 31: [2023-04-29 17:23:29,434] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 14: [2023-04-29 17:23:29,434] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 31: [2023-04-29 17:23:29,434] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 31: [2023-04-29 17:23:29,434] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 11: [2023-04-29 17:23:29,436] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 11: [2023-04-29 17:23:29,437] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 11: [2023-04-29 17:23:29,437] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 11: [2023-04-29 17:23:29,438] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 11: [2023-04-29 17:23:29,438] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 14: [2023-04-29 17:23:29,439] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 5: [2023-04-29 17:23:29,444] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 5: [2023-04-29 17:23:29,444] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 5: [2023-04-29 17:23:29,444] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 5: [2023-04-29 17:23:29,446] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 14: [2023-04-29 17:23:29,447] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 21: [2023-04-29 17:23:29,446] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 21: [2023-04-29 17:23:29,447] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 21: [2023-04-29 17:23:29,447] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 14: [2023-04-29 17:23:29,448] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 14: [2023-04-29 17:23:29,449] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 5: [2023-04-29 17:23:29,449] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 21: [2023-04-29 17:23:29,449] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 5: [2023-04-29 17:23:29,452] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 14: [2023-04-29 17:23:29,452] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 14: [2023-04-29 17:23:29,452] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 14: [2023-04-29 17:23:29,452] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 25: [2023-04-29 17:23:29,461] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 25: [2023-04-29 17:23:29,461] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 25: [2023-04-29 17:23:29,461] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 25: [2023-04-29 17:23:29,461] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 25: [2023-04-29 17:23:29,461] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 25: [2023-04-29 17:23:29,461] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 25: [2023-04-29 17:23:29,462] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 25: [2023-04-29 17:23:29,462] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 25: [2023-04-29 17:23:29,465] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 25: [2023-04-29 17:23:29,465] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 16: [2023-04-29 17:23:29,469] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 16: [2023-04-29 17:23:29,469] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 4: [2023-04-29 17:23:29,471] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 4: [2023-04-29 17:23:29,471] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 25: [2023-04-29 17:23:29,471] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 25: [2023-04-29 17:23:29,472] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 25: [2023-04-29 17:23:29,473] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 5: [2023-04-29 17:23:29,473] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 25: [2023-04-29 17:23:29,473] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 25: [2023-04-29 17:23:29,473] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 5: [2023-04-29 17:23:29,474] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 25: [2023-04-29 17:23:29,474] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 16: [2023-04-29 17:23:29,474] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 16: [2023-04-29 17:23:29,475] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 5: [2023-04-29 17:23:29,475] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 14: [2023-04-29 17:23:29,476] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 27: [2023-04-29 17:23:29,475] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 27: [2023-04-29 17:23:29,476] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 27: [2023-04-29 17:23:29,476] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 27: [2023-04-29 17:23:29,476] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 27: [2023-04-29 17:23:29,476] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 27: [2023-04-29 17:23:29,476] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 27: [2023-04-29 17:23:29,476] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 27: [2023-04-29 17:23:29,476] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 5: [2023-04-29 17:23:29,477] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 14: [2023-04-29 17:23:29,478] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 14: [2023-04-29 17:23:29,479] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 27: [2023-04-29 17:23:29,479] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 27: [2023-04-29 17:23:29,482] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 14: [2023-04-29 17:23:29,486] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 16: [2023-04-29 17:23:29,487] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 16: [2023-04-29 17:23:29,487] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 16: [2023-04-29 17:23:29,487] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 16: [2023-04-29 17:23:29,487] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 31: [2023-04-29 17:23:29,487] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 31: [2023-04-29 17:23:29,487] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 31: [2023-04-29 17:23:29,487] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 27: [2023-04-29 17:23:29,487] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 27: [2023-04-29 17:23:29,488] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 11: [2023-04-29 17:23:29,488] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 11: [2023-04-29 17:23:29,488] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 11: [2023-04-29 17:23:29,488] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 27: [2023-04-29 17:23:29,488] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 14: [2023-04-29 17:23:29,488] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 14: [2023-04-29 17:23:29,488] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 27: [2023-04-29 17:23:29,489] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 27: [2023-04-29 17:23:29,489] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 27: [2023-04-29 17:23:29,490] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 4: [2023-04-29 17:23:29,492] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 4: [2023-04-29 17:23:29,492] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 31: [2023-04-29 17:23:29,493] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 31: [2023-04-29 17:23:29,493] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 16: [2023-04-29 17:23:29,494] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 16: [2023-04-29 17:23:29,495] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 11: [2023-04-29 17:23:29,496] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 4: [2023-04-29 17:23:29,497] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 4: [2023-04-29 17:23:29,497] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 16: [2023-04-29 17:23:29,497] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 4: [2023-04-29 17:23:29,499] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 4: [2023-04-29 17:23:29,499] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 4: [2023-04-29 17:23:29,499] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 4: [2023-04-29 17:23:29,499] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 16: [2023-04-29 17:23:29,501] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 11: [2023-04-29 17:23:29,502] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 11: [2023-04-29 17:23:29,502] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 31: [2023-04-29 17:23:29,503] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 31: [2023-04-29 17:23:29,503] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 31: [2023-04-29 17:23:29,504] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 11: [2023-04-29 17:23:29,507] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 31: [2023-04-29 17:23:29,508] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 6: [2023-04-29 17:23:29,509] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 6: [2023-04-29 17:23:29,509] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 6: [2023-04-29 17:23:29,509] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 11: [2023-04-29 17:23:29,509] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 6: [2023-04-29 17:23:29,509] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 6: [2023-04-29 17:23:29,509] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 6: [2023-04-29 17:23:29,509] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 6: [2023-04-29 17:23:29,509] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 6: [2023-04-29 17:23:29,510] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 31: [2023-04-29 17:23:29,510] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 31: [2023-04-29 17:23:29,511] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 11: [2023-04-29 17:23:29,511] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 11: [2023-04-29 17:23:29,513] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 11: [2023-04-29 17:23:29,513] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 6: [2023-04-29 17:23:29,513] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 12: [2023-04-29 17:23:29,513] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 12: [2023-04-29 17:23:29,513] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 6: [2023-04-29 17:23:29,514] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 16: [2023-04-29 17:23:29,514] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 12: [2023-04-29 17:23:29,514] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 12: [2023-04-29 17:23:29,514] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 12: [2023-04-29 17:23:29,514] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 12: [2023-04-29 17:23:29,514] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 12: [2023-04-29 17:23:29,514] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 12: [2023-04-29 17:23:29,514] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 16: [2023-04-29 17:23:29,515] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 25: [2023-04-29 17:23:29,516] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 25: [2023-04-29 17:23:29,516] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 16: [2023-04-29 17:23:29,517] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 31: [2023-04-29 17:23:29,518] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 16: [2023-04-29 17:23:29,518] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 6: [2023-04-29 17:23:29,518] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 6: [2023-04-29 17:23:29,519] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 6: [2023-04-29 17:23:29,519] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 12: [2023-04-29 17:23:29,519] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 6: [2023-04-29 17:23:29,519] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 31: [2023-04-29 17:23:29,519] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 12: [2023-04-29 17:23:29,520] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 12: [2023-04-29 17:23:29,521] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 27: [2023-04-29 17:23:29,520] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 6: [2023-04-29 17:23:29,520] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 6: [2023-04-29 17:23:29,521] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 12: [2023-04-29 17:23:29,522] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 12: [2023-04-29 17:23:29,523] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 12: [2023-04-29 17:23:29,523] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 12: [2023-04-29 17:23:29,523] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 12: [2023-04-29 17:23:29,523] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 4: [2023-04-29 17:23:29,525] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 11: [2023-04-29 17:23:29,526] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 11: [2023-04-29 17:23:29,529] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 11: [2023-04-29 17:23:29,530] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 31: [2023-04-29 17:23:29,530] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 31: [2023-04-29 17:23:29,531] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 31: [2023-04-29 17:23:29,531] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 4: [2023-04-29 17:23:29,534] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 4: [2023-04-29 17:23:29,534] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 11: [2023-04-29 17:23:29,536] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 25: [2023-04-29 17:23:29,536] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 4: [2023-04-29 17:23:29,537] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 11: [2023-04-29 17:23:29,537] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 4: [2023-04-29 17:23:29,538] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 4: [2023-04-29 17:23:29,538] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 25: [2023-04-29 17:23:29,539] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 25: [2023-04-29 17:23:29,540] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 27: [2023-04-29 17:23:29,540] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 25: [2023-04-29 17:23:29,540] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 25: [2023-04-29 17:23:29,544] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 25: [2023-04-29 17:23:29,544] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 25: [2023-04-29 17:23:29,544] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 25: [2023-04-29 17:23:29,544] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 27: [2023-04-29 17:23:29,544] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 10: [2023-04-29 17:23:29,551] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 10: [2023-04-29 17:23:29,551] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 10: [2023-04-29 17:23:29,552] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 10: [2023-04-29 17:23:29,553] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 10: [2023-04-29 17:23:29,553] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 10: [2023-04-29 17:23:29,553] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 10: [2023-04-29 17:23:29,553] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 10: [2023-04-29 17:23:29,553] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 10: [2023-04-29 17:23:29,555] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 10: [2023-04-29 17:23:29,557] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 10: [2023-04-29 17:23:29,558] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 10: [2023-04-29 17:23:29,558] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 10: [2023-04-29 17:23:29,560] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 10: [2023-04-29 17:23:29,560] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 24: [2023-04-29 17:23:29,561] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 10: [2023-04-29 17:23:29,562] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 10: [2023-04-29 17:23:29,562] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 24: [2023-04-29 17:23:29,562] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 24: [2023-04-29 17:23:29,562] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 24: [2023-04-29 17:23:29,562] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 24: [2023-04-29 17:23:29,562] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 24: [2023-04-29 17:23:29,562] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 24: [2023-04-29 17:23:29,562] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 24: [2023-04-29 17:23:29,563] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 26: [2023-04-29 17:23:29,563] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 26: [2023-04-29 17:23:29,563] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 26: [2023-04-29 17:23:29,563] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 26: [2023-04-29 17:23:29,563] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 26: [2023-04-29 17:23:29,563] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 26: [2023-04-29 17:23:29,563] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 26: [2023-04-29 17:23:29,563] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 26: [2023-04-29 17:23:29,563] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 12: [2023-04-29 17:23:29,565] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 0: [2023-04-29 17:23:29,565] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 0: [2023-04-29 17:23:29,565] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 0: [2023-04-29 17:23:29,565] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 0: [2023-04-29 17:23:29,565] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 0: [2023-04-29 17:23:29,565] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 0: [2023-04-29 17:23:29,565] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 0: [2023-04-29 17:23:29,565] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 6: [2023-04-29 17:23:29,564] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 6: [2023-04-29 17:23:29,564] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 0: [2023-04-29 17:23:29,565] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 24: [2023-04-29 17:23:29,566] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 27: [2023-04-29 17:23:29,568] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 27: [2023-04-29 17:23:29,568] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 26: [2023-04-29 17:23:29,568] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 26: [2023-04-29 17:23:29,569] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 27: [2023-04-29 17:23:29,569] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 26: [2023-04-29 17:23:29,569] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 24: [2023-04-29 17:23:29,569] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 26: [2023-04-29 17:23:29,570] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 24: [2023-04-29 17:23:29,570] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 27: [2023-04-29 17:23:29,570] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 27: [2023-04-29 17:23:29,570] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 26: [2023-04-29 17:23:29,570] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 26: [2023-04-29 17:23:29,570] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 26: [2023-04-29 17:23:29,571] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 26: [2023-04-29 17:23:29,571] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 27: [2023-04-29 17:23:29,572] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 25: [2023-04-29 17:23:29,572] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 27: [2023-04-29 17:23:29,573] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 25: [2023-04-29 17:23:29,573] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 25: [2023-04-29 17:23:29,575] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 7: [2023-04-29 17:23:29,575] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 7: [2023-04-29 17:23:29,575] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 7: [2023-04-29 17:23:29,575] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 7: [2023-04-29 17:23:29,575] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 7: [2023-04-29 17:23:29,575] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 20: [2023-04-29 17:23:29,575] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 20: [2023-04-29 17:23:29,575] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 20: [2023-04-29 17:23:29,575] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 7: [2023-04-29 17:23:29,575] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 7: [2023-04-29 17:23:29,575] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 24: [2023-04-29 17:23:29,575] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 20: [2023-04-29 17:23:29,575] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 20: [2023-04-29 17:23:29,576] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 24: [2023-04-29 17:23:29,575] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 20: [2023-04-29 17:23:29,576] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 20: [2023-04-29 17:23:29,576] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 7: [2023-04-29 17:23:29,576] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 20: [2023-04-29 17:23:29,576] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 12: [2023-04-29 17:23:29,578] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 24: [2023-04-29 17:23:29,577] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 24: [2023-04-29 17:23:29,577] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 24: [2023-04-29 17:23:29,578] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 0: [2023-04-29 17:23:29,578] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 0: [2023-04-29 17:23:29,579] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 0: [2023-04-29 17:23:29,579] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 0: [2023-04-29 17:23:29,579] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 0: [2023-04-29 17:23:29,579] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 25: [2023-04-29 17:23:29,579] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 7: [2023-04-29 17:23:29,580] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 7: [2023-04-29 17:23:29,580] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 7: [2023-04-29 17:23:29,580] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 0: [2023-04-29 17:23:29,580] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 20: [2023-04-29 17:23:29,580] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 0: [2023-04-29 17:23:29,581] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 7: [2023-04-29 17:23:29,581] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 25: [2023-04-29 17:23:29,581] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 0: [2023-04-29 17:23:29,581] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 20: [2023-04-29 17:23:29,581] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 7: [2023-04-29 17:23:29,582] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 20: [2023-04-29 17:23:29,582] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 7: [2023-04-29 17:23:29,582] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 7: [2023-04-29 17:23:29,582] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 20: [2023-04-29 17:23:29,583] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 7: [2023-04-29 17:23:29,583] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 25: [2023-04-29 17:23:29,584] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 20: [2023-04-29 17:23:29,584] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 20: [2023-04-29 17:23:29,585] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 12: [2023-04-29 17:23:29,586] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 20: [2023-04-29 17:23:29,586] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 12: [2023-04-29 17:23:29,586] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 20: [2023-04-29 17:23:29,586] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 12: [2023-04-29 17:23:29,587] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 6: [2023-04-29 17:23:29,588] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 6: [2023-04-29 17:23:29,588] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 6: [2023-04-29 17:23:29,588] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 12: [2023-04-29 17:23:29,590] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 12: [2023-04-29 17:23:29,590] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 12: [2023-04-29 17:23:29,590] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 12: [2023-04-29 17:23:29,590] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 6: [2023-04-29 17:23:29,592] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 6: [2023-04-29 17:23:29,592] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 6: [2023-04-29 17:23:29,592] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 6: [2023-04-29 17:23:29,592] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 6: [2023-04-29 17:23:29,592] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 27: [2023-04-29 17:23:29,598] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 27: [2023-04-29 17:23:29,599] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 27: [2023-04-29 17:23:29,602] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 27: [2023-04-29 17:23:29,604] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 27: [2023-04-29 17:23:29,604] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 12: [2023-04-29 17:23:29,605] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 27: [2023-04-29 17:23:29,606] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 9: [2023-04-29 17:23:29,608] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 9: [2023-04-29 17:23:29,608] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 9: [2023-04-29 17:23:29,608] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 9: [2023-04-29 17:23:29,608] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 9: [2023-04-29 17:23:29,608] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 23: [2023-04-29 17:23:29,609] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 9: [2023-04-29 17:23:29,608] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 9: [2023-04-29 17:23:29,609] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 9: [2023-04-29 17:23:29,609] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 23: [2023-04-29 17:23:29,609] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 23: [2023-04-29 17:23:29,609] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 18: [2023-04-29 17:23:29,609] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 18: [2023-04-29 17:23:29,609] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 18: [2023-04-29 17:23:29,609] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 23: [2023-04-29 17:23:29,609] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 18: [2023-04-29 17:23:29,609] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 18: [2023-04-29 17:23:29,609] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 18: [2023-04-29 17:23:29,609] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 18: [2023-04-29 17:23:29,609] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 23: [2023-04-29 17:23:29,609] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 23: [2023-04-29 17:23:29,609] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 23: [2023-04-29 17:23:29,609] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 23: [2023-04-29 17:23:29,609] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 18: [2023-04-29 17:23:29,610] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 10: [2023-04-29 17:23:29,610] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 9: [2023-04-29 17:23:29,613] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 23: [2023-04-29 17:23:29,612] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 9: [2023-04-29 17:23:29,614] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 9: [2023-04-29 17:23:29,614] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 9: [2023-04-29 17:23:29,614] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 9: [2023-04-29 17:23:29,614] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 9: [2023-04-29 17:23:29,615] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 23: [2023-04-29 17:23:29,615] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 9: [2023-04-29 17:23:29,615] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 9: [2023-04-29 17:23:29,615] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 12: [2023-04-29 17:23:29,615] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 10: [2023-04-29 17:23:29,616] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 12: [2023-04-29 17:23:29,616] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 1: [2023-04-29 17:23:29,616] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 1: [2023-04-29 17:23:29,616] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 10: [2023-04-29 17:23:29,617] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 10: [2023-04-29 17:23:29,617] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 1: [2023-04-29 17:23:29,617] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 1: [2023-04-29 17:23:29,617] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 1: [2023-04-29 17:23:29,617] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 1: [2023-04-29 17:23:29,617] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 1: [2023-04-29 17:23:29,617] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 1: [2023-04-29 17:23:29,617] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 24: [2023-04-29 17:23:29,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 18: [2023-04-29 17:23:29,618] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 12: [2023-04-29 17:23:29,618] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 12: [2023-04-29 17:23:29,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 23: [2023-04-29 17:23:29,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 23: [2023-04-29 17:23:29,620] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 12: [2023-04-29 17:23:29,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 12: [2023-04-29 17:23:29,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 23: [2023-04-29 17:23:29,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 26: [2023-04-29 17:23:29,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 23: [2023-04-29 17:23:29,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 23: [2023-04-29 17:23:29,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 23: [2023-04-29 17:23:29,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 1: [2023-04-29 17:23:29,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 1: [2023-04-29 17:23:29,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 10: [2023-04-29 17:23:29,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 10: [2023-04-29 17:23:29,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 10: [2023-04-29 17:23:29,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 1: [2023-04-29 17:23:29,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 10: [2023-04-29 17:23:29,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 1: [2023-04-29 17:23:29,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 18: [2023-04-29 17:23:29,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 18: [2023-04-29 17:23:29,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 18: [2023-04-29 17:23:29,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 18: [2023-04-29 17:23:29,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 1: [2023-04-29 17:23:29,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 18: [2023-04-29 17:23:29,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 6: [2023-04-29 17:23:29,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 1: [2023-04-29 17:23:29,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 19: [2023-04-29 17:23:29,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 1: [2023-04-29 17:23:29,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 19: [2023-04-29 17:23:29,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 19: [2023-04-29 17:23:29,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 18: [2023-04-29 17:23:29,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 19: [2023-04-29 17:23:29,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 1: [2023-04-29 17:23:29,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 18: [2023-04-29 17:23:29,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 19: [2023-04-29 17:23:29,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 19: [2023-04-29 17:23:29,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 19: [2023-04-29 17:23:29,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 26: [2023-04-29 17:23:29,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 26: [2023-04-29 17:23:29,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 19: [2023-04-29 17:23:29,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 26: [2023-04-29 17:23:29,627] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 6: [2023-04-29 17:23:29,628] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 6: [2023-04-29 17:23:29,628] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 6: [2023-04-29 17:23:29,629] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 19: [2023-04-29 17:23:29,629] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 19: [2023-04-29 17:23:29,629] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 19: [2023-04-29 17:23:29,629] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 10: [2023-04-29 17:23:29,633] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 6: [2023-04-29 17:23:29,633] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 19: [2023-04-29 17:23:29,633] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 19: [2023-04-29 17:23:29,633] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 19: [2023-04-29 17:23:29,633] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 19: [2023-04-29 17:23:29,634] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 19: [2023-04-29 17:23:29,634] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 7: [2023-04-29 17:23:29,634] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 7: [2023-04-29 17:23:29,634] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 6: [2023-04-29 17:23:29,634] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 7: [2023-04-29 17:23:29,635] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 20: [2023-04-29 17:23:29,636] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 20: [2023-04-29 17:23:29,636] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 26: [2023-04-29 17:23:29,638] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 26: [2023-04-29 17:23:29,638] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 26: [2023-04-29 17:23:29,638] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 26: [2023-04-29 17:23:29,638] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 24: [2023-04-29 17:23:29,638] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 20: [2023-04-29 17:23:29,638] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 20: [2023-04-29 17:23:29,638] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 24: [2023-04-29 17:23:29,640] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 24: [2023-04-29 17:23:29,641] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 22: [2023-04-29 17:23:29,640] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 22: [2023-04-29 17:23:29,640] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 22: [2023-04-29 17:23:29,640] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 22: [2023-04-29 17:23:29,640] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 22: [2023-04-29 17:23:29,640] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 22: [2023-04-29 17:23:29,640] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 22: [2023-04-29 17:23:29,640] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 22: [2023-04-29 17:23:29,641] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 7: [2023-04-29 17:23:29,643] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 22: [2023-04-29 17:23:29,645] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 22: [2023-04-29 17:23:29,645] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 26: [2023-04-29 17:23:29,646] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 10: [2023-04-29 17:23:29,646] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 22: [2023-04-29 17:23:29,650] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 22: [2023-04-29 17:23:29,650] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 22: [2023-04-29 17:23:29,651] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 22: [2023-04-29 17:23:29,652] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 22: [2023-04-29 17:23:29,652] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 30: [2023-04-29 17:23:29,652] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 30: [2023-04-29 17:23:29,653] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 30: [2023-04-29 17:23:29,653] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 30: [2023-04-29 17:23:29,653] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 30: [2023-04-29 17:23:29,653] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 30: [2023-04-29 17:23:29,653] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 30: [2023-04-29 17:23:29,653] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 30: [2023-04-29 17:23:29,653] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 22: [2023-04-29 17:23:29,653] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 20: [2023-04-29 17:23:29,654] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 20: [2023-04-29 17:23:29,654] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 26: [2023-04-29 17:23:29,654] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 7: [2023-04-29 17:23:29,654] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 7: [2023-04-29 17:23:29,654] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 7: [2023-04-29 17:23:29,654] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 7: [2023-04-29 17:23:29,654] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 26: [2023-04-29 17:23:29,655] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 26: [2023-04-29 17:23:29,655] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 20: [2023-04-29 17:23:29,655] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 10: [2023-04-29 17:23:29,648] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 10: [2023-04-29 17:23:29,649] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 10: [2023-04-29 17:23:29,652] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 10: [2023-04-29 17:23:29,653] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 10: [2023-04-29 17:23:29,653] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 10: [2023-04-29 17:23:29,654] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 7: [2023-04-29 17:23:29,657] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 20: [2023-04-29 17:23:29,657] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 24: [2023-04-29 17:23:29,657] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 24: [2023-04-29 17:23:29,657] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 24: [2023-04-29 17:23:29,657] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 7: [2023-04-29 17:23:29,657] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 0: [2023-04-29 17:23:29,658] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 7: [2023-04-29 17:23:29,659] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 20: [2023-04-29 17:23:29,659] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 20: [2023-04-29 17:23:29,660] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 0: [2023-04-29 17:23:29,660] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 23: [2023-04-29 17:23:29,659] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 0: [2023-04-29 17:23:29,660] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 26: [2023-04-29 17:23:29,662] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 24: [2023-04-29 17:23:29,664] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 20: [2023-04-29 17:23:29,664] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 30: [2023-04-29 17:23:29,664] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 30: [2023-04-29 17:23:29,664] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 30: [2023-04-29 17:23:29,664] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 24: [2023-04-29 17:23:29,664] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 30: [2023-04-29 17:23:29,664] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 30: [2023-04-29 17:23:29,665] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 9: [2023-04-29 17:23:29,665] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 30: [2023-04-29 17:23:29,665] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 30: [2023-04-29 17:23:29,665] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 26: [2023-04-29 17:23:29,666] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 26: [2023-04-29 17:23:29,666] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 20: [2023-04-29 17:23:29,666] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 26: [2023-04-29 17:23:29,666] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 0: [2023-04-29 17:23:29,667] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 0: [2023-04-29 17:23:29,667] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 30: [2023-04-29 17:23:29,667] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 24: [2023-04-29 17:23:29,670] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 24: [2023-04-29 17:23:29,671] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 7: [2023-04-29 17:23:29,671] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 1: [2023-04-29 17:23:29,672] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 9: [2023-04-29 17:23:29,674] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 9: [2023-04-29 17:23:29,674] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 9: [2023-04-29 17:23:29,675] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 9: [2023-04-29 17:23:29,675] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 23: [2023-04-29 17:23:29,675] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 9: [2023-04-29 17:23:29,678] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 9: [2023-04-29 17:23:29,678] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 9: [2023-04-29 17:23:29,679] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 13: [2023-04-29 17:23:29,679] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 13: [2023-04-29 17:23:29,679] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 20: [2023-04-29 17:23:29,680] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 23: [2023-04-29 17:23:29,681] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 20: [2023-04-29 17:23:29,681] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 7: [2023-04-29 17:23:29,681] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 7: [2023-04-29 17:23:29,682] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 13: [2023-04-29 17:23:29,682] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 13: [2023-04-29 17:23:29,682] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 13: [2023-04-29 17:23:29,682] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 13: [2023-04-29 17:23:29,682] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 13: [2023-04-29 17:23:29,682] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 13: [2023-04-29 17:23:29,683] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 1: [2023-04-29 17:23:29,684] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 1: [2023-04-29 17:23:29,684] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 1: [2023-04-29 17:23:29,684] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 1: [2023-04-29 17:23:29,684] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 13: [2023-04-29 17:23:29,684] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 13: [2023-04-29 17:23:29,684] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 24: [2023-04-29 17:23:29,685] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 20: [2023-04-29 17:23:29,685] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 19: [2023-04-29 17:23:29,684] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 19: [2023-04-29 17:23:29,684] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 19: [2023-04-29 17:23:29,684] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 23: [2023-04-29 17:23:29,686] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 20: [2023-04-29 17:23:29,686] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 7: [2023-04-29 17:23:29,687] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 13: [2023-04-29 17:23:29,688] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 0: [2023-04-29 17:23:29,689] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 0: [2023-04-29 17:23:29,689] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 7: [2023-04-29 17:23:29,689] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 1: [2023-04-29 17:23:29,689] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 1: [2023-04-29 17:23:29,689] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 1: [2023-04-29 17:23:29,689] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 3: [2023-04-29 17:23:29,689] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 3: [2023-04-29 17:23:29,689] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 0: [2023-04-29 17:23:29,689] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 3: [2023-04-29 17:23:29,689] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 3: [2023-04-29 17:23:29,690] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 9: [2023-04-29 17:23:29,690] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 3: [2023-04-29 17:23:29,690] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 3: [2023-04-29 17:23:29,690] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 3: [2023-04-29 17:23:29,690] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 0: [2023-04-29 17:23:29,690] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 3: [2023-04-29 17:23:29,690] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 13: [2023-04-29 17:23:29,692] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 13: [2023-04-29 17:23:29,692] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 24: [2023-04-29 17:23:29,693] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 24: [2023-04-29 17:23:29,693] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 13: [2023-04-29 17:23:29,693] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 13: [2023-04-29 17:23:29,693] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 13: [2023-04-29 17:23:29,693] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 3: [2023-04-29 17:23:29,694] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 3: [2023-04-29 17:23:29,694] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 0: [2023-04-29 17:23:29,695] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 24: [2023-04-29 17:23:29,695] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 18: [2023-04-29 17:23:29,696] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 23: [2023-04-29 17:23:29,696] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 1: [2023-04-29 17:23:29,696] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 19: [2023-04-29 17:23:29,697] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 22: [2023-04-29 17:23:29,697] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 22: [2023-04-29 17:23:29,697] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 24: [2023-04-29 17:23:29,697] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 23: [2023-04-29 17:23:29,698] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 23: [2023-04-29 17:23:29,698] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 23: [2023-04-29 17:23:29,698] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 23: [2023-04-29 17:23:29,699] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 23: [2023-04-29 17:23:29,699] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 0: [2023-04-29 17:23:29,700] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 3: [2023-04-29 17:23:29,700] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 9: [2023-04-29 17:23:29,700] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 3: [2023-04-29 17:23:29,700] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 3: [2023-04-29 17:23:29,700] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 9: [2023-04-29 17:23:29,700] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 3: [2023-04-29 17:23:29,700] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 3: [2023-04-29 17:23:29,701] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 9: [2023-04-29 17:23:29,701] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 3: [2023-04-29 17:23:29,701] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 0: [2023-04-29 17:23:29,702] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 18: [2023-04-29 17:23:29,702] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 19: [2023-04-29 17:23:29,702] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 19: [2023-04-29 17:23:29,702] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 19: [2023-04-29 17:23:29,702] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 19: [2023-04-29 17:23:29,702] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 18: [2023-04-29 17:23:29,702] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 0: [2023-04-29 17:23:29,702] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 29: [2023-04-29 17:23:29,702] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 29: [2023-04-29 17:23:29,703] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 9: [2023-04-29 17:23:29,703] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 29: [2023-04-29 17:23:29,703] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 29: [2023-04-29 17:23:29,703] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 29: [2023-04-29 17:23:29,703] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 29: [2023-04-29 17:23:29,703] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 29: [2023-04-29 17:23:29,703] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 29: [2023-04-29 17:23:29,704] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 9: [2023-04-29 17:23:29,704] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 9: [2023-04-29 17:23:29,704] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 19: [2023-04-29 17:23:29,705] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 9: [2023-04-29 17:23:29,706] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 15: [2023-04-29 17:23:29,706] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 15: [2023-04-29 17:23:29,706] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 15: [2023-04-29 17:23:29,706] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 15: [2023-04-29 17:23:29,706] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 15: [2023-04-29 17:23:29,706] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 15: [2023-04-29 17:23:29,706] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 15: [2023-04-29 17:23:29,706] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 15: [2023-04-29 17:23:29,707] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 29: [2023-04-29 17:23:29,707] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 29: [2023-04-29 17:23:29,707] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 19: [2023-04-29 17:23:29,708] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 2: [2023-04-29 17:23:29,708] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 2: [2023-04-29 17:23:29,708] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 19: [2023-04-29 17:23:29,708] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 2: [2023-04-29 17:23:29,709] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 2: [2023-04-29 17:23:29,709] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 2: [2023-04-29 17:23:29,709] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 2: [2023-04-29 17:23:29,709] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 2: [2023-04-29 17:23:29,709] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 2: [2023-04-29 17:23:29,710] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 5: [2023-04-29 17:23:29,709] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 5: [2023-04-29 17:23:29,709] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 5: [2023-04-29 17:23:29,710] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 5: [2023-04-29 17:23:29,710] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 5: [2023-04-29 17:23:29,710] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 5: [2023-04-29 17:23:29,710] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 5: [2023-04-29 17:23:29,710] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 8: [2023-04-29 17:23:29,710] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 8: [2023-04-29 17:23:29,710] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 8: [2023-04-29 17:23:29,710] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 8: [2023-04-29 17:23:29,711] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 8: [2023-04-29 17:23:29,711] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 8: [2023-04-29 17:23:29,711] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 8: [2023-04-29 17:23:29,711] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 5: [2023-04-29 17:23:29,711] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 1: [2023-04-29 17:23:29,711] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 8: [2023-04-29 17:23:29,711] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 1: [2023-04-29 17:23:29,711] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 28: [2023-04-29 17:23:29,711] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 28: [2023-04-29 17:23:29,711] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 28: [2023-04-29 17:23:29,711] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 28: [2023-04-29 17:23:29,711] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 28: [2023-04-29 17:23:29,712] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 28: [2023-04-29 17:23:29,712] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 28: [2023-04-29 17:23:29,712] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 28: [2023-04-29 17:23:29,712] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 2: [2023-04-29 17:23:29,712] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 23: [2023-04-29 17:23:29,712] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 2: [2023-04-29 17:23:29,713] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 22: [2023-04-29 17:23:29,713] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 29: [2023-04-29 17:23:29,713] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 29: [2023-04-29 17:23:29,713] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 2: [2023-04-29 17:23:29,713] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 5: [2023-04-29 17:23:29,713] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 29: [2023-04-29 17:23:29,714] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 5: [2023-04-29 17:23:29,714] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 29: [2023-04-29 17:23:29,715] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 1: [2023-04-29 17:23:29,715] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 18: [2023-04-29 17:23:29,715] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 18: [2023-04-29 17:23:29,715] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 18: [2023-04-29 17:23:29,715] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 18: [2023-04-29 17:23:29,715] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 18: [2023-04-29 17:23:29,715] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 29: [2023-04-29 17:23:29,715] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 5: [2023-04-29 17:23:29,715] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 29: [2023-04-29 17:23:29,715] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 2: [2023-04-29 17:23:29,716] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 1: [2023-04-29 17:23:29,716] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 2: [2023-04-29 17:23:29,717] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 8: [2023-04-29 17:23:29,717] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 8: [2023-04-29 17:23:29,717] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 22: [2023-04-29 17:23:29,718] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 8: [2023-04-29 17:23:29,718] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 22: [2023-04-29 17:23:29,719] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 15: [2023-04-29 17:23:29,718] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 0: [2023-04-29 17:23:29,719] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 8: [2023-04-29 17:23:29,719] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 15: [2023-04-29 17:23:29,719] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 2: [2023-04-29 17:23:29,719] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 2: [2023-04-29 17:23:29,719] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 8: [2023-04-29 17:23:29,720] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 0: [2023-04-29 17:23:29,720] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 1: [2023-04-29 17:23:29,720] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 15: [2023-04-29 17:23:29,720] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 5: [2023-04-29 17:23:29,720] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 15: [2023-04-29 17:23:29,721] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 5: [2023-04-29 17:23:29,721] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 2: [2023-04-29 17:23:29,721] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 15: [2023-04-29 17:23:29,721] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 0: [2023-04-29 17:23:29,721] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 8: [2023-04-29 17:23:29,721] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 8: [2023-04-29 17:23:29,721] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 5: [2023-04-29 17:23:29,721] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 8: [2023-04-29 17:23:29,722] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 5: [2023-04-29 17:23:29,722] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 15: [2023-04-29 17:23:29,722] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 5: [2023-04-29 17:23:29,722] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 15: [2023-04-29 17:23:29,722] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 1: [2023-04-29 17:23:29,723] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 1: [2023-04-29 17:23:29,723] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 22: [2023-04-29 17:23:29,723] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 15: [2023-04-29 17:23:29,723] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 22: [2023-04-29 17:23:29,723] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 22: [2023-04-29 17:23:29,723] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 28: [2023-04-29 17:23:29,723] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 28: [2023-04-29 17:23:29,724] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 19: [2023-04-29 17:23:29,724] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 18: [2023-04-29 17:23:29,724] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 28: [2023-04-29 17:23:29,724] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 28: [2023-04-29 17:23:29,725] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 28: [2023-04-29 17:23:29,725] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 28: [2023-04-29 17:23:29,725] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 28: [2023-04-29 17:23:29,727] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 28: [2023-04-29 17:23:29,727] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt... 18: [2023-04-29 17:23:29,729] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 18: [2023-04-29 17:23:29,729] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 22: [2023-04-29 17:23:29,729] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 14: [2023-04-29 17:23:29,730] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 23: [2023-04-29 17:23:29,730] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 23: [2023-04-29 17:23:29,730] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 14: [2023-04-29 17:23:29,730] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 14: [2023-04-29 17:23:29,731] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 14: [2023-04-29 17:23:29,731] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 14: [2023-04-29 17:23:29,731] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 14: [2023-04-29 17:23:29,731] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 14: [2023-04-29 17:23:29,731] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 14: [2023-04-29 17:23:29,731] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 17: [2023-04-29 17:23:29,730] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 17: [2023-04-29 17:23:29,730] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 17: [2023-04-29 17:23:29,731] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 17: [2023-04-29 17:23:29,731] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 23: [2023-04-29 17:23:29,731] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 17: [2023-04-29 17:23:29,731] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 17: [2023-04-29 17:23:29,731] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 17: [2023-04-29 17:23:29,731] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 17: [2023-04-29 17:23:29,732] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 19: [2023-04-29 17:23:29,732] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 19: [2023-04-29 17:23:29,732] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 19: [2023-04-29 17:23:29,732] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 19: [2023-04-29 17:23:29,733] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 14: [2023-04-29 17:23:29,734] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 23: [2023-04-29 17:23:29,734] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 22: [2023-04-29 17:23:29,734] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 14: [2023-04-29 17:23:29,735] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 23: [2023-04-29 17:23:29,735] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 17: [2023-04-29 17:23:29,736] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 22: [2023-04-29 17:23:29,736] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 30: [2023-04-29 17:23:29,736] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 17: [2023-04-29 17:23:29,737] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 13: [2023-04-29 17:23:29,738] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 14: [2023-04-29 17:23:29,740] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 17: [2023-04-29 17:23:29,740] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 17: [2023-04-29 17:23:29,741] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 14: [2023-04-29 17:23:29,741] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 14: [2023-04-29 17:23:29,741] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 17: [2023-04-29 17:23:29,742] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 14: [2023-04-29 17:23:29,742] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 17: [2023-04-29 17:23:29,742] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 14: [2023-04-29 17:23:29,742] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 14: [2023-04-29 17:23:29,743] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 13: [2023-04-29 17:23:29,743] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 17: [2023-04-29 17:23:29,743] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 3: [2023-04-29 17:23:29,744] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 3: [2023-04-29 17:23:29,744] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 17: [2023-04-29 17:23:29,743] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 18: [2023-04-29 17:23:29,749] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 18: [2023-04-29 17:23:29,750] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 18: [2023-04-29 17:23:29,750] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 18: [2023-04-29 17:23:29,753] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 18: [2023-04-29 17:23:29,753] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 22: [2023-04-29 17:23:29,754] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 22: [2023-04-29 17:23:29,755] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 30: [2023-04-29 17:23:29,756] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 30: [2023-04-29 17:23:29,756] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 30: [2023-04-29 17:23:29,756] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 30: [2023-04-29 17:23:29,756] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 30: [2023-04-29 17:23:29,756] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 13: [2023-04-29 17:23:29,756] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 30: [2023-04-29 17:23:29,756] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 30: [2023-04-29 17:23:29,757] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 29: [2023-04-29 17:23:29,759] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 29: [2023-04-29 17:23:29,759] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 22: [2023-04-29 17:23:29,760] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 13: [2023-04-29 17:23:29,760] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 30: [2023-04-29 17:23:29,761] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 2: [2023-04-29 17:23:29,762] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 22: [2023-04-29 17:23:29,763] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 22: [2023-04-29 17:23:29,764] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 5: [2023-04-29 17:23:29,763] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 5: [2023-04-29 17:23:29,763] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 13: [2023-04-29 17:23:29,765] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 13: [2023-04-29 17:23:29,765] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 13: [2023-04-29 17:23:29,765] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 8: [2023-04-29 17:23:29,764] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 13: [2023-04-29 17:23:29,767] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 3: [2023-04-29 17:23:29,767] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 13: [2023-04-29 17:23:29,767] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 3: [2023-04-29 17:23:29,767] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 3: [2023-04-29 17:23:29,768] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 13: [2023-04-29 17:23:29,769] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 2: [2023-04-29 17:23:29,771] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 2: [2023-04-29 17:23:29,771] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 3: [2023-04-29 17:23:29,771] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 3: [2023-04-29 17:23:29,771] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 3: [2023-04-29 17:23:29,771] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 3: [2023-04-29 17:23:29,771] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 3: [2023-04-29 17:23:29,771] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 8: [2023-04-29 17:23:29,775] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 29: [2023-04-29 17:23:29,776] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 8: [2023-04-29 17:23:29,779] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 29: [2023-04-29 17:23:29,779] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 29: [2023-04-29 17:23:29,780] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 13: [2023-04-29 17:23:29,781] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 16: [2023-04-29 17:23:29,783] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 16: [2023-04-29 17:23:29,783] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 16: [2023-04-29 17:23:29,783] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 16: [2023-04-29 17:23:29,783] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 16: [2023-04-29 17:23:29,783] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 16: [2023-04-29 17:23:29,783] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 16: [2023-04-29 17:23:29,783] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 16: [2023-04-29 17:23:29,784] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 11: [2023-04-29 17:23:29,784] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 11: [2023-04-29 17:23:29,784] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 8: [2023-04-29 17:23:29,784] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 8: [2023-04-29 17:23:29,784] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 2: [2023-04-29 17:23:29,784] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 2: [2023-04-29 17:23:29,784] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 8: [2023-04-29 17:23:29,784] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 8: [2023-04-29 17:23:29,784] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 2: [2023-04-29 17:23:29,785] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 5: [2023-04-29 17:23:29,785] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 11: [2023-04-29 17:23:29,786] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 11: [2023-04-29 17:23:29,786] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 11: [2023-04-29 17:23:29,786] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 11: [2023-04-29 17:23:29,786] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 11: [2023-04-29 17:23:29,786] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 11: [2023-04-29 17:23:29,787] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 5: [2023-04-29 17:23:29,787] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 2: [2023-04-29 17:23:29,787] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 2: [2023-04-29 17:23:29,787] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 11: [2023-04-29 17:23:29,787] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 14: [2023-04-29 17:23:29,787] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 14: [2023-04-29 17:23:29,787] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 29: [2023-04-29 17:23:29,787] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 5: [2023-04-29 17:23:29,788] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 8: [2023-04-29 17:23:29,788] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 21: [2023-04-29 17:23:29,788] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 21: [2023-04-29 17:23:29,788] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 21: [2023-04-29 17:23:29,788] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 21: [2023-04-29 17:23:29,788] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 21: [2023-04-29 17:23:29,788] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 21: [2023-04-29 17:23:29,788] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 21: [2023-04-29 17:23:29,788] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 2: [2023-04-29 17:23:29,788] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 21: [2023-04-29 17:23:29,788] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 4: [2023-04-29 17:23:29,789] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 4: [2023-04-29 17:23:29,789] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 11: [2023-04-29 17:23:29,789] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 16: [2023-04-29 17:23:29,789] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 16: [2023-04-29 17:23:29,789] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 16: [2023-04-29 17:23:29,790] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 17: [2023-04-29 17:23:29,790] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 16: [2023-04-29 17:23:29,790] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 29: [2023-04-29 17:23:29,790] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 29: [2023-04-29 17:23:29,790] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 29: [2023-04-29 17:23:29,790] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 11: [2023-04-29 17:23:29,790] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 30: [2023-04-29 17:23:29,790] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 29: [2023-04-29 17:23:29,790] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 16: [2023-04-29 17:23:29,790] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 16: [2023-04-29 17:23:29,791] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 16: [2023-04-29 17:23:29,790] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 30: [2023-04-29 17:23:29,791] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 16: [2023-04-29 17:23:29,791] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 15: [2023-04-29 17:23:29,791] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 30: [2023-04-29 17:23:29,791] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 4: [2023-04-29 17:23:29,792] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 4: [2023-04-29 17:23:29,792] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 4: [2023-04-29 17:23:29,792] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 21: [2023-04-29 17:23:29,792] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 4: [2023-04-29 17:23:29,792] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 4: [2023-04-29 17:23:29,792] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 17: [2023-04-29 17:23:29,792] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 8: [2023-04-29 17:23:29,792] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 4: [2023-04-29 17:23:29,792] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 30: [2023-04-29 17:23:29,792] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 30: [2023-04-29 17:23:29,792] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 21: [2023-04-29 17:23:29,793] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 21: [2023-04-29 17:23:29,793] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 4: [2023-04-29 17:23:29,793] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 21: [2023-04-29 17:23:29,793] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 5: [2023-04-29 17:23:29,793] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 4: [2023-04-29 17:23:29,794] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 5: [2023-04-29 17:23:29,794] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 5: [2023-04-29 17:23:29,794] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 5: [2023-04-29 17:23:29,794] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 11: [2023-04-29 17:23:29,794] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 31: [2023-04-29 17:23:29,794] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 31: [2023-04-29 17:23:29,794] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 31: [2023-04-29 17:23:29,794] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 21: [2023-04-29 17:23:29,794] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 31: [2023-04-29 17:23:29,794] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 31: [2023-04-29 17:23:29,794] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 31: [2023-04-29 17:23:29,794] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 31: [2023-04-29 17:23:29,794] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 31: [2023-04-29 17:23:29,795] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 21: [2023-04-29 17:23:29,795] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 11: [2023-04-29 17:23:29,795] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 21: [2023-04-29 17:23:29,795] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 21: [2023-04-29 17:23:29,795] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 2: [2023-04-29 17:23:29,796] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 11: [2023-04-29 17:23:29,796] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 2: [2023-04-29 17:23:29,796] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 25: [2023-04-29 17:23:29,796] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 25: [2023-04-29 17:23:29,796] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 11: [2023-04-29 17:23:29,796] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 11: [2023-04-29 17:23:29,797] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 3: [2023-04-29 17:23:29,797] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 30: [2023-04-29 17:23:29,797] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 30: [2023-04-29 17:23:29,798] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 31: [2023-04-29 17:23:29,798] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 31: [2023-04-29 17:23:29,799] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 31: [2023-04-29 17:23:29,799] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 28: [2023-04-29 17:23:29,799] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 5: [2023-04-29 17:23:29,800] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 25: [2023-04-29 17:23:29,799] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 25: [2023-04-29 17:23:29,799] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 31: [2023-04-29 17:23:29,800] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 25: [2023-04-29 17:23:29,800] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 25: [2023-04-29 17:23:29,800] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 25: [2023-04-29 17:23:29,800] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 25: [2023-04-29 17:23:29,800] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 25: [2023-04-29 17:23:29,801] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 31: [2023-04-29 17:23:29,801] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 25: [2023-04-29 17:23:29,801] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 8: [2023-04-29 17:23:29,801] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 31: [2023-04-29 17:23:29,801] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 31: [2023-04-29 17:23:29,801] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 3: [2023-04-29 17:23:29,801] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 28: [2023-04-29 17:23:29,801] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 31: [2023-04-29 17:23:29,802] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 4: [2023-04-29 17:23:29,802] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 28: [2023-04-29 17:23:29,802] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 14: [2023-04-29 17:23:29,802] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 13: [2023-04-29 17:23:29,802] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 3: [2023-04-29 17:23:29,803] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 4: [2023-04-29 17:23:29,804] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 13: [2023-04-29 17:23:29,804] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 4: [2023-04-29 17:23:29,804] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 13: [2023-04-29 17:23:29,804] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 13: [2023-04-29 17:23:29,804] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 28: [2023-04-29 17:23:29,804] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 4: [2023-04-29 17:23:29,804] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 13: [2023-04-29 17:23:29,804] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 4: [2023-04-29 17:23:29,805] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 3: [2023-04-29 17:23:29,805] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 15: [2023-04-29 17:23:29,805] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 15: [2023-04-29 17:23:29,805] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 15: [2023-04-29 17:23:29,806] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 3: [2023-04-29 17:23:29,806] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 3: [2023-04-29 17:23:29,806] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 8: [2023-04-29 17:23:29,806] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 4: [2023-04-29 17:23:29,806] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 25: [2023-04-29 17:23:29,807] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 15: [2023-04-29 17:23:29,809] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 15: [2023-04-29 17:23:29,809] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 15: [2023-04-29 17:23:29,809] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 15: [2023-04-29 17:23:29,809] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 29: [2023-04-29 17:23:29,809] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 17: [2023-04-29 17:23:29,809] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 25: [2023-04-29 17:23:29,809] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 25: [2023-04-29 17:23:29,810] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 17: [2023-04-29 17:23:29,810] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 25: [2023-04-29 17:23:29,810] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 25: [2023-04-29 17:23:29,810] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 25: [2023-04-29 17:23:29,811] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 14: [2023-04-29 17:23:29,811] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 14: [2023-04-29 17:23:29,811] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 8: [2023-04-29 17:23:29,811] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 17: [2023-04-29 17:23:29,812] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 17: [2023-04-29 17:23:29,812] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 17: [2023-04-29 17:23:29,815] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 17: [2023-04-29 17:23:29,815] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 2: [2023-04-29 17:23:29,816] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 8: [2023-04-29 17:23:29,817] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 8: [2023-04-29 17:23:29,817] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 8: [2023-04-29 17:23:29,817] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 15: [2023-04-29 17:23:29,817] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 5: [2023-04-29 17:23:29,820] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 2: [2023-04-29 17:23:29,821] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 8: [2023-04-29 17:23:29,821] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 5: [2023-04-29 17:23:29,822] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 14: [2023-04-29 17:23:29,821] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 2: [2023-04-29 17:23:29,822] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 28: [2023-04-29 17:23:29,823] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 28: [2023-04-29 17:23:29,823] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 28: [2023-04-29 17:23:29,823] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 28: [2023-04-29 17:23:29,823] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_30-model_00-model_states.pt. 2: [2023-04-29 17:23:29,824] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 2: [2023-04-29 17:23:29,824] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 14: [2023-04-29 17:23:29,824] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 14: [2023-04-29 17:23:29,824] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 14: [2023-04-29 17:23:29,824] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 14: [2023-04-29 17:23:29,824] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 29: [2023-04-29 17:23:29,826] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 29: [2023-04-29 17:23:29,826] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 29: [2023-04-29 17:23:29,826] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 5: [2023-04-29 17:23:29,826] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 14: [2023-04-29 17:23:29,826] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 5: [2023-04-29 17:23:29,828] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 5: [2023-04-29 17:23:29,828] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 10: [2023-04-29 17:23:29,829] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 10: [2023-04-29 17:23:29,829] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 10: [2023-04-29 17:23:29,829] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 10: [2023-04-29 17:23:29,829] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 10: [2023-04-29 17:23:29,829] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 10: [2023-04-29 17:23:29,829] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 10: [2023-04-29 17:23:29,829] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 10: [2023-04-29 17:23:29,829] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 29: [2023-04-29 17:23:29,832] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 29: [2023-04-29 17:23:29,832] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 17: [2023-04-29 17:23:29,832] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 17: [2023-04-29 17:23:29,832] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 5: [2023-04-29 17:23:29,833] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 28: [2023-04-29 17:23:29,834] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 28: [2023-04-29 17:23:29,834] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 11: [2023-04-29 17:23:29,834] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 10: [2023-04-29 17:23:29,835] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 10: [2023-04-29 17:23:29,835] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 10: [2023-04-29 17:23:29,835] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 10: [2023-04-29 17:23:29,836] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 28: [2023-04-29 17:23:29,836] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 28: [2023-04-29 17:23:29,836] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 10: [2023-04-29 17:23:29,836] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 10: [2023-04-29 17:23:29,837] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 10: [2023-04-29 17:23:29,838] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 10: [2023-04-29 17:23:29,838] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 27: [2023-04-29 17:23:29,839] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 27: [2023-04-29 17:23:29,840] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 27: [2023-04-29 17:23:29,840] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 27: [2023-04-29 17:23:29,840] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 27: [2023-04-29 17:23:29,840] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 27: [2023-04-29 17:23:29,840] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 27: [2023-04-29 17:23:29,840] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 27: [2023-04-29 17:23:29,840] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 17: [2023-04-29 17:23:29,841] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 17: [2023-04-29 17:23:29,841] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 17: [2023-04-29 17:23:29,842] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 17: [2023-04-29 17:23:29,843] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 27: [2023-04-29 17:23:29,843] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 16: [2023-04-29 17:23:29,843] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 16: [2023-04-29 17:23:29,843] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 15: [2023-04-29 17:23:29,845] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 15: [2023-04-29 17:23:29,845] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 4: [2023-04-29 17:23:29,846] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 4: [2023-04-29 17:23:29,846] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 11: [2023-04-29 17:23:29,848] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 11: [2023-04-29 17:23:29,848] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 16: [2023-04-29 17:23:29,847] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 15: [2023-04-29 17:23:29,849] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 21: [2023-04-29 17:23:29,849] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 21: [2023-04-29 17:23:29,849] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 21: [2023-04-29 17:23:29,849] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 15: [2023-04-29 17:23:29,850] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 27: [2023-04-29 17:23:29,850] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 15: [2023-04-29 17:23:29,851] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 15: [2023-04-29 17:23:29,851] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 27: [2023-04-29 17:23:29,851] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 15: [2023-04-29 17:23:29,851] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 27: [2023-04-29 17:23:29,852] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 14: [2023-04-29 17:23:29,852] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 21: [2023-04-29 17:23:29,852] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 27: [2023-04-29 17:23:29,852] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 27: [2023-04-29 17:23:29,853] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 31: [2023-04-29 17:23:29,853] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 31: [2023-04-29 17:23:29,853] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 31: [2023-04-29 17:23:29,853] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 25: [2023-04-29 17:23:29,853] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 25: [2023-04-29 17:23:29,853] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 27: [2023-04-29 17:23:29,854] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 11: [2023-04-29 17:23:29,854] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 11: [2023-04-29 17:23:29,854] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 28: [2023-04-29 17:23:29,854] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 11: [2023-04-29 17:23:29,854] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 27: [2023-04-29 17:23:29,855] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 28: [2023-04-29 17:23:29,856] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 16: [2023-04-29 17:23:29,857] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 16: [2023-04-29 17:23:29,857] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 16: [2023-04-29 17:23:29,857] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 16: [2023-04-29 17:23:29,857] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 16: [2023-04-29 17:23:29,857] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 14: [2023-04-29 17:23:29,858] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 31: [2023-04-29 17:23:29,858] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 14: [2023-04-29 17:23:29,858] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 28: [2023-04-29 17:23:29,859] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 28: [2023-04-29 17:23:29,862] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 14: [2023-04-29 17:23:29,862] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 14: [2023-04-29 17:23:29,862] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 17: [2023-04-29 17:23:29,863] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 21: [2023-04-29 17:23:29,864] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 21: [2023-04-29 17:23:29,864] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 21: [2023-04-29 17:23:29,864] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 21: [2023-04-29 17:23:29,864] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 11: [2023-04-29 17:23:29,864] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 11: [2023-04-29 17:23:29,864] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 25: [2023-04-29 17:23:29,865] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 24: [2023-04-29 17:23:29,866] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 17: [2023-04-29 17:23:29,866] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 12: [2023-04-29 17:23:29,866] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 12: [2023-04-29 17:23:29,866] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 12: [2023-04-29 17:23:29,866] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 12: [2023-04-29 17:23:29,866] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 16: [2023-04-29 17:23:29,866] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 12: [2023-04-29 17:23:29,867] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 12: [2023-04-29 17:23:29,867] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 12: [2023-04-29 17:23:29,867] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 24: [2023-04-29 17:23:29,867] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 24: [2023-04-29 17:23:29,867] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 24: [2023-04-29 17:23:29,867] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 12: [2023-04-29 17:23:29,867] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 24: [2023-04-29 17:23:29,867] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 24: [2023-04-29 17:23:29,867] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 24: [2023-04-29 17:23:29,867] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 4: [2023-04-29 17:23:29,867] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 4: [2023-04-29 17:23:29,867] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 16: [2023-04-29 17:23:29,867] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 4: [2023-04-29 17:23:29,868] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 31: [2023-04-29 17:23:29,870] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 31: [2023-04-29 17:23:29,870] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 31: [2023-04-29 17:23:29,870] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 31: [2023-04-29 17:23:29,870] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 11: [2023-04-29 17:23:29,870] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 12: [2023-04-29 17:23:29,870] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 12: [2023-04-29 17:23:29,871] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 11: [2023-04-29 17:23:29,871] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 11: [2023-04-29 17:23:29,872] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 12: [2023-04-29 17:23:29,872] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 12: [2023-04-29 17:23:29,874] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 21: [2023-04-29 17:23:29,874] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 21: [2023-04-29 17:23:29,874] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 21: [2023-04-29 17:23:29,874] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 12: [2023-04-29 17:23:29,875] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 16: [2023-04-29 17:23:29,875] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 25: [2023-04-29 17:23:29,875] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 25: [2023-04-29 17:23:29,875] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 4: [2023-04-29 17:23:29,875] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 4: [2023-04-29 17:23:29,875] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 12: [2023-04-29 17:23:29,875] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 12: [2023-04-29 17:23:29,876] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 31: [2023-04-29 17:23:29,876] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 21: [2023-04-29 17:23:29,876] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 31: [2023-04-29 17:23:29,876] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 12: [2023-04-29 17:23:29,877] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 31: [2023-04-29 17:23:29,877] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 11: [2023-04-29 17:23:29,880] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 16: [2023-04-29 17:23:29,882] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 26: [2023-04-29 17:23:29,882] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 26: [2023-04-29 17:23:29,882] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 26: [2023-04-29 17:23:29,883] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 26: [2023-04-29 17:23:29,883] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 26: [2023-04-29 17:23:29,883] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 26: [2023-04-29 17:23:29,883] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 26: [2023-04-29 17:23:29,883] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 16: [2023-04-29 17:23:29,883] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 26: [2023-04-29 17:23:29,883] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 25: [2023-04-29 17:23:29,883] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 31: [2023-04-29 17:23:29,883] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 11: [2023-04-29 17:23:29,884] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 4: [2023-04-29 17:23:29,884] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 4: [2023-04-29 17:23:29,884] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 4: [2023-04-29 17:23:29,884] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 16: [2023-04-29 17:23:29,885] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 0: [2023-04-29 17:23:29,886] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 0: [2023-04-29 17:23:29,886] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 0: [2023-04-29 17:23:29,886] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 0: [2023-04-29 17:23:29,886] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 0: [2023-04-29 17:23:29,886] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 0: [2023-04-29 17:23:29,886] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 0: [2023-04-29 17:23:29,886] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 25: [2023-04-29 17:23:29,886] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 25: [2023-04-29 17:23:29,886] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 25: [2023-04-29 17:23:29,886] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 25: [2023-04-29 17:23:29,886] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 0: [2023-04-29 17:23:29,887] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 16: [2023-04-29 17:23:29,888] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 16: [2023-04-29 17:23:29,888] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 25: [2023-04-29 17:23:29,888] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 21: [2023-04-29 17:23:29,889] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 26: [2023-04-29 17:23:29,890] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 26: [2023-04-29 17:23:29,890] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 26: [2023-04-29 17:23:29,890] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 21: [2023-04-29 17:23:29,891] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 26: [2023-04-29 17:23:29,891] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 26: [2023-04-29 17:23:29,891] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 26: [2023-04-29 17:23:29,891] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 21: [2023-04-29 17:23:29,891] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 26: [2023-04-29 17:23:29,891] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 26: [2023-04-29 17:23:29,892] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 10: [2023-04-29 17:23:29,892] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 10: [2023-04-29 17:23:29,892] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 10: [2023-04-29 17:23:29,893] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 10: [2023-04-29 17:23:29,893] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 31: [2023-04-29 17:23:29,893] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 27: [2023-04-29 17:23:29,893] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 19: [2023-04-29 17:23:29,894] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 19: [2023-04-29 17:23:29,894] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 21: [2023-04-29 17:23:29,894] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 4: [2023-04-29 17:23:29,894] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 19: [2023-04-29 17:23:29,895] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 31: [2023-04-29 17:23:29,895] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 19: [2023-04-29 17:23:29,895] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 0: [2023-04-29 17:23:29,896] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 19: [2023-04-29 17:23:29,896] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 19: [2023-04-29 17:23:29,896] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 19: [2023-04-29 17:23:29,896] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 19: [2023-04-29 17:23:29,896] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 20: [2023-04-29 17:23:29,896] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 20: [2023-04-29 17:23:29,896] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 20: [2023-04-29 17:23:29,896] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 11: [2023-04-29 17:23:29,896] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 20: [2023-04-29 17:23:29,897] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 20: [2023-04-29 17:23:29,897] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 20: [2023-04-29 17:23:29,897] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 20: [2023-04-29 17:23:29,897] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 11: [2023-04-29 17:23:29,897] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 20: [2023-04-29 17:23:29,897] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 0: [2023-04-29 17:23:29,897] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 0: [2023-04-29 17:23:29,897] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 31: [2023-04-29 17:23:29,898] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 31: [2023-04-29 17:23:29,898] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 10: [2023-04-29 17:23:29,898] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 10: [2023-04-29 17:23:29,898] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 10: [2023-04-29 17:23:29,898] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 10: [2023-04-29 17:23:29,898] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 11: [2023-04-29 17:23:29,899] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 0: [2023-04-29 17:23:29,900] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 0: [2023-04-29 17:23:29,900] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 19: [2023-04-29 17:23:29,899] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 19: [2023-04-29 17:23:29,900] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 19: [2023-04-29 17:23:29,901] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 0: [2023-04-29 17:23:29,900] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 0: [2023-04-29 17:23:29,901] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 20: [2023-04-29 17:23:29,902] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 20: [2023-04-29 17:23:29,903] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 20: [2023-04-29 17:23:29,903] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 0: [2023-04-29 17:23:29,903] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 19: [2023-04-29 17:23:29,904] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 19: [2023-04-29 17:23:29,904] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 19: [2023-04-29 17:23:29,904] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 20: [2023-04-29 17:23:29,905] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 19: [2023-04-29 17:23:29,905] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 19: [2023-04-29 17:23:29,905] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 20: [2023-04-29 17:23:29,906] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 4: [2023-04-29 17:23:29,906] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 20: [2023-04-29 17:23:29,906] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 4: [2023-04-29 17:23:29,906] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 20: [2023-04-29 17:23:29,906] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 20: [2023-04-29 17:23:29,907] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 27: [2023-04-29 17:23:29,910] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 24: [2023-04-29 17:23:29,867] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 24: [2023-04-29 17:23:29,870] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 24: [2023-04-29 17:23:29,876] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 24: [2023-04-29 17:23:29,877] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 24: [2023-04-29 17:23:29,878] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 24: [2023-04-29 17:23:29,878] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 24: [2023-04-29 17:23:29,879] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 24: [2023-04-29 17:23:29,879] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 24: [2023-04-29 17:23:29,880] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 25: [2023-04-29 17:23:29,915] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 4: [2023-04-29 17:23:29,917] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 4: [2023-04-29 17:23:29,917] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 23: [2023-04-29 17:23:29,917] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 23: [2023-04-29 17:23:29,917] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 12: [2023-04-29 17:23:29,918] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 12: [2023-04-29 17:23:29,918] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 4: [2023-04-29 17:23:29,918] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 23: [2023-04-29 17:23:29,918] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 23: [2023-04-29 17:23:29,919] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 27: [2023-04-29 17:23:29,919] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 23: [2023-04-29 17:23:29,919] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 23: [2023-04-29 17:23:29,919] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 23: [2023-04-29 17:23:29,919] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 23: [2023-04-29 17:23:29,919] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 27: [2023-04-29 17:23:29,920] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 25: [2023-04-29 17:23:29,920] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 25: [2023-04-29 17:23:29,921] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 25: [2023-04-29 17:23:29,922] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 25: [2023-04-29 17:23:29,922] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 27: [2023-04-29 17:23:29,923] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 23: [2023-04-29 17:23:29,924] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 23: [2023-04-29 17:23:29,925] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 23: [2023-04-29 17:23:29,926] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 23: [2023-04-29 17:23:29,928] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 23: [2023-04-29 17:23:29,928] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 23: [2023-04-29 17:23:29,929] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 23: [2023-04-29 17:23:29,930] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 23: [2023-04-29 17:23:29,930] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 12: [2023-04-29 17:23:29,930] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 12: [2023-04-29 17:23:29,933] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 27: [2023-04-29 17:23:29,934] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 10: [2023-04-29 17:23:29,918] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 10: [2023-04-29 17:23:29,920] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 10: [2023-04-29 17:23:29,921] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 10: [2023-04-29 17:23:29,922] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 10: [2023-04-29 17:23:29,926] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 10: [2023-04-29 17:23:29,927] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 10: [2023-04-29 17:23:29,927] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 10: [2023-04-29 17:23:29,929] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 12: [2023-04-29 17:23:29,940] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 18: [2023-04-29 17:23:29,940] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 18: [2023-04-29 17:23:29,940] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 18: [2023-04-29 17:23:29,940] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 18: [2023-04-29 17:23:29,941] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 18: [2023-04-29 17:23:29,941] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 18: [2023-04-29 17:23:29,941] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 18: [2023-04-29 17:23:29,941] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 18: [2023-04-29 17:23:29,941] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 9: [2023-04-29 17:23:29,941] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 9: [2023-04-29 17:23:29,941] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 9: [2023-04-29 17:23:29,941] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 9: [2023-04-29 17:23:29,941] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 9: [2023-04-29 17:23:29,941] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 9: [2023-04-29 17:23:29,941] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 9: [2023-04-29 17:23:29,941] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 9: [2023-04-29 17:23:29,942] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 12: [2023-04-29 17:23:29,943] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 12: [2023-04-29 17:23:29,944] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 27: [2023-04-29 17:23:29,944] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 12: [2023-04-29 17:23:29,946] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 12: [2023-04-29 17:23:29,946] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 12: [2023-04-29 17:23:29,946] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 9: [2023-04-29 17:23:29,946] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 26: [2023-04-29 17:23:29,945] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 9: [2023-04-29 17:23:29,946] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 26: [2023-04-29 17:23:29,946] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 9: [2023-04-29 17:23:29,947] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 9: [2023-04-29 17:23:29,947] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 9: [2023-04-29 17:23:29,947] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 9: [2023-04-29 17:23:29,947] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 9: [2023-04-29 17:23:29,947] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 9: [2023-04-29 17:23:29,948] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 6: [2023-04-29 17:23:29,949] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 6: [2023-04-29 17:23:29,949] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 6: [2023-04-29 17:23:29,949] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 26: [2023-04-29 17:23:29,949] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 6: [2023-04-29 17:23:29,949] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 6: [2023-04-29 17:23:29,949] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 6: [2023-04-29 17:23:29,949] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 6: [2023-04-29 17:23:29,949] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 6: [2023-04-29 17:23:29,950] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 27: [2023-04-29 17:23:29,950] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 27: [2023-04-29 17:23:29,950] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 27: [2023-04-29 17:23:29,952] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 27: [2023-04-29 17:23:29,952] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 27: [2023-04-29 17:23:29,952] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 26: [2023-04-29 17:23:29,953] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 6: [2023-04-29 17:23:29,953] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 18: [2023-04-29 17:23:29,953] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 6: [2023-04-29 17:23:29,954] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 26: [2023-04-29 17:23:29,954] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 26: [2023-04-29 17:23:29,954] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 26: [2023-04-29 17:23:29,954] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 26: [2023-04-29 17:23:29,954] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 18: [2023-04-29 17:23:29,954] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 18: [2023-04-29 17:23:29,954] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 12: [2023-04-29 17:23:29,955] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 24: [2023-04-29 17:23:29,920] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 24: [2023-04-29 17:23:29,940] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 24: [2023-04-29 17:23:29,946] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 24: [2023-04-29 17:23:29,950] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 19: [2023-04-29 17:23:29,955] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 19: [2023-04-29 17:23:29,955] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 19: [2023-04-29 17:23:29,955] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 18: [2023-04-29 17:23:29,955] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 18: [2023-04-29 17:23:29,956] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 18: [2023-04-29 17:23:29,956] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 18: [2023-04-29 17:23:29,956] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 24: [2023-04-29 17:23:29,957] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 18: [2023-04-29 17:23:29,958] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 6: [2023-04-29 17:23:29,957] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 6: [2023-04-29 17:23:29,958] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 20: [2023-04-29 17:23:29,958] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 20: [2023-04-29 17:23:29,958] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 20: [2023-04-29 17:23:29,958] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 20: [2023-04-29 17:23:29,958] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 6: [2023-04-29 17:23:29,959] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 6: [2023-04-29 17:23:29,959] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 12: [2023-04-29 17:23:29,960] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 6: [2023-04-29 17:23:29,960] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 6: [2023-04-29 17:23:29,961] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 27: [2023-04-29 17:23:29,962] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 24: [2023-04-29 17:23:29,964] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 24: [2023-04-29 17:23:29,965] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 0: [2023-04-29 17:23:29,967] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 24: [2023-04-29 17:23:29,967] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 24: [2023-04-29 17:23:29,968] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 19: [2023-04-29 17:23:29,969] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 30: [2023-04-29 17:23:29,972] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 3: [2023-04-29 17:23:29,972] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 3: [2023-04-29 17:23:29,972] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 19: [2023-04-29 17:23:29,973] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 19: [2023-04-29 17:23:29,973] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 19: [2023-04-29 17:23:29,973] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 19: [2023-04-29 17:23:29,973] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 29: [2023-04-29 17:23:29,973] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 30: [2023-04-29 17:23:29,973] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 30: [2023-04-29 17:23:29,973] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 30: [2023-04-29 17:23:29,973] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 30: [2023-04-29 17:23:29,973] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 29: [2023-04-29 17:23:29,973] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 30: [2023-04-29 17:23:29,973] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 30: [2023-04-29 17:23:29,973] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 12: [2023-04-29 17:23:29,973] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 26: [2023-04-29 17:23:29,973] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 30: [2023-04-29 17:23:29,973] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 20: [2023-04-29 17:23:29,973] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 20: [2023-04-29 17:23:29,973] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 20: [2023-04-29 17:23:29,973] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 20: [2023-04-29 17:23:29,973] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 12: [2023-04-29 17:23:29,974] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 12: [2023-04-29 17:23:29,975] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 3: [2023-04-29 17:23:29,975] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 26: [2023-04-29 17:23:29,976] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 3: [2023-04-29 17:23:29,976] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 3: [2023-04-29 17:23:29,976] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 3: [2023-04-29 17:23:29,976] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 3: [2023-04-29 17:23:29,976] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 12: [2023-04-29 17:23:29,976] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 3: [2023-04-29 17:23:29,976] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 27: [2023-04-29 17:23:29,976] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 26: [2023-04-29 17:23:29,976] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 29: [2023-04-29 17:23:29,976] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 29: [2023-04-29 17:23:29,976] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 29: [2023-04-29 17:23:29,976] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 29: [2023-04-29 17:23:29,976] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 29: [2023-04-29 17:23:29,976] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 3: [2023-04-29 17:23:29,977] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 29: [2023-04-29 17:23:29,977] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 29: [2023-04-29 17:23:29,977] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 27: [2023-04-29 17:23:29,977] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 23: [2023-04-29 17:23:29,977] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 3: [2023-04-29 17:23:29,978] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 29: [2023-04-29 17:23:29,978] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 27: [2023-04-29 17:23:29,978] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 26: [2023-04-29 17:23:29,979] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 0: [2023-04-29 17:23:29,978] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 19: [2023-04-29 17:23:29,979] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 19: [2023-04-29 17:23:29,980] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 19: [2023-04-29 17:23:29,980] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 24: [2023-04-29 17:23:29,980] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 24: [2023-04-29 17:23:29,980] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 20: [2023-04-29 17:23:29,982] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 20: [2023-04-29 17:23:29,982] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 26: [2023-04-29 17:23:29,983] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 29: [2023-04-29 17:23:29,983] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 23: [2023-04-29 17:23:29,984] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 20: [2023-04-29 17:23:29,984] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 26: [2023-04-29 17:23:29,984] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 30: [2023-04-29 17:23:29,984] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 30: [2023-04-29 17:23:29,984] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 30: [2023-04-29 17:23:29,984] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 30: [2023-04-29 17:23:29,984] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 30: [2023-04-29 17:23:29,985] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 26: [2023-04-29 17:23:29,985] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 30: [2023-04-29 17:23:29,985] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 3: [2023-04-29 17:23:29,984] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 30: [2023-04-29 17:23:29,985] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 29: [2023-04-29 17:23:29,985] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 0: [2023-04-29 17:23:29,985] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 26: [2023-04-29 17:23:29,985] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 3: [2023-04-29 17:23:29,985] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 20: [2023-04-29 17:23:29,985] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 3: [2023-04-29 17:23:29,986] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 3: [2023-04-29 17:23:29,986] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 3: [2023-04-29 17:23:29,986] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 3: [2023-04-29 17:23:29,986] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 30: [2023-04-29 17:23:29,986] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 7: [2023-04-29 17:23:29,987] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 7: [2023-04-29 17:23:29,987] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 7: [2023-04-29 17:23:29,987] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 7: [2023-04-29 17:23:29,987] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 7: [2023-04-29 17:23:29,987] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 7: [2023-04-29 17:23:29,987] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 7: [2023-04-29 17:23:29,987] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 7: [2023-04-29 17:23:29,987] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 29: [2023-04-29 17:23:29,987] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 29: [2023-04-29 17:23:29,987] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 29: [2023-04-29 17:23:29,988] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 29: [2023-04-29 17:23:29,988] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 7: [2023-04-29 17:23:29,990] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 7: [2023-04-29 17:23:29,990] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 7: [2023-04-29 17:23:29,992] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 7: [2023-04-29 17:23:29,992] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 0: [2023-04-29 17:23:29,992] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 24: [2023-04-29 17:23:29,993] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 7: [2023-04-29 17:23:29,993] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 7: [2023-04-29 17:23:29,994] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 7: [2023-04-29 17:23:29,994] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 7: [2023-04-29 17:23:29,995] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 0: [2023-04-29 17:23:29,996] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 23: [2023-04-29 17:23:29,996] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 9: [2023-04-29 17:23:29,997] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 23: [2023-04-29 17:23:29,998] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 19: [2023-04-29 17:23:29,998] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 0: [2023-04-29 17:23:29,998] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 23: [2023-04-29 17:23:30,000] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 23: [2023-04-29 17:23:30,000] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 23: [2023-04-29 17:23:30,000] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 24: [2023-04-29 17:23:30,001] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 24: [2023-04-29 17:23:30,001] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 23: [2023-04-29 17:23:30,002] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 23: [2023-04-29 17:23:30,002] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 9: [2023-04-29 17:23:30,003] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 19: [2023-04-29 17:23:30,003] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 19: [2023-04-29 17:23:30,003] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 19: [2023-04-29 17:23:30,003] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 20: [2023-04-29 17:23:30,003] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 24: [2023-04-29 17:23:30,003] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 19: [2023-04-29 17:23:30,004] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 20: [2023-04-29 17:23:30,006] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 20: [2023-04-29 17:23:30,006] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 6: [2023-04-29 17:23:30,005] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 20: [2023-04-29 17:23:30,006] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 24: [2023-04-29 17:23:30,007] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 23: [2023-04-29 17:23:30,007] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 0: [2023-04-29 17:23:30,008] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 0: [2023-04-29 17:23:30,008] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 6: [2023-04-29 17:23:30,008] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 9: [2023-04-29 17:23:30,009] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 9: [2023-04-29 17:23:30,010] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 9: [2023-04-29 17:23:30,010] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 9: [2023-04-29 17:23:30,010] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 0: [2023-04-29 17:23:30,010] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 9: [2023-04-29 17:23:30,014] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 9: [2023-04-29 17:23:30,014] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 0: [2023-04-29 17:23:30,016] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 28: [2023-04-29 17:23:30,016] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 28: [2023-04-29 17:23:30,016] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 28: [2023-04-29 17:23:30,016] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 28: [2023-04-29 17:23:30,017] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 28: [2023-04-29 17:23:30,017] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 28: [2023-04-29 17:23:30,017] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 28: [2023-04-29 17:23:30,017] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 28: [2023-04-29 17:23:30,017] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 0: [2023-04-29 17:23:30,018] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 9: [2023-04-29 17:23:30,019] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 0: [2023-04-29 17:23:30,023] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 23: [2023-04-29 17:23:30,024] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 6: [2023-04-29 17:23:30,025] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 6: [2023-04-29 17:23:30,025] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 28: [2023-04-29 17:23:30,026] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 28: [2023-04-29 17:23:30,026] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 9: [2023-04-29 17:23:30,028] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 3: [2023-04-29 17:23:30,028] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 3: [2023-04-29 17:23:30,028] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 6: [2023-04-29 17:23:30,029] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 6: [2023-04-29 17:23:30,029] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 29: [2023-04-29 17:23:30,030] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 29: [2023-04-29 17:23:30,030] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 28: [2023-04-29 17:23:30,031] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 15: [2023-04-29 17:23:30,030] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 15: [2023-04-29 17:23:30,030] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 15: [2023-04-29 17:23:30,030] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 15: [2023-04-29 17:23:30,030] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 15: [2023-04-29 17:23:30,030] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 28: [2023-04-29 17:23:30,031] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 28: [2023-04-29 17:23:30,031] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 23: [2023-04-29 17:23:30,031] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 28: [2023-04-29 17:23:30,031] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 28: [2023-04-29 17:23:30,032] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 23: [2023-04-29 17:23:30,032] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 18: [2023-04-29 17:23:30,032] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 18: [2023-04-29 17:23:30,032] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 6: [2023-04-29 17:23:30,033] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 28: [2023-04-29 17:23:30,033] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 0: [2023-04-29 17:23:30,033] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 18: [2023-04-29 17:23:30,035] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 23: [2023-04-29 17:23:30,037] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 23: [2023-04-29 17:23:30,037] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 7: [2023-04-29 17:23:30,037] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 7: [2023-04-29 17:23:30,037] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 9: [2023-04-29 17:23:30,039] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 9: [2023-04-29 17:23:30,039] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 23: [2023-04-29 17:23:30,039] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 9: [2023-04-29 17:23:30,039] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 9: [2023-04-29 17:23:30,042] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 0: [2023-04-29 17:23:30,042] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 9: [2023-04-29 17:23:30,042] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 0: [2023-04-29 17:23:30,042] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 6: [2023-04-29 17:23:30,043] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 6: [2023-04-29 17:23:30,043] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 6: [2023-04-29 17:23:30,043] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 0: [2023-04-29 17:23:30,043] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 18: [2023-04-29 17:23:30,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 18: [2023-04-29 17:23:30,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 18: [2023-04-29 17:23:30,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 18: [2023-04-29 17:23:30,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 18: [2023-04-29 17:23:30,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 9: [2023-04-29 17:23:30,046] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 1: [2023-04-29 17:23:30,046] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 1: [2023-04-29 17:23:30,046] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 1: [2023-04-29 17:23:30,048] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 1: [2023-04-29 17:23:30,048] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 1: [2023-04-29 17:23:30,048] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 1: [2023-04-29 17:23:30,048] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 1: [2023-04-29 17:23:30,048] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 1: [2023-04-29 17:23:30,049] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 3: [2023-04-29 17:23:30,051] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 29: [2023-04-29 17:23:30,051] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 7: [2023-04-29 17:23:30,052] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 29: [2023-04-29 17:23:30,052] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 3: [2023-04-29 17:23:30,052] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 3: [2023-04-29 17:23:30,053] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 1: [2023-04-29 17:23:30,052] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 1: [2023-04-29 17:23:30,053] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 1: [2023-04-29 17:23:30,053] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 29: [2023-04-29 17:23:30,053] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 1: [2023-04-29 17:23:30,054] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 6: [2023-04-29 17:23:30,054] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 6: [2023-04-29 17:23:30,054] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 7: [2023-04-29 17:23:30,054] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 1: [2023-04-29 17:23:30,054] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 1: [2023-04-29 17:23:30,054] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 1: [2023-04-29 17:23:30,055] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 1: [2023-04-29 17:23:30,056] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 30: [2023-04-29 17:23:30,056] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 29: [2023-04-29 17:23:30,057] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 3: [2023-04-29 17:23:30,058] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 3: [2023-04-29 17:23:30,058] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 3: [2023-04-29 17:23:30,058] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 3: [2023-04-29 17:23:30,058] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 3: [2023-04-29 17:23:30,058] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 22: [2023-04-29 17:23:30,058] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 22: [2023-04-29 17:23:30,058] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 7: [2023-04-29 17:23:30,059] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 7: [2023-04-29 17:23:30,059] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 18: [2023-04-29 17:23:30,060] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 22: [2023-04-29 17:23:30,061] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 29: [2023-04-29 17:23:30,061] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 22: [2023-04-29 17:23:30,061] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 22: [2023-04-29 17:23:30,061] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 22: [2023-04-29 17:23:30,061] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 22: [2023-04-29 17:23:30,061] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 22: [2023-04-29 17:23:30,061] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 22: [2023-04-29 17:23:30,063] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 22: [2023-04-29 17:23:30,063] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 6: [2023-04-29 17:23:30,066] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 18: [2023-04-29 17:23:30,067] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 29: [2023-04-29 17:23:30,067] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 29: [2023-04-29 17:23:30,067] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 7: [2023-04-29 17:23:30,068] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 7: [2023-04-29 17:23:30,068] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 7: [2023-04-29 17:23:30,068] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 7: [2023-04-29 17:23:30,068] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 18: [2023-04-29 17:23:30,069] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 22: [2023-04-29 17:23:30,070] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 22: [2023-04-29 17:23:30,071] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 22: [2023-04-29 17:23:30,072] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 22: [2023-04-29 17:23:30,072] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 22: [2023-04-29 17:23:30,072] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 22: [2023-04-29 17:23:30,073] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 29: [2023-04-29 17:23:30,074] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 6: [2023-04-29 17:23:30,074] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 13: [2023-04-29 17:23:30,074] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 15: [2023-04-29 17:23:30,030] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 15: [2023-04-29 17:23:30,030] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 15: [2023-04-29 17:23:30,031] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 15: [2023-04-29 17:23:30,043] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 15: [2023-04-29 17:23:30,043] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 15: [2023-04-29 17:23:30,043] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 15: [2023-04-29 17:23:30,044] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 15: [2023-04-29 17:23:30,044] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 15: [2023-04-29 17:23:30,045] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 15: [2023-04-29 17:23:30,046] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 15: [2023-04-29 17:23:30,046] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt... 13: [2023-04-29 17:23:30,075] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 6: [2023-04-29 17:23:30,075] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 30: [2023-04-29 17:23:30,076] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 30: [2023-04-29 17:23:30,076] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 30: [2023-04-29 17:23:30,076] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 30: [2023-04-29 17:23:30,076] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 30: [2023-04-29 17:23:30,076] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 7: [2023-04-29 17:23:30,076] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 6: [2023-04-29 17:23:30,077] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 3: [2023-04-29 17:23:30,078] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 13: [2023-04-29 17:23:30,077] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 13: [2023-04-29 17:23:30,078] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 13: [2023-04-29 17:23:30,078] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 13: [2023-04-29 17:23:30,078] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 13: [2023-04-29 17:23:30,078] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 7: [2023-04-29 17:23:30,078] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 13: [2023-04-29 17:23:30,078] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 13: [2023-04-29 17:23:30,079] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 29: [2023-04-29 17:23:30,081] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 13: [2023-04-29 17:23:30,083] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 13: [2023-04-29 17:23:30,083] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 18: [2023-04-29 17:23:30,085] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 3: [2023-04-29 17:23:30,087] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 29: [2023-04-29 17:23:30,088] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 13: [2023-04-29 17:23:30,088] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 13: [2023-04-29 17:23:30,088] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 18: [2023-04-29 17:23:30,088] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 3: [2023-04-29 17:23:30,089] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 13: [2023-04-29 17:23:30,089] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 13: [2023-04-29 17:23:30,090] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 13: [2023-04-29 17:23:30,090] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 29: [2023-04-29 17:23:30,090] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 18: [2023-04-29 17:23:30,091] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 3: [2023-04-29 17:23:30,092] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 18: [2023-04-29 17:23:30,092] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 18: [2023-04-29 17:23:30,092] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 3: [2023-04-29 17:23:30,093] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 3: [2023-04-29 17:23:30,093] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 28: [2023-04-29 17:23:30,093] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 7: [2023-04-29 17:23:30,094] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 7: [2023-04-29 17:23:30,098] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 29: [2023-04-29 17:23:30,099] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 7: [2023-04-29 17:23:30,101] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 7: [2023-04-29 17:23:30,101] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 29: [2023-04-29 17:23:30,102] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 29: [2023-04-29 17:23:30,104] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 1: [2023-04-29 17:23:30,106] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 1: [2023-04-29 17:23:30,108] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 28: [2023-04-29 17:23:30,110] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 28: [2023-04-29 17:23:30,111] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 1: [2023-04-29 17:23:30,113] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 1: [2023-04-29 17:23:30,113] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 1: [2023-04-29 17:23:30,113] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 22: [2023-04-29 17:23:30,114] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 22: [2023-04-29 17:23:30,114] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 1: [2023-04-29 17:23:30,116] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 15: [2023-04-29 17:23:30,116] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 30: [2023-04-29 17:23:30,076] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 30: [2023-04-29 17:23:30,076] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 30: [2023-04-29 17:23:30,081] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 30: [2023-04-29 17:23:30,110] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 30: [2023-04-29 17:23:30,112] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 30: [2023-04-29 17:23:30,113] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 30: [2023-04-29 17:23:30,115] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 30: [2023-04-29 17:23:30,115] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 30: [2023-04-29 17:23:30,118] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 30: [2023-04-29 17:23:30,118] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 1: [2023-04-29 17:23:30,121] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 1: [2023-04-29 17:23:30,123] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 28: [2023-04-29 17:23:30,124] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 15: [2023-04-29 17:23:30,126] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 15: [2023-04-29 17:23:30,126] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 15: [2023-04-29 17:23:30,126] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 28: [2023-04-29 17:23:30,127] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 28: [2023-04-29 17:23:30,127] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 28: [2023-04-29 17:23:30,127] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 28: [2023-04-29 17:23:30,127] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 28: [2023-04-29 17:23:30,127] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 13: [2023-04-29 17:23:30,133] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 1: [2023-04-29 17:23:30,133] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 15: [2023-04-29 17:23:30,133] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 15: [2023-04-29 17:23:30,133] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 15: [2023-04-29 17:23:30,133] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 15: [2023-04-29 17:23:30,134] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_31-model_00-model_states.pt. 14: [2023-04-29 17:23:30,133] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 14: [2023-04-29 17:23:30,133] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 14: [2023-04-29 17:23:30,133] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 14: [2023-04-29 17:23:30,133] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 14: [2023-04-29 17:23:30,134] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 14: [2023-04-29 17:23:30,134] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 14: [2023-04-29 17:23:30,134] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 14: [2023-04-29 17:23:30,134] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 1: [2023-04-29 17:23:30,136] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 22: [2023-04-29 17:23:30,136] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 22: [2023-04-29 17:23:30,136] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 14: [2023-04-29 17:23:30,137] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 14: [2023-04-29 17:23:30,137] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 1: [2023-04-29 17:23:30,137] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 13: [2023-04-29 17:23:30,138] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 22: [2023-04-29 17:23:30,139] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 22: [2023-04-29 17:23:30,139] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 1: [2023-04-29 17:23:30,139] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 22: [2023-04-29 17:23:30,140] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 15: [2023-04-29 17:23:30,142] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 1: [2023-04-29 17:23:30,143] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 14: [2023-04-29 17:23:30,143] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 14: [2023-04-29 17:23:30,143] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 22: [2023-04-29 17:23:30,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 22: [2023-04-29 17:23:30,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 22: [2023-04-29 17:23:30,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 14: [2023-04-29 17:23:30,144] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 28: [2023-04-29 17:23:30,144] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 28: [2023-04-29 17:23:30,144] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 14: [2023-04-29 17:23:30,144] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 1: [2023-04-29 17:23:30,145] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 14: [2023-04-29 17:23:30,145] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 14: [2023-04-29 17:23:30,145] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 1: [2023-04-29 17:23:30,150] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 1: [2023-04-29 17:23:30,151] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 2: [2023-04-29 17:23:30,152] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 2: [2023-04-29 17:23:30,152] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 2: [2023-04-29 17:23:30,154] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 13: [2023-04-29 17:23:30,154] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 13: [2023-04-29 17:23:30,154] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 2: [2023-04-29 17:23:30,154] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 2: [2023-04-29 17:23:30,154] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 13: [2023-04-29 17:23:30,154] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 2: [2023-04-29 17:23:30,154] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 2: [2023-04-29 17:23:30,154] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 2: [2023-04-29 17:23:30,155] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 2: [2023-04-29 17:23:30,156] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 2: [2023-04-29 17:23:30,157] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 17: [2023-04-29 17:23:30,157] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 17: [2023-04-29 17:23:30,157] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 17: [2023-04-29 17:23:30,158] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 17: [2023-04-29 17:23:30,158] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 17: [2023-04-29 17:23:30,158] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 17: [2023-04-29 17:23:30,158] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 17: [2023-04-29 17:23:30,158] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 17: [2023-04-29 17:23:30,158] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 2: [2023-04-29 17:23:30,158] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 15: [2023-04-29 17:23:30,159] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 15: [2023-04-29 17:23:30,159] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 13: [2023-04-29 17:23:30,161] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 13: [2023-04-29 17:23:30,161] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 13: [2023-04-29 17:23:30,161] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 28: [2023-04-29 17:23:30,160] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 28: [2023-04-29 17:23:30,162] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 17: [2023-04-29 17:23:30,162] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 28: [2023-04-29 17:23:30,162] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 15: [2023-04-29 17:23:30,162] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 28: [2023-04-29 17:23:30,163] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 2: [2023-04-29 17:23:30,163] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 2: [2023-04-29 17:23:30,163] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 17: [2023-04-29 17:23:30,163] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 2: [2023-04-29 17:23:30,164] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 2: [2023-04-29 17:23:30,165] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 2: [2023-04-29 17:23:30,165] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 28: [2023-04-29 17:23:30,165] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 13: [2023-04-29 17:23:30,166] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 17: [2023-04-29 17:23:30,167] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 17: [2023-04-29 17:23:30,168] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 17: [2023-04-29 17:23:30,169] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 15: [2023-04-29 17:23:30,169] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 17: [2023-04-29 17:23:30,169] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 17: [2023-04-29 17:23:30,169] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 11: [2023-04-29 17:23:30,169] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 11: [2023-04-29 17:23:30,169] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 11: [2023-04-29 17:23:30,170] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 17: [2023-04-29 17:23:30,170] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 11: [2023-04-29 17:23:30,170] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 11: [2023-04-29 17:23:30,170] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 11: [2023-04-29 17:23:30,170] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 11: [2023-04-29 17:23:30,170] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 11: [2023-04-29 17:23:30,170] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 15: [2023-04-29 17:23:30,171] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 15: [2023-04-29 17:23:30,172] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 22: [2023-04-29 17:23:30,173] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 15: [2023-04-29 17:23:30,174] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 11: [2023-04-29 17:23:30,174] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 11: [2023-04-29 17:23:30,175] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 13: [2023-04-29 17:23:30,175] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 11: [2023-04-29 17:23:30,175] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 22: [2023-04-29 17:23:30,176] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 22: [2023-04-29 17:23:30,176] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 22: [2023-04-29 17:23:30,176] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 11: [2023-04-29 17:23:30,177] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 11: [2023-04-29 17:23:30,179] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 11: [2023-04-29 17:23:30,180] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 11: [2023-04-29 17:23:30,180] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 11: [2023-04-29 17:23:30,180] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 22: [2023-04-29 17:23:30,183] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 13: [2023-04-29 17:23:30,183] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 22: [2023-04-29 17:23:30,183] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 13: [2023-04-29 17:23:30,184] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 21: [2023-04-29 17:23:30,184] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 21: [2023-04-29 17:23:30,184] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 21: [2023-04-29 17:23:30,185] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 21: [2023-04-29 17:23:30,185] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 21: [2023-04-29 17:23:30,185] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 21: [2023-04-29 17:23:30,185] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 21: [2023-04-29 17:23:30,185] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 21: [2023-04-29 17:23:30,185] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 14: [2023-04-29 17:23:30,187] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 13: [2023-04-29 17:23:30,189] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 14: [2023-04-29 17:23:30,190] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 21: [2023-04-29 17:23:30,190] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 21: [2023-04-29 17:23:30,190] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 21: [2023-04-29 17:23:30,190] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 21: [2023-04-29 17:23:30,190] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 13: [2023-04-29 17:23:30,191] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 21: [2023-04-29 17:23:30,191] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 21: [2023-04-29 17:23:30,191] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 21: [2023-04-29 17:23:30,192] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 21: [2023-04-29 17:23:30,192] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 13: [2023-04-29 17:23:30,193] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 8: [2023-04-29 17:23:30,199] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 8: [2023-04-29 17:23:30,199] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 8: [2023-04-29 17:23:30,201] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 8: [2023-04-29 17:23:30,201] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 8: [2023-04-29 17:23:30,201] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 8: [2023-04-29 17:23:30,201] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 8: [2023-04-29 17:23:30,201] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 8: [2023-04-29 17:23:30,201] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 13: [2023-04-29 17:23:30,205] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 31: [2023-04-29 17:23:30,205] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 31: [2023-04-29 17:23:30,205] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 31: [2023-04-29 17:23:30,205] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 31: [2023-04-29 17:23:30,206] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 31: [2023-04-29 17:23:30,206] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 31: [2023-04-29 17:23:30,206] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 14: [2023-04-29 17:23:30,206] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 31: [2023-04-29 17:23:30,206] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 31: [2023-04-29 17:23:30,206] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 14: [2023-04-29 17:23:30,208] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 8: [2023-04-29 17:23:30,208] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 8: [2023-04-29 17:23:30,208] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 8: [2023-04-29 17:23:30,208] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 8: [2023-04-29 17:23:30,208] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 8: [2023-04-29 17:23:30,209] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 8: [2023-04-29 17:23:30,209] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 8: [2023-04-29 17:23:30,210] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 8: [2023-04-29 17:23:30,211] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 31: [2023-04-29 17:23:30,210] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 31: [2023-04-29 17:23:30,210] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 31: [2023-04-29 17:23:30,211] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 2: [2023-04-29 17:23:30,210] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 2: [2023-04-29 17:23:30,210] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 2: [2023-04-29 17:23:30,210] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 31: [2023-04-29 17:23:30,211] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 5: [2023-04-29 17:23:30,211] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 5: [2023-04-29 17:23:30,211] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 31: [2023-04-29 17:23:30,212] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 31: [2023-04-29 17:23:30,212] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 31: [2023-04-29 17:23:30,213] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 31: [2023-04-29 17:23:30,213] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 5: [2023-04-29 17:23:30,214] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 5: [2023-04-29 17:23:30,214] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 5: [2023-04-29 17:23:30,214] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 5: [2023-04-29 17:23:30,214] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 5: [2023-04-29 17:23:30,214] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 5: [2023-04-29 17:23:30,215] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 14: [2023-04-29 17:23:30,215] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 14: [2023-04-29 17:23:30,215] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 5: [2023-04-29 17:23:30,216] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 5: [2023-04-29 17:23:30,216] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 17: [2023-04-29 17:23:30,216] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 17: [2023-04-29 17:23:30,218] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 4: [2023-04-29 17:23:30,218] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 4: [2023-04-29 17:23:30,218] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 14: [2023-04-29 17:23:30,218] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 14: [2023-04-29 17:23:30,218] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 14: [2023-04-29 17:23:30,218] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 14: [2023-04-29 17:23:30,218] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 4: [2023-04-29 17:23:30,219] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 4: [2023-04-29 17:23:30,219] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 4: [2023-04-29 17:23:30,219] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 4: [2023-04-29 17:23:30,219] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 4: [2023-04-29 17:23:30,219] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 4: [2023-04-29 17:23:30,219] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 2: [2023-04-29 17:23:30,222] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 4: [2023-04-29 17:23:30,223] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 4: [2023-04-29 17:23:30,223] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 5: [2023-04-29 17:23:30,224] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 5: [2023-04-29 17:23:30,224] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 5: [2023-04-29 17:23:30,224] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 5: [2023-04-29 17:23:30,224] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 5: [2023-04-29 17:23:30,225] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 5: [2023-04-29 17:23:30,227] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 2: [2023-04-29 17:23:30,228] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 2: [2023-04-29 17:23:30,228] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 11: [2023-04-29 17:23:30,228] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 11: [2023-04-29 17:23:30,228] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 11: [2023-04-29 17:23:30,228] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 4: [2023-04-29 17:23:30,230] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 4: [2023-04-29 17:23:30,230] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 4: [2023-04-29 17:23:30,230] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 26: [2023-04-29 17:23:30,230] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 26: [2023-04-29 17:23:30,230] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 26: [2023-04-29 17:23:30,230] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 26: [2023-04-29 17:23:30,230] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 26: [2023-04-29 17:23:30,230] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 26: [2023-04-29 17:23:30,230] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 26: [2023-04-29 17:23:30,230] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 26: [2023-04-29 17:23:30,231] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 4: [2023-04-29 17:23:30,231] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 4: [2023-04-29 17:23:30,232] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 4: [2023-04-29 17:23:30,233] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 2: [2023-04-29 17:23:30,233] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 2: [2023-04-29 17:23:30,234] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 2: [2023-04-29 17:23:30,235] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 2: [2023-04-29 17:23:30,235] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 2: [2023-04-29 17:23:30,236] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 26: [2023-04-29 17:23:30,236] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 26: [2023-04-29 17:23:30,236] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 26: [2023-04-29 17:23:30,236] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 26: [2023-04-29 17:23:30,237] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 26: [2023-04-29 17:23:30,237] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 26: [2023-04-29 17:23:30,238] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 16: [2023-04-29 17:23:30,237] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 16: [2023-04-29 17:23:30,237] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 16: [2023-04-29 17:23:30,237] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 17: [2023-04-29 17:23:30,238] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 16: [2023-04-29 17:23:30,238] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 16: [2023-04-29 17:23:30,238] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 16: [2023-04-29 17:23:30,238] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 16: [2023-04-29 17:23:30,238] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 26: [2023-04-29 17:23:30,238] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 16: [2023-04-29 17:23:30,238] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 26: [2023-04-29 17:23:30,238] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 17: [2023-04-29 17:23:30,240] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 17: [2023-04-29 17:23:30,240] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 17: [2023-04-29 17:23:30,240] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 11: [2023-04-29 17:23:30,240] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 14: [2023-04-29 17:23:30,243] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 17: [2023-04-29 17:23:30,243] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 17: [2023-04-29 17:23:30,244] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 17: [2023-04-29 17:23:30,244] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 16: [2023-04-29 17:23:30,243] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 16: [2023-04-29 17:23:30,243] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 16: [2023-04-29 17:23:30,244] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 17: [2023-04-29 17:23:30,244] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 16: [2023-04-29 17:23:30,244] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 16: [2023-04-29 17:23:30,245] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 14: [2023-04-29 17:23:30,245] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 16: [2023-04-29 17:23:30,245] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 16: [2023-04-29 17:23:30,245] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 16: [2023-04-29 17:23:30,245] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 21: [2023-04-29 17:23:30,246] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 21: [2023-04-29 17:23:30,246] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 21: [2023-04-29 17:23:30,246] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 11: [2023-04-29 17:23:30,247] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 11: [2023-04-29 17:23:30,247] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 11: [2023-04-29 17:23:30,247] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 11: [2023-04-29 17:23:30,248] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 11: [2023-04-29 17:23:30,249] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 2: [2023-04-29 17:23:30,250] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 21: [2023-04-29 17:23:30,250] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 21: [2023-04-29 17:23:30,250] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 11: [2023-04-29 17:23:30,250] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 11: [2023-04-29 17:23:30,250] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 14: [2023-04-29 17:23:30,252] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 14: [2023-04-29 17:23:30,253] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 14: [2023-04-29 17:23:30,255] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 14: [2023-04-29 17:23:30,255] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 2: [2023-04-29 17:23:30,257] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 2: [2023-04-29 17:23:30,258] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 21: [2023-04-29 17:23:30,263] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 21: [2023-04-29 17:23:30,263] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 21: [2023-04-29 17:23:30,263] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 25: [2023-04-29 17:23:30,264] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 25: [2023-04-29 17:23:30,264] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 8: [2023-04-29 17:23:30,264] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 0: [2023-04-29 17:23:30,264] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 0: [2023-04-29 17:23:30,264] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 0: [2023-04-29 17:23:30,264] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 0: [2023-04-29 17:23:30,265] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 0: [2023-04-29 17:23:30,265] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 0: [2023-04-29 17:23:30,265] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 0: [2023-04-29 17:23:30,265] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 2: [2023-04-29 17:23:30,265] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 0: [2023-04-29 17:23:30,265] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 10: [2023-04-29 17:23:30,265] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 10: [2023-04-29 17:23:30,265] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 31: [2023-04-29 17:23:30,265] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 31: [2023-04-29 17:23:30,265] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 31: [2023-04-29 17:23:30,265] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 17: [2023-04-29 17:23:30,266] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 10: [2023-04-29 17:23:30,266] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 10: [2023-04-29 17:23:30,266] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 8: [2023-04-29 17:23:30,266] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 10: [2023-04-29 17:23:30,267] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 10: [2023-04-29 17:23:30,267] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 10: [2023-04-29 17:23:30,267] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 10: [2023-04-29 17:23:30,267] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 8: [2023-04-29 17:23:30,267] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 2: [2023-04-29 17:23:30,267] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 5: [2023-04-29 17:23:30,268] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 5: [2023-04-29 17:23:30,268] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 25: [2023-04-29 17:23:30,268] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 25: [2023-04-29 17:23:30,268] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 25: [2023-04-29 17:23:30,268] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 25: [2023-04-29 17:23:30,268] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 25: [2023-04-29 17:23:30,268] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 25: [2023-04-29 17:23:30,268] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 8: [2023-04-29 17:23:30,268] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 25: [2023-04-29 17:23:30,268] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 25: [2023-04-29 17:23:30,269] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 31: [2023-04-29 17:23:30,269] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 20: [2023-04-29 17:23:30,269] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 20: [2023-04-29 17:23:30,269] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 20: [2023-04-29 17:23:30,269] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 20: [2023-04-29 17:23:30,270] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 20: [2023-04-29 17:23:30,270] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 20: [2023-04-29 17:23:30,270] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 20: [2023-04-29 17:23:30,270] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 20: [2023-04-29 17:23:30,270] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 17: [2023-04-29 17:23:30,270] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 21: [2023-04-29 17:23:30,270] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 10: [2023-04-29 17:23:30,270] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 10: [2023-04-29 17:23:30,271] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 21: [2023-04-29 17:23:30,271] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 11: [2023-04-29 17:23:30,271] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 21: [2023-04-29 17:23:30,271] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 10: [2023-04-29 17:23:30,271] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 10: [2023-04-29 17:23:30,272] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 27: [2023-04-29 17:23:30,273] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 27: [2023-04-29 17:23:30,273] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 0: [2023-04-29 17:23:30,273] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 27: [2023-04-29 17:23:30,273] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 27: [2023-04-29 17:23:30,273] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 27: [2023-04-29 17:23:30,273] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 27: [2023-04-29 17:23:30,273] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 27: [2023-04-29 17:23:30,273] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 20: [2023-04-29 17:23:30,274] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 27: [2023-04-29 17:23:30,274] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 8: [2023-04-29 17:23:30,274] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 8: [2023-04-29 17:23:30,274] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 4: [2023-04-29 17:23:30,274] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 4: [2023-04-29 17:23:30,274] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 10: [2023-04-29 17:23:30,274] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 20: [2023-04-29 17:23:30,275] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 20: [2023-04-29 17:23:30,275] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 27: [2023-04-29 17:23:30,275] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 10: [2023-04-29 17:23:30,275] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 21: [2023-04-29 17:23:30,276] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 11: [2023-04-29 17:23:30,276] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 11: [2023-04-29 17:23:30,276] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 8: [2023-04-29 17:23:30,276] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 8: [2023-04-29 17:23:30,276] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 10: [2023-04-29 17:23:30,276] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 0: [2023-04-29 17:23:30,276] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 20: [2023-04-29 17:23:30,276] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 17: [2023-04-29 17:23:30,277] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 10: [2023-04-29 17:23:30,277] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 25: [2023-04-29 17:23:30,276] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 0: [2023-04-29 17:23:30,277] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 11: [2023-04-29 17:23:30,277] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 21: [2023-04-29 17:23:30,277] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 17: [2023-04-29 17:23:30,278] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 25: [2023-04-29 17:23:30,278] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 0: [2023-04-29 17:23:30,278] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 20: [2023-04-29 17:23:30,278] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 20: [2023-04-29 17:23:30,278] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 17: [2023-04-29 17:23:30,278] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 25: [2023-04-29 17:23:30,279] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 17: [2023-04-29 17:23:30,279] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 0: [2023-04-29 17:23:30,279] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 12: [2023-04-29 17:23:30,279] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 12: [2023-04-29 17:23:30,279] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 25: [2023-04-29 17:23:30,279] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 20: [2023-04-29 17:23:30,279] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 25: [2023-04-29 17:23:30,280] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 20: [2023-04-29 17:23:30,280] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 25: [2023-04-29 17:23:30,280] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 11: [2023-04-29 17:23:30,280] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 12: [2023-04-29 17:23:30,280] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 12: [2023-04-29 17:23:30,280] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 12: [2023-04-29 17:23:30,280] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 12: [2023-04-29 17:23:30,280] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 0: [2023-04-29 17:23:30,280] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 12: [2023-04-29 17:23:30,280] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 12: [2023-04-29 17:23:30,281] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 0: [2023-04-29 17:23:30,281] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 0: [2023-04-29 17:23:30,283] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 31: [2023-04-29 17:23:30,282] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 31: [2023-04-29 17:23:30,282] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 31: [2023-04-29 17:23:30,282] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 31: [2023-04-29 17:23:30,283] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 5: [2023-04-29 17:23:30,284] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 27: [2023-04-29 17:23:30,284] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 27: [2023-04-29 17:23:30,285] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 27: [2023-04-29 17:23:30,285] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 27: [2023-04-29 17:23:30,286] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 27: [2023-04-29 17:23:30,286] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 12: [2023-04-29 17:23:30,286] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 12: [2023-04-29 17:23:30,287] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 27: [2023-04-29 17:23:30,287] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 31: [2023-04-29 17:23:30,287] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 12: [2023-04-29 17:23:30,287] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 27: [2023-04-29 17:23:30,287] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 12: [2023-04-29 17:23:30,287] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 5: [2023-04-29 17:23:30,288] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 21: [2023-04-29 17:23:30,288] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 31: [2023-04-29 17:23:30,288] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 31: [2023-04-29 17:23:30,288] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 5: [2023-04-29 17:23:30,288] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 12: [2023-04-29 17:23:30,288] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 12: [2023-04-29 17:23:30,288] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 12: [2023-04-29 17:23:30,288] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 26: [2023-04-29 17:23:30,288] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 21: [2023-04-29 17:23:30,289] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 12: [2023-04-29 17:23:30,289] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 8: [2023-04-29 17:23:30,290] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 8: [2023-04-29 17:23:30,290] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 21: [2023-04-29 17:23:30,290] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 8: [2023-04-29 17:23:30,291] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 26: [2023-04-29 17:23:30,292] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 26: [2023-04-29 17:23:30,292] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 31: [2023-04-29 17:23:30,292] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 9: [2023-04-29 17:23:30,292] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 9: [2023-04-29 17:23:30,292] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 9: [2023-04-29 17:23:30,292] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 9: [2023-04-29 17:23:30,292] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 9: [2023-04-29 17:23:30,292] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 9: [2023-04-29 17:23:30,292] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 9: [2023-04-29 17:23:30,292] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 9: [2023-04-29 17:23:30,293] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 26: [2023-04-29 17:23:30,293] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 4: [2023-04-29 17:23:30,295] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 24: [2023-04-29 17:23:30,295] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 24: [2023-04-29 17:23:30,296] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 24: [2023-04-29 17:23:30,296] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 24: [2023-04-29 17:23:30,296] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 8: [2023-04-29 17:23:30,296] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 24: [2023-04-29 17:23:30,296] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 24: [2023-04-29 17:23:30,296] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 24: [2023-04-29 17:23:30,296] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 4: [2023-04-29 17:23:30,296] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 24: [2023-04-29 17:23:30,296] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 9: [2023-04-29 17:23:30,297] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 9: [2023-04-29 17:23:30,297] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 9: [2023-04-29 17:23:30,298] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 9: [2023-04-29 17:23:30,298] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 9: [2023-04-29 17:23:30,298] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 9: [2023-04-29 17:23:30,298] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 9: [2023-04-29 17:23:30,299] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 9: [2023-04-29 17:23:30,299] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 5: [2023-04-29 17:23:30,299] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 5: [2023-04-29 17:23:30,299] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 5: [2023-04-29 17:23:30,299] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 5: [2023-04-29 17:23:30,299] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 16: [2023-04-29 17:23:30,298] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 16: [2023-04-29 17:23:30,299] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 24: [2023-04-29 17:23:30,299] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 5: [2023-04-29 17:23:30,302] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 4: [2023-04-29 17:23:30,302] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 4: [2023-04-29 17:23:30,302] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 4: [2023-04-29 17:23:30,302] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 4: [2023-04-29 17:23:30,302] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 16: [2023-04-29 17:23:30,303] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 4: [2023-04-29 17:23:30,303] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 4: [2023-04-29 17:23:30,304] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 8: [2023-04-29 17:23:30,305] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 16: [2023-04-29 17:23:30,305] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 23: [2023-04-29 17:23:30,305] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 23: [2023-04-29 17:23:30,305] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 26: [2023-04-29 17:23:30,305] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 26: [2023-04-29 17:23:30,305] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 26: [2023-04-29 17:23:30,306] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 8: [2023-04-29 17:23:30,305] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 8: [2023-04-29 17:23:30,306] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 26: [2023-04-29 17:23:30,306] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 24: [2023-04-29 17:23:30,305] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 24: [2023-04-29 17:23:30,305] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 8: [2023-04-29 17:23:30,306] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 24: [2023-04-29 17:23:30,307] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 24: [2023-04-29 17:23:30,307] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 24: [2023-04-29 17:23:30,308] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 24: [2023-04-29 17:23:30,308] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 7: [2023-04-29 17:23:30,309] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 7: [2023-04-29 17:23:30,309] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 7: [2023-04-29 17:23:30,309] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 7: [2023-04-29 17:23:30,309] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 7: [2023-04-29 17:23:30,309] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 7: [2023-04-29 17:23:30,309] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 7: [2023-04-29 17:23:30,309] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 23: [2023-04-29 17:23:30,309] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 7: [2023-04-29 17:23:30,309] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 31: [2023-04-29 17:23:30,309] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 31: [2023-04-29 17:23:30,309] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 23: [2023-04-29 17:23:30,309] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 5: [2023-04-29 17:23:30,310] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 23: [2023-04-29 17:23:30,310] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 23: [2023-04-29 17:23:30,310] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 23: [2023-04-29 17:23:30,310] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 23: [2023-04-29 17:23:30,310] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 23: [2023-04-29 17:23:30,310] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 31: [2023-04-29 17:23:30,310] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 24: [2023-04-29 17:23:30,310] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 26: [2023-04-29 17:23:30,311] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 31: [2023-04-29 17:23:30,311] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 7: [2023-04-29 17:23:30,313] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 7: [2023-04-29 17:23:30,314] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 7: [2023-04-29 17:23:30,314] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 23: [2023-04-29 17:23:30,314] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 23: [2023-04-29 17:23:30,315] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 7: [2023-04-29 17:23:30,315] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 7: [2023-04-29 17:23:30,315] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 7: [2023-04-29 17:23:30,316] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 7: [2023-04-29 17:23:30,316] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 7: [2023-04-29 17:23:30,316] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 16: [2023-04-29 17:23:30,318] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 16: [2023-04-29 17:23:30,318] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 16: [2023-04-29 17:23:30,318] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 16: [2023-04-29 17:23:30,318] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 23: [2023-04-29 17:23:30,318] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 23: [2023-04-29 17:23:30,318] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 23: [2023-04-29 17:23:30,319] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 27: [2023-04-29 17:23:30,319] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 26: [2023-04-29 17:23:30,320] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 26: [2023-04-29 17:23:30,320] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 23: [2023-04-29 17:23:30,320] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 23: [2023-04-29 17:23:30,321] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 25: [2023-04-29 17:23:30,320] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 20: [2023-04-29 17:23:30,321] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 25: [2023-04-29 17:23:30,321] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 26: [2023-04-29 17:23:30,322] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 18: [2023-04-29 17:23:30,326] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 18: [2023-04-29 17:23:30,326] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 18: [2023-04-29 17:23:30,326] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 18: [2023-04-29 17:23:30,327] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 18: [2023-04-29 17:23:30,327] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 18: [2023-04-29 17:23:30,327] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 18: [2023-04-29 17:23:30,327] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 18: [2023-04-29 17:23:30,327] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 10: [2023-04-29 17:23:30,328] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 10: [2023-04-29 17:23:30,328] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 10: [2023-04-29 17:23:30,328] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 10: [2023-04-29 17:23:30,329] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 16: [2023-04-29 17:23:30,329] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 16: [2023-04-29 17:23:30,331] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 4: [2023-04-29 17:23:30,331] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 5: [2023-04-29 17:23:30,332] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 26: [2023-04-29 17:23:30,332] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 5: [2023-04-29 17:23:30,332] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 5: [2023-04-29 17:23:30,332] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 5: [2023-04-29 17:23:30,332] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 26: [2023-04-29 17:23:30,332] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 26: [2023-04-29 17:23:30,333] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 20: [2023-04-29 17:23:30,333] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 26: [2023-04-29 17:23:30,334] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 10: [2023-04-29 17:23:30,334] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 10: [2023-04-29 17:23:30,334] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 10: [2023-04-29 17:23:30,334] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 10: [2023-04-29 17:23:30,334] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 16: [2023-04-29 17:23:30,334] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 5: [2023-04-29 17:23:30,335] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 16: [2023-04-29 17:23:30,335] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 20: [2023-04-29 17:23:30,335] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 20: [2023-04-29 17:23:30,335] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 4: [2023-04-29 17:23:30,336] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 4: [2023-04-29 17:23:30,336] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 4: [2023-04-29 17:23:30,337] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 27: [2023-04-29 17:23:30,337] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 4: [2023-04-29 17:23:30,340] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 18: [2023-04-29 17:23:30,339] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 18: [2023-04-29 17:23:30,340] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 18: [2023-04-29 17:23:30,340] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 18: [2023-04-29 17:23:30,341] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 18: [2023-04-29 17:23:30,341] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 29: [2023-04-29 17:23:30,341] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 29: [2023-04-29 17:23:30,341] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 4: [2023-04-29 17:23:30,341] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 18: [2023-04-29 17:23:30,341] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 25: [2023-04-29 17:23:30,341] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 20: [2023-04-29 17:23:30,341] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 20: [2023-04-29 17:23:30,341] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 20: [2023-04-29 17:23:30,342] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 12: [2023-04-29 17:23:30,341] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 18: [2023-04-29 17:23:30,342] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 18: [2023-04-29 17:23:30,342] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 16: [2023-04-29 17:23:30,345] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 16: [2023-04-29 17:23:30,345] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 0: [2023-04-29 17:23:30,345] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 25: [2023-04-29 17:23:30,346] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 12: [2023-04-29 17:23:30,346] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 29: [2023-04-29 17:23:30,345] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 29: [2023-04-29 17:23:30,346] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 12: [2023-04-29 17:23:30,346] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 25: [2023-04-29 17:23:30,346] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 29: [2023-04-29 17:23:30,346] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 29: [2023-04-29 17:23:30,346] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 19: [2023-04-29 17:23:30,346] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 19: [2023-04-29 17:23:30,346] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 29: [2023-04-29 17:23:30,346] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 29: [2023-04-29 17:23:30,346] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 29: [2023-04-29 17:23:30,346] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 29: [2023-04-29 17:23:30,346] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 19: [2023-04-29 17:23:30,347] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 19: [2023-04-29 17:23:30,347] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 19: [2023-04-29 17:23:30,348] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 19: [2023-04-29 17:23:30,348] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 19: [2023-04-29 17:23:30,348] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 3: [2023-04-29 17:23:30,348] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 3: [2023-04-29 17:23:30,348] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 19: [2023-04-29 17:23:30,348] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 16: [2023-04-29 17:23:30,349] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 16: [2023-04-29 17:23:30,349] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 24: [2023-04-29 17:23:30,349] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 25: [2023-04-29 17:23:30,350] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 25: [2023-04-29 17:23:30,350] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 12: [2023-04-29 17:23:30,350] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 9: [2023-04-29 17:23:30,350] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 3: [2023-04-29 17:23:30,351] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 19: [2023-04-29 17:23:30,351] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 19: [2023-04-29 17:23:30,351] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 3: [2023-04-29 17:23:30,351] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 3: [2023-04-29 17:23:30,351] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 3: [2023-04-29 17:23:30,352] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 3: [2023-04-29 17:23:30,352] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 3: [2023-04-29 17:23:30,352] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 19: [2023-04-29 17:23:30,352] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 20: [2023-04-29 17:23:30,352] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 25: [2023-04-29 17:23:30,352] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 25: [2023-04-29 17:23:30,352] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 25: [2023-04-29 17:23:30,352] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 3: [2023-04-29 17:23:30,353] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 3: [2023-04-29 17:23:30,353] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 12: [2023-04-29 17:23:30,352] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 9: [2023-04-29 17:23:30,353] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 10: [2023-04-29 17:23:30,354] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 23: [2023-04-29 17:23:30,355] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 19: [2023-04-29 17:23:30,356] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 19: [2023-04-29 17:23:30,356] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 29: [2023-04-29 17:23:30,356] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 10: [2023-04-29 17:23:30,356] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 29: [2023-04-29 17:23:30,356] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 12: [2023-04-29 17:23:30,356] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 12: [2023-04-29 17:23:30,356] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 12: [2023-04-29 17:23:30,356] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 19: [2023-04-29 17:23:30,357] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 19: [2023-04-29 17:23:30,357] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 29: [2023-04-29 17:23:30,357] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 19: [2023-04-29 17:23:30,357] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 10: [2023-04-29 17:23:30,358] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 20: [2023-04-29 17:23:30,358] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 29: [2023-04-29 17:23:30,358] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 10: [2023-04-29 17:23:30,358] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 29: [2023-04-29 17:23:30,358] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 29: [2023-04-29 17:23:30,358] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 20: [2023-04-29 17:23:30,359] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 0: [2023-04-29 17:23:30,359] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 9: [2023-04-29 17:23:30,359] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 9: [2023-04-29 17:23:30,359] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 9: [2023-04-29 17:23:30,359] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 9: [2023-04-29 17:23:30,359] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 0: [2023-04-29 17:23:30,360] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 20: [2023-04-29 17:23:30,360] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 20: [2023-04-29 17:23:30,360] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 27: [2023-04-29 17:23:30,360] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 27: [2023-04-29 17:23:30,360] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 3: [2023-04-29 17:23:30,360] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 3: [2023-04-29 17:23:30,361] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 3: [2023-04-29 17:23:30,361] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 10: [2023-04-29 17:23:30,361] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 3: [2023-04-29 17:23:30,361] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 3: [2023-04-29 17:23:30,361] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 10: [2023-04-29 17:23:30,362] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 10: [2023-04-29 17:23:30,362] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 3: [2023-04-29 17:23:30,363] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 30: [2023-04-29 17:23:30,363] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 12: [2023-04-29 17:23:30,363] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 9: [2023-04-29 17:23:30,363] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 9: [2023-04-29 17:23:30,363] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 27: [2023-04-29 17:23:30,363] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 27: [2023-04-29 17:23:30,363] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 27: [2023-04-29 17:23:30,363] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 27: [2023-04-29 17:23:30,363] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 27: [2023-04-29 17:23:30,363] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 10: [2023-04-29 17:23:30,363] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 30: [2023-04-29 17:23:30,364] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 30: [2023-04-29 17:23:30,364] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 30: [2023-04-29 17:23:30,364] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 30: [2023-04-29 17:23:30,364] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 30: [2023-04-29 17:23:30,364] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 30: [2023-04-29 17:23:30,364] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 0: [2023-04-29 17:23:30,364] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 30: [2023-04-29 17:23:30,364] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 0: [2023-04-29 17:23:30,364] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 6: [2023-04-29 17:23:30,367] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 6: [2023-04-29 17:23:30,367] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 6: [2023-04-29 17:23:30,367] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 6: [2023-04-29 17:23:30,367] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 6: [2023-04-29 17:23:30,367] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 6: [2023-04-29 17:23:30,367] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 6: [2023-04-29 17:23:30,367] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 6: [2023-04-29 17:23:30,367] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 7: [2023-04-29 17:23:30,367] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 7: [2023-04-29 17:23:30,367] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 7: [2023-04-29 17:23:30,369] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 6: [2023-04-29 17:23:30,370] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 6: [2023-04-29 17:23:30,371] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 23: [2023-04-29 17:23:30,372] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 7: [2023-04-29 17:23:30,372] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 12: [2023-04-29 17:23:30,373] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 20: [2023-04-29 17:23:30,373] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 20: [2023-04-29 17:23:30,373] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 30: [2023-04-29 17:23:30,374] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 30: [2023-04-29 17:23:30,374] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 30: [2023-04-29 17:23:30,374] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 30: [2023-04-29 17:23:30,375] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 0: [2023-04-29 17:23:30,375] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 30: [2023-04-29 17:23:30,375] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 25: [2023-04-29 17:23:30,375] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 30: [2023-04-29 17:23:30,376] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 30: [2023-04-29 17:23:30,376] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 30: [2023-04-29 17:23:30,376] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 24: [2023-04-29 17:23:30,376] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 23: [2023-04-29 17:23:30,377] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 6: [2023-04-29 17:23:30,376] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 6: [2023-04-29 17:23:30,377] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 24: [2023-04-29 17:23:30,377] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 6: [2023-04-29 17:23:30,377] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 6: [2023-04-29 17:23:30,377] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 6: [2023-04-29 17:23:30,378] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 6: [2023-04-29 17:23:30,379] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 12: [2023-04-29 17:23:30,379] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 20: [2023-04-29 17:23:30,380] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 23: [2023-04-29 17:23:30,381] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 9: [2023-04-29 17:23:30,381] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 9: [2023-04-29 17:23:30,381] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 12: [2023-04-29 17:23:30,382] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 28: [2023-04-29 17:23:30,384] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 28: [2023-04-29 17:23:30,384] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 28: [2023-04-29 17:23:30,384] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 28: [2023-04-29 17:23:30,384] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 28: [2023-04-29 17:23:30,384] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 28: [2023-04-29 17:23:30,384] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 28: [2023-04-29 17:23:30,384] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 28: [2023-04-29 17:23:30,385] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 20: [2023-04-29 17:23:30,385] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 7: [2023-04-29 17:23:30,386] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 7: [2023-04-29 17:23:30,386] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 7: [2023-04-29 17:23:30,386] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 7: [2023-04-29 17:23:30,386] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 24: [2023-04-29 17:23:30,386] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 24: [2023-04-29 17:23:30,386] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 24: [2023-04-29 17:23:30,386] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 25: [2023-04-29 17:23:30,381] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 25: [2023-04-29 17:23:30,386] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 25: [2023-04-29 17:23:30,387] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 25: [2023-04-29 17:23:30,387] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 15: [2023-04-29 17:23:30,388] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 15: [2023-04-29 17:23:30,388] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 15: [2023-04-29 17:23:30,388] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 15: [2023-04-29 17:23:30,388] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 15: [2023-04-29 17:23:30,388] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 15: [2023-04-29 17:23:30,388] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 15: [2023-04-29 17:23:30,388] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 15: [2023-04-29 17:23:30,388] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 9: [2023-04-29 17:23:30,388] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 25: [2023-04-29 17:23:30,389] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 0: [2023-04-29 17:23:30,389] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 9: [2023-04-29 17:23:30,389] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 12: [2023-04-29 17:23:30,390] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 1: [2023-04-29 17:23:30,390] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 1: [2023-04-29 17:23:30,390] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 1: [2023-04-29 17:23:30,390] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 27: [2023-04-29 17:23:30,390] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 1: [2023-04-29 17:23:30,390] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 1: [2023-04-29 17:23:30,390] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 1: [2023-04-29 17:23:30,390] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 1: [2023-04-29 17:23:30,390] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 23: [2023-04-29 17:23:30,390] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 29: [2023-04-29 17:23:30,390] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 29: [2023-04-29 17:23:30,390] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 1: [2023-04-29 17:23:30,391] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 0: [2023-04-29 17:23:30,391] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 24: [2023-04-29 17:23:30,391] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 24: [2023-04-29 17:23:30,391] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 12: [2023-04-29 17:23:30,391] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 12: [2023-04-29 17:23:30,391] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 9: [2023-04-29 17:23:30,391] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 9: [2023-04-29 17:23:30,391] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 7: [2023-04-29 17:23:30,392] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 7: [2023-04-29 17:23:30,392] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 7: [2023-04-29 17:23:30,392] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 24: [2023-04-29 17:23:30,392] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 12: [2023-04-29 17:23:30,392] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 9: [2023-04-29 17:23:30,393] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 9: [2023-04-29 17:23:30,394] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 0: [2023-04-29 17:23:30,395] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 0: [2023-04-29 17:23:30,395] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 1: [2023-04-29 17:23:30,395] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 0: [2023-04-29 17:23:30,395] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 0: [2023-04-29 17:23:30,395] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 1: [2023-04-29 17:23:30,396] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 23: [2023-04-29 17:23:30,396] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 1: [2023-04-29 17:23:30,396] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 1: [2023-04-29 17:23:30,396] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 1: [2023-04-29 17:23:30,396] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 28: [2023-04-29 17:23:30,396] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 28: [2023-04-29 17:23:30,396] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 15: [2023-04-29 17:23:30,397] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 28: [2023-04-29 17:23:30,397] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 15: [2023-04-29 17:23:30,397] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 27: [2023-04-29 17:23:30,397] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 27: [2023-04-29 17:23:30,397] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 23: [2023-04-29 17:23:30,397] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 23: [2023-04-29 17:23:30,398] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 28: [2023-04-29 17:23:30,398] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 28: [2023-04-29 17:23:30,398] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 0: [2023-04-29 17:23:30,398] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 1: [2023-04-29 17:23:30,398] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 28: [2023-04-29 17:23:30,398] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 28: [2023-04-29 17:23:30,399] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 1: [2023-04-29 17:23:30,399] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 1: [2023-04-29 17:23:30,399] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 27: [2023-04-29 17:23:30,399] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 7: [2023-04-29 17:23:30,400] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 23: [2023-04-29 17:23:30,400] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 28: [2023-04-29 17:23:30,400] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 27: [2023-04-29 17:23:30,400] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 15: [2023-04-29 17:23:30,401] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 15: [2023-04-29 17:23:30,401] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 15: [2023-04-29 17:23:30,401] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 15: [2023-04-29 17:23:30,402] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 24: [2023-04-29 17:23:30,403] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 15: [2023-04-29 17:23:30,403] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 15: [2023-04-29 17:23:30,403] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt... 23: [2023-04-29 17:23:30,403] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 3: [2023-04-29 17:23:30,403] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 3: [2023-04-29 17:23:30,403] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 27: [2023-04-29 17:23:30,405] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 22: [2023-04-29 17:23:30,405] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 22: [2023-04-29 17:23:30,405] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 22: [2023-04-29 17:23:30,406] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 22: [2023-04-29 17:23:30,406] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 22: [2023-04-29 17:23:30,406] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 22: [2023-04-29 17:23:30,406] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 22: [2023-04-29 17:23:30,406] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 27: [2023-04-29 17:23:30,406] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 22: [2023-04-29 17:23:30,406] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 19: [2023-04-29 17:23:30,406] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 19: [2023-04-29 17:23:30,406] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 19: [2023-04-29 17:23:30,406] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 23: [2023-04-29 17:23:30,407] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 22: [2023-04-29 17:23:30,410] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 22: [2023-04-29 17:23:30,410] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 7: [2023-04-29 17:23:30,412] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 29: [2023-04-29 17:23:30,413] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 29: [2023-04-29 17:23:30,413] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 7: [2023-04-29 17:23:30,414] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 6: [2023-04-29 17:23:30,414] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 24: [2023-04-29 17:23:30,415] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 22: [2023-04-29 17:23:30,415] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 22: [2023-04-29 17:23:30,416] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 7: [2023-04-29 17:23:30,417] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 7: [2023-04-29 17:23:30,417] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 22: [2023-04-29 17:23:30,418] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 22: [2023-04-29 17:23:30,418] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 19: [2023-04-29 17:23:30,418] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 24: [2023-04-29 17:23:30,418] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 22: [2023-04-29 17:23:30,418] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 22: [2023-04-29 17:23:30,419] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 18: [2023-04-29 17:23:30,419] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 18: [2023-04-29 17:23:30,419] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 18: [2023-04-29 17:23:30,419] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 24: [2023-04-29 17:23:30,420] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 29: [2023-04-29 17:23:30,419] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 23: [2023-04-29 17:23:30,422] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 0: [2023-04-29 17:23:30,422] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 0: [2023-04-29 17:23:30,423] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 19: [2023-04-29 17:23:30,424] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 19: [2023-04-29 17:23:30,424] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 19: [2023-04-29 17:23:30,424] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 19: [2023-04-29 17:23:30,424] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 6: [2023-04-29 17:23:30,425] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 0: [2023-04-29 17:23:30,425] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 3: [2023-04-29 17:23:30,426] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 3: [2023-04-29 17:23:30,427] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 18: [2023-04-29 17:23:30,426] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 18: [2023-04-29 17:23:30,426] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 18: [2023-04-29 17:23:30,426] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 18: [2023-04-29 17:23:30,427] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 3: [2023-04-29 17:23:30,427] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 24: [2023-04-29 17:23:30,427] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 19: [2023-04-29 17:23:30,427] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 18: [2023-04-29 17:23:30,427] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 24: [2023-04-29 17:23:30,428] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 24: [2023-04-29 17:23:30,428] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 23: [2023-04-29 17:23:30,429] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 19: [2023-04-29 17:23:30,430] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 19: [2023-04-29 17:23:30,430] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 29: [2023-04-29 17:23:30,430] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 23: [2023-04-29 17:23:30,433] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 23: [2023-04-29 17:23:30,433] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 3: [2023-04-29 17:23:30,433] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 3: [2023-04-29 17:23:30,433] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 3: [2023-04-29 17:23:30,433] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 3: [2023-04-29 17:23:30,433] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 3: [2023-04-29 17:23:30,433] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 6: [2023-04-29 17:23:30,434] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 29: [2023-04-29 17:23:30,435] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 29: [2023-04-29 17:23:30,435] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 29: [2023-04-29 17:23:30,435] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 29: [2023-04-29 17:23:30,435] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 23: [2023-04-29 17:23:30,436] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 13: [2023-04-29 17:23:30,440] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 13: [2023-04-29 17:23:30,440] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 13: [2023-04-29 17:23:30,440] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 13: [2023-04-29 17:23:30,440] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 13: [2023-04-29 17:23:30,440] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 13: [2023-04-29 17:23:30,441] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 13: [2023-04-29 17:23:30,441] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 13: [2023-04-29 17:23:30,441] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 19: [2023-04-29 17:23:30,443] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 1: [2023-04-29 17:23:30,446] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 6: [2023-04-29 17:23:30,446] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 13: [2023-04-29 17:23:30,446] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 29: [2023-04-29 17:23:30,447] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 13: [2023-04-29 17:23:30,447] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 6: [2023-04-29 17:23:30,447] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 30: [2023-04-29 17:23:30,448] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 13: [2023-04-29 17:23:30,449] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 13: [2023-04-29 17:23:30,449] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 13: [2023-04-29 17:23:30,450] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 13: [2023-04-29 17:23:30,450] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 13: [2023-04-29 17:23:30,451] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 18: [2023-04-29 17:23:30,451] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 6: [2023-04-29 17:23:30,451] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 6: [2023-04-29 17:23:30,451] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 6: [2023-04-29 17:23:30,451] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 6: [2023-04-29 17:23:30,451] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 6: [2023-04-29 17:23:30,451] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 3: [2023-04-29 17:23:30,452] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 13: [2023-04-29 17:23:30,452] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 19: [2023-04-29 17:23:30,453] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 18: [2023-04-29 17:23:30,454] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 1: [2023-04-29 17:23:30,454] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 1: [2023-04-29 17:23:30,454] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 1: [2023-04-29 17:23:30,454] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 1: [2023-04-29 17:23:30,454] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 19: [2023-04-29 17:23:30,455] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 19: [2023-04-29 17:23:30,455] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 19: [2023-04-29 17:23:30,455] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 30: [2023-04-29 17:23:30,455] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 30: [2023-04-29 17:23:30,455] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 18: [2023-04-29 17:23:30,457] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 29: [2023-04-29 17:23:30,462] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 3: [2023-04-29 17:23:30,463] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 22: [2023-04-29 17:23:30,463] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 1: [2023-04-29 17:23:30,463] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 1: [2023-04-29 17:23:30,463] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 1: [2023-04-29 17:23:30,463] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 3: [2023-04-29 17:23:30,464] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 22: [2023-04-29 17:23:30,464] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 18: [2023-04-29 17:23:30,465] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 3: [2023-04-29 17:23:30,465] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 18: [2023-04-29 17:23:30,465] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 18: [2023-04-29 17:23:30,465] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 29: [2023-04-29 17:23:30,465] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 29: [2023-04-29 17:23:30,466] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 18: [2023-04-29 17:23:30,466] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 3: [2023-04-29 17:23:30,466] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 15: [2023-04-29 17:23:30,466] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 29: [2023-04-29 17:23:30,467] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 3: [2023-04-29 17:23:30,467] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 18: [2023-04-29 17:23:30,468] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 1: [2023-04-29 17:23:30,468] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 28: [2023-04-29 17:23:30,468] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 29: [2023-04-29 17:23:30,469] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 30: [2023-04-29 17:23:30,474] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 28: [2023-04-29 17:23:30,476] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 28: [2023-04-29 17:23:30,476] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 22: [2023-04-29 17:23:30,478] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 30: [2023-04-29 17:23:30,478] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 30: [2023-04-29 17:23:30,478] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 30: [2023-04-29 17:23:30,478] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 30: [2023-04-29 17:23:30,478] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 30: [2023-04-29 17:23:30,478] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 1: [2023-04-29 17:23:30,478] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 28: [2023-04-29 17:23:30,479] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 1: [2023-04-29 17:23:30,479] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 1: [2023-04-29 17:23:30,481] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 6: [2023-04-29 17:23:30,481] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 6: [2023-04-29 17:23:30,483] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 6: [2023-04-29 17:23:30,484] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 1: [2023-04-29 17:23:30,485] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 6: [2023-04-29 17:23:30,485] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 15: [2023-04-29 17:23:30,486] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 6: [2023-04-29 17:23:30,487] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 6: [2023-04-29 17:23:30,487] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 30: [2023-04-29 17:23:30,487] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 15: [2023-04-29 17:23:30,487] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 15: [2023-04-29 17:23:30,488] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 15: [2023-04-29 17:23:30,489] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 15: [2023-04-29 17:23:30,489] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 15: [2023-04-29 17:23:30,489] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 15: [2023-04-29 17:23:30,489] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 22: [2023-04-29 17:23:30,489] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 22: [2023-04-29 17:23:30,489] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 22: [2023-04-29 17:23:30,489] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 22: [2023-04-29 17:23:30,489] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 22: [2023-04-29 17:23:30,489] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 30: [2023-04-29 17:23:30,489] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 1: [2023-04-29 17:23:30,491] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 15: [2023-04-29 17:23:30,491] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 1: [2023-04-29 17:23:30,491] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 1: [2023-04-29 17:23:30,494] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 22: [2023-04-29 17:23:30,494] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 28: [2023-04-29 17:23:30,495] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 13: [2023-04-29 17:23:30,500] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 22: [2023-04-29 17:23:30,501] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 28: [2023-04-29 17:23:30,502] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 28: [2023-04-29 17:23:30,503] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 28: [2023-04-29 17:23:30,503] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 28: [2023-04-29 17:23:30,503] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 28: [2023-04-29 17:23:30,503] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_32-model_00-model_states.pt. 13: [2023-04-29 17:23:30,503] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 11: [2023-04-29 17:23:30,506] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 11: [2023-04-29 17:23:30,506] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 11: [2023-04-29 17:23:30,506] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 22: [2023-04-29 17:23:30,506] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 11: [2023-04-29 17:23:30,506] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 11: [2023-04-29 17:23:30,506] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 11: [2023-04-29 17:23:30,506] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 11: [2023-04-29 17:23:30,506] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 11: [2023-04-29 17:23:30,507] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 30: [2023-04-29 17:23:30,509] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 11: [2023-04-29 17:23:30,509] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 28: [2023-04-29 17:23:30,510] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 30: [2023-04-29 17:23:30,510] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 30: [2023-04-29 17:23:30,510] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 11: [2023-04-29 17:23:30,511] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 11: [2023-04-29 17:23:30,511] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 30: [2023-04-29 17:23:30,512] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 28: [2023-04-29 17:23:30,512] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 14: [2023-04-29 17:23:30,512] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 14: [2023-04-29 17:23:30,513] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 14: [2023-04-29 17:23:30,513] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 30: [2023-04-29 17:23:30,513] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 14: [2023-04-29 17:23:30,513] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 14: [2023-04-29 17:23:30,513] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 14: [2023-04-29 17:23:30,513] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 14: [2023-04-29 17:23:30,513] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 13: [2023-04-29 17:23:30,513] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 14: [2023-04-29 17:23:30,514] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 13: [2023-04-29 17:23:30,514] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 13: [2023-04-29 17:23:30,514] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 11: [2023-04-29 17:23:30,514] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 11: [2023-04-29 17:23:30,514] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 11: [2023-04-29 17:23:30,515] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 11: [2023-04-29 17:23:30,516] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 11: [2023-04-29 17:23:30,516] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 14: [2023-04-29 17:23:30,516] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 14: [2023-04-29 17:23:30,517] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 13: [2023-04-29 17:23:30,522] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 22: [2023-04-29 17:23:30,523] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 22: [2023-04-29 17:23:30,523] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 22: [2023-04-29 17:23:30,523] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 22: [2023-04-29 17:23:30,524] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 15: [2023-04-29 17:23:30,524] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 14: [2023-04-29 17:23:30,523] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 14: [2023-04-29 17:23:30,523] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 14: [2023-04-29 17:23:30,524] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 2: [2023-04-29 17:23:30,524] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 2: [2023-04-29 17:23:30,524] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 14: [2023-04-29 17:23:30,524] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 14: [2023-04-29 17:23:30,525] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 14: [2023-04-29 17:23:30,525] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 2: [2023-04-29 17:23:30,527] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 15: [2023-04-29 17:23:30,527] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 13: [2023-04-29 17:23:30,528] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 2: [2023-04-29 17:23:30,528] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 2: [2023-04-29 17:23:30,528] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 2: [2023-04-29 17:23:30,528] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 2: [2023-04-29 17:23:30,528] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 2: [2023-04-29 17:23:30,528] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 2: [2023-04-29 17:23:30,528] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 2: [2023-04-29 17:23:30,530] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 15: [2023-04-29 17:23:30,529] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 15: [2023-04-29 17:23:30,530] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 15: [2023-04-29 17:23:30,531] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 13: [2023-04-29 17:23:30,532] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 28: [2023-04-29 17:23:30,532] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 2: [2023-04-29 17:23:30,532] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 15: [2023-04-29 17:23:30,532] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 15: [2023-04-29 17:23:30,532] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 28: [2023-04-29 17:23:30,533] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 13: [2023-04-29 17:23:30,533] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 22: [2023-04-29 17:23:30,534] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 28: [2023-04-29 17:23:30,535] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 13: [2023-04-29 17:23:30,535] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 2: [2023-04-29 17:23:30,537] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 2: [2023-04-29 17:23:30,537] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 28: [2023-04-29 17:23:30,537] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 2: [2023-04-29 17:23:30,538] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 13: [2023-04-29 17:23:30,538] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 2: [2023-04-29 17:23:30,539] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 2: [2023-04-29 17:23:30,539] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 13: [2023-04-29 17:23:30,542] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 13: [2023-04-29 17:23:30,550] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 11: [2023-04-29 17:23:30,557] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 13: [2023-04-29 17:23:30,563] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 13: [2023-04-29 17:23:30,564] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 13: [2023-04-29 17:23:30,566] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 11: [2023-04-29 17:23:30,568] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 11: [2023-04-29 17:23:30,568] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 14: [2023-04-29 17:23:30,568] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 14: [2023-04-29 17:23:30,569] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 4: [2023-04-29 17:23:30,569] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 4: [2023-04-29 17:23:30,569] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 4: [2023-04-29 17:23:30,572] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 4: [2023-04-29 17:23:30,572] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 4: [2023-04-29 17:23:30,572] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 4: [2023-04-29 17:23:30,572] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 4: [2023-04-29 17:23:30,572] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 4: [2023-04-29 17:23:30,573] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 4: [2023-04-29 17:23:30,574] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 4: [2023-04-29 17:23:30,574] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 11: [2023-04-29 17:23:30,574] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 2: [2023-04-29 17:23:30,576] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 11: [2023-04-29 17:23:30,577] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 20: [2023-04-29 17:23:30,578] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 20: [2023-04-29 17:23:30,578] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 11: [2023-04-29 17:23:30,578] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 4: [2023-04-29 17:23:30,581] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 20: [2023-04-29 17:23:30,580] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 20: [2023-04-29 17:23:30,581] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 20: [2023-04-29 17:23:30,581] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 20: [2023-04-29 17:23:30,581] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 20: [2023-04-29 17:23:30,581] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 20: [2023-04-29 17:23:30,582] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 4: [2023-04-29 17:23:30,582] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 4: [2023-04-29 17:23:30,583] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 20: [2023-04-29 17:23:30,583] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 4: [2023-04-29 17:23:30,584] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 20: [2023-04-29 17:23:30,584] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 4: [2023-04-29 17:23:30,584] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 4: [2023-04-29 17:23:30,585] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 10: [2023-04-29 17:23:30,585] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 10: [2023-04-29 17:23:30,585] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 10: [2023-04-29 17:23:30,585] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 10: [2023-04-29 17:23:30,586] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 10: [2023-04-29 17:23:30,586] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 10: [2023-04-29 17:23:30,586] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 10: [2023-04-29 17:23:30,586] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 10: [2023-04-29 17:23:30,586] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 11: [2023-04-29 17:23:30,586] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 11: [2023-04-29 17:23:30,586] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 20: [2023-04-29 17:23:30,587] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 14: [2023-04-29 17:23:30,587] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 11: [2023-04-29 17:23:30,588] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 20: [2023-04-29 17:23:30,588] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 14: [2023-04-29 17:23:30,588] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 20: [2023-04-29 17:23:30,589] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 20: [2023-04-29 17:23:30,590] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 2: [2023-04-29 17:23:30,590] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 2: [2023-04-29 17:23:30,590] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 10: [2023-04-29 17:23:30,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 10: [2023-04-29 17:23:30,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 10: [2023-04-29 17:23:30,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 20: [2023-04-29 17:23:30,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 10: [2023-04-29 17:23:30,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 20: [2023-04-29 17:23:30,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 11: [2023-04-29 17:23:30,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 11: [2023-04-29 17:23:30,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 10: [2023-04-29 17:23:30,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 10: [2023-04-29 17:23:30,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 26: [2023-04-29 17:23:30,593] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 26: [2023-04-29 17:23:30,593] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 14: [2023-04-29 17:23:30,593] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 10: [2023-04-29 17:23:30,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 26: [2023-04-29 17:23:30,594] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 26: [2023-04-29 17:23:30,594] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 26: [2023-04-29 17:23:30,594] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 26: [2023-04-29 17:23:30,594] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 26: [2023-04-29 17:23:30,594] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 10: [2023-04-29 17:23:30,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 26: [2023-04-29 17:23:30,595] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 2: [2023-04-29 17:23:30,597] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 14: [2023-04-29 17:23:30,597] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 14: [2023-04-29 17:23:30,601] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 26: [2023-04-29 17:23:30,600] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 26: [2023-04-29 17:23:30,600] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 26: [2023-04-29 17:23:30,601] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 26: [2023-04-29 17:23:30,601] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 26: [2023-04-29 17:23:30,602] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 26: [2023-04-29 17:23:30,602] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 26: [2023-04-29 17:23:30,602] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 26: [2023-04-29 17:23:30,602] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 11: [2023-04-29 17:23:30,603] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 2: [2023-04-29 17:23:30,604] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 2: [2023-04-29 17:23:30,604] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 2: [2023-04-29 17:23:30,604] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 2: [2023-04-29 17:23:30,604] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 2: [2023-04-29 17:23:30,604] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 23: [2023-04-29 17:23:30,604] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 23: [2023-04-29 17:23:30,604] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 23: [2023-04-29 17:23:30,605] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 23: [2023-04-29 17:23:30,605] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 23: [2023-04-29 17:23:30,605] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 23: [2023-04-29 17:23:30,605] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 23: [2023-04-29 17:23:30,605] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 23: [2023-04-29 17:23:30,605] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 14: [2023-04-29 17:23:30,606] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 14: [2023-04-29 17:23:30,606] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 14: [2023-04-29 17:23:30,606] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 31: [2023-04-29 17:23:30,606] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 31: [2023-04-29 17:23:30,606] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 31: [2023-04-29 17:23:30,606] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 11: [2023-04-29 17:23:30,606] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 31: [2023-04-29 17:23:30,606] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 31: [2023-04-29 17:23:30,606] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 31: [2023-04-29 17:23:30,606] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 31: [2023-04-29 17:23:30,606] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 31: [2023-04-29 17:23:30,606] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 25: [2023-04-29 17:23:30,606] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 25: [2023-04-29 17:23:30,606] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 25: [2023-04-29 17:23:30,607] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 25: [2023-04-29 17:23:30,607] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 25: [2023-04-29 17:23:30,607] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 25: [2023-04-29 17:23:30,607] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 25: [2023-04-29 17:23:30,607] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 25: [2023-04-29 17:23:30,608] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 23: [2023-04-29 17:23:30,610] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 31: [2023-04-29 17:23:30,610] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 31: [2023-04-29 17:23:30,611] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 31: [2023-04-29 17:23:30,611] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 25: [2023-04-29 17:23:30,610] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 25: [2023-04-29 17:23:30,611] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 23: [2023-04-29 17:23:30,611] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 31: [2023-04-29 17:23:30,613] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 31: [2023-04-29 17:23:30,613] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 31: [2023-04-29 17:23:30,613] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 31: [2023-04-29 17:23:30,613] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 31: [2023-04-29 17:23:30,614] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 2: [2023-04-29 17:23:30,614] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 27: [2023-04-29 17:23:30,614] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 2: [2023-04-29 17:23:30,614] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 27: [2023-04-29 17:23:30,614] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 27: [2023-04-29 17:23:30,615] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 27: [2023-04-29 17:23:30,615] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 27: [2023-04-29 17:23:30,615] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 27: [2023-04-29 17:23:30,615] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 27: [2023-04-29 17:23:30,615] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 27: [2023-04-29 17:23:30,615] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 21: [2023-04-29 17:23:30,615] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 21: [2023-04-29 17:23:30,615] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 21: [2023-04-29 17:23:30,615] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 21: [2023-04-29 17:23:30,615] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 21: [2023-04-29 17:23:30,615] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 21: [2023-04-29 17:23:30,615] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 21: [2023-04-29 17:23:30,615] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 23: [2023-04-29 17:23:30,615] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 23: [2023-04-29 17:23:30,615] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 21: [2023-04-29 17:23:30,616] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 23: [2023-04-29 17:23:30,616] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 23: [2023-04-29 17:23:30,616] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 11: [2023-04-29 17:23:30,616] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 11: [2023-04-29 17:23:30,616] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 27: [2023-04-29 17:23:30,616] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 23: [2023-04-29 17:23:30,617] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 25: [2023-04-29 17:23:30,617] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 23: [2023-04-29 17:23:30,617] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 11: [2023-04-29 17:23:30,617] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 25: [2023-04-29 17:23:30,618] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 16: [2023-04-29 17:23:30,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 16: [2023-04-29 17:23:30,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 16: [2023-04-29 17:23:30,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 25: [2023-04-29 17:23:30,618] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 14: [2023-04-29 17:23:30,618] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 16: [2023-04-29 17:23:30,619] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 16: [2023-04-29 17:23:30,619] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 16: [2023-04-29 17:23:30,619] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 16: [2023-04-29 17:23:30,619] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 25: [2023-04-29 17:23:30,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 16: [2023-04-29 17:23:30,619] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 25: [2023-04-29 17:23:30,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 25: [2023-04-29 17:23:30,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 21: [2023-04-29 17:23:30,620] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 21: [2023-04-29 17:23:30,620] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 21: [2023-04-29 17:23:30,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 21: [2023-04-29 17:23:30,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 21: [2023-04-29 17:23:30,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 21: [2023-04-29 17:23:30,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 21: [2023-04-29 17:23:30,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 21: [2023-04-29 17:23:30,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 27: [2023-04-29 17:23:30,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 16: [2023-04-29 17:23:30,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 16: [2023-04-29 17:23:30,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 16: [2023-04-29 17:23:30,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 16: [2023-04-29 17:23:30,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 16: [2023-04-29 17:23:30,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 16: [2023-04-29 17:23:30,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 4: [2023-04-29 17:23:30,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 4: [2023-04-29 17:23:30,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 16: [2023-04-29 17:23:30,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 16: [2023-04-29 17:23:30,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 27: [2023-04-29 17:23:30,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 27: [2023-04-29 17:23:30,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 27: [2023-04-29 17:23:30,626] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 27: [2023-04-29 17:23:30,627] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 27: [2023-04-29 17:23:30,628] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 27: [2023-04-29 17:23:30,629] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 24: [2023-04-29 17:23:30,629] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 14: [2023-04-29 17:23:30,629] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 24: [2023-04-29 17:23:30,630] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 24: [2023-04-29 17:23:30,630] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 24: [2023-04-29 17:23:30,630] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 24: [2023-04-29 17:23:30,630] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 24: [2023-04-29 17:23:30,630] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 24: [2023-04-29 17:23:30,630] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 24: [2023-04-29 17:23:30,630] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 14: [2023-04-29 17:23:30,632] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 24: [2023-04-29 17:23:30,633] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 2: [2023-04-29 17:23:30,635] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 2: [2023-04-29 17:23:30,637] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 2: [2023-04-29 17:23:30,637] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 2: [2023-04-29 17:23:30,637] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 24: [2023-04-29 17:23:30,638] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 2: [2023-04-29 17:23:30,638] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 14: [2023-04-29 17:23:30,639] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 20: [2023-04-29 17:23:30,639] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 20: [2023-04-29 17:23:30,639] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 24: [2023-04-29 17:23:30,640] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 24: [2023-04-29 17:23:30,640] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 14: [2023-04-29 17:23:30,641] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 24: [2023-04-29 17:23:30,642] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 24: [2023-04-29 17:23:30,642] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 14: [2023-04-29 17:23:30,643] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 20: [2023-04-29 17:23:30,643] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 24: [2023-04-29 17:23:30,643] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 4: [2023-04-29 17:23:30,644] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 24: [2023-04-29 17:23:30,644] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 4: [2023-04-29 17:23:30,646] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 20: [2023-04-29 17:23:30,646] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 20: [2023-04-29 17:23:30,646] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 4: [2023-04-29 17:23:30,646] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 4: [2023-04-29 17:23:30,646] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 10: [2023-04-29 17:23:30,649] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 10: [2023-04-29 17:23:30,649] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 10: [2023-04-29 17:23:30,649] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 10: [2023-04-29 17:23:30,649] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 12: [2023-04-29 17:23:30,651] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 12: [2023-04-29 17:23:30,651] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 12: [2023-04-29 17:23:30,652] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 12: [2023-04-29 17:23:30,652] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 12: [2023-04-29 17:23:30,653] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 12: [2023-04-29 17:23:30,653] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 12: [2023-04-29 17:23:30,653] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 12: [2023-04-29 17:23:30,653] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 12: [2023-04-29 17:23:30,655] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 12: [2023-04-29 17:23:30,655] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 10: [2023-04-29 17:23:30,654] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 10: [2023-04-29 17:23:30,654] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 10: [2023-04-29 17:23:30,654] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 10: [2023-04-29 17:23:30,655] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 26: [2023-04-29 17:23:30,658] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 26: [2023-04-29 17:23:30,658] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 26: [2023-04-29 17:23:30,658] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 20: [2023-04-29 17:23:30,660] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 0: [2023-04-29 17:23:30,661] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 0: [2023-04-29 17:23:30,661] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 0: [2023-04-29 17:23:30,661] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 0: [2023-04-29 17:23:30,661] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 0: [2023-04-29 17:23:30,661] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 0: [2023-04-29 17:23:30,661] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 0: [2023-04-29 17:23:30,661] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 0: [2023-04-29 17:23:30,661] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 4: [2023-04-29 17:23:30,661] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 20: [2023-04-29 17:23:30,662] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 20: [2023-04-29 17:23:30,662] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 23: [2023-04-29 17:23:30,662] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 12: [2023-04-29 17:23:30,663] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 26: [2023-04-29 17:23:30,662] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 20: [2023-04-29 17:23:30,663] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 12: [2023-04-29 17:23:30,663] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 20: [2023-04-29 17:23:30,663] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 12: [2023-04-29 17:23:30,664] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 12: [2023-04-29 17:23:30,664] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 12: [2023-04-29 17:23:30,665] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 12: [2023-04-29 17:23:30,665] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 31: [2023-04-29 17:23:30,665] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 31: [2023-04-29 17:23:30,665] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 31: [2023-04-29 17:23:30,665] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 4: [2023-04-29 17:23:30,665] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 4: [2023-04-29 17:23:30,665] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 4: [2023-04-29 17:23:30,665] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 26: [2023-04-29 17:23:30,665] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 23: [2023-04-29 17:23:30,665] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 26: [2023-04-29 17:23:30,666] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 26: [2023-04-29 17:23:30,666] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 27: [2023-04-29 17:23:30,666] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 26: [2023-04-29 17:23:30,666] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 25: [2023-04-29 17:23:30,667] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 25: [2023-04-29 17:23:30,667] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 20: [2023-04-29 17:23:30,670] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 4: [2023-04-29 17:23:30,670] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 0: [2023-04-29 17:23:30,671] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 0: [2023-04-29 17:23:30,673] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 20: [2023-04-29 17:23:30,674] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 20: [2023-04-29 17:23:30,674] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 0: [2023-04-29 17:23:30,675] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 0: [2023-04-29 17:23:30,675] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 21: [2023-04-29 17:23:30,675] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 21: [2023-04-29 17:23:30,675] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 21: [2023-04-29 17:23:30,675] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 0: [2023-04-29 17:23:30,675] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 0: [2023-04-29 17:23:30,676] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 4: [2023-04-29 17:23:30,677] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 0: [2023-04-29 17:23:30,678] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 10: [2023-04-29 17:23:30,678] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 10: [2023-04-29 17:23:30,678] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 16: [2023-04-29 17:23:30,678] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 16: [2023-04-29 17:23:30,678] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 0: [2023-04-29 17:23:30,679] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 31: [2023-04-29 17:23:30,680] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 31: [2023-04-29 17:23:30,680] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 31: [2023-04-29 17:23:30,680] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 31: [2023-04-29 17:23:30,680] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 31: [2023-04-29 17:23:30,680] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 23: [2023-04-29 17:23:30,681] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 10: [2023-04-29 17:23:30,681] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 9: [2023-04-29 17:23:30,680] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 9: [2023-04-29 17:23:30,680] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 9: [2023-04-29 17:23:30,680] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 9: [2023-04-29 17:23:30,680] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 9: [2023-04-29 17:23:30,680] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 9: [2023-04-29 17:23:30,680] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 9: [2023-04-29 17:23:30,680] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 9: [2023-04-29 17:23:30,681] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 10: [2023-04-29 17:23:30,683] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 16: [2023-04-29 17:23:30,684] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 24: [2023-04-29 17:23:30,683] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 9: [2023-04-29 17:23:30,685] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 9: [2023-04-29 17:23:30,685] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 9: [2023-04-29 17:23:30,686] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 10: [2023-04-29 17:23:30,686] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 9: [2023-04-29 17:23:30,686] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 25: [2023-04-29 17:23:30,686] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 9: [2023-04-29 17:23:30,686] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 10: [2023-04-29 17:23:30,686] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 26: [2023-04-29 17:23:30,686] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 9: [2023-04-29 17:23:30,686] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 26: [2023-04-29 17:23:30,686] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 9: [2023-04-29 17:23:30,687] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 9: [2023-04-29 17:23:30,687] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 27: [2023-04-29 17:23:30,687] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 23: [2023-04-29 17:23:30,687] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 23: [2023-04-29 17:23:30,688] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 23: [2023-04-29 17:23:30,688] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 25: [2023-04-29 17:23:30,688] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 25: [2023-04-29 17:23:30,688] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 25: [2023-04-29 17:23:30,688] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 25: [2023-04-29 17:23:30,688] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 25: [2023-04-29 17:23:30,688] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 26: [2023-04-29 17:23:30,688] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 20: [2023-04-29 17:23:30,689] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 25: [2023-04-29 17:23:30,689] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 10: [2023-04-29 17:23:30,689] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 20: [2023-04-29 17:23:30,689] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 10: [2023-04-29 17:23:30,689] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 20: [2023-04-29 17:23:30,689] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 21: [2023-04-29 17:23:30,689] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 21: [2023-04-29 17:23:30,689] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 21: [2023-04-29 17:23:30,689] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 21: [2023-04-29 17:23:30,689] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 21: [2023-04-29 17:23:30,689] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 26: [2023-04-29 17:23:30,690] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 31: [2023-04-29 17:23:30,690] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 31: [2023-04-29 17:23:30,690] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 25: [2023-04-29 17:23:30,691] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 23: [2023-04-29 17:23:30,691] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 31: [2023-04-29 17:23:30,692] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 23: [2023-04-29 17:23:30,693] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 26: [2023-04-29 17:23:30,693] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 26: [2023-04-29 17:23:30,694] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 16: [2023-04-29 17:23:30,694] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 16: [2023-04-29 17:23:30,694] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 16: [2023-04-29 17:23:30,694] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 16: [2023-04-29 17:23:30,694] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 16: [2023-04-29 17:23:30,694] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 4: [2023-04-29 17:23:30,694] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 26: [2023-04-29 17:23:30,694] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 29: [2023-04-29 17:23:30,694] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 29: [2023-04-29 17:23:30,694] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 23: [2023-04-29 17:23:30,695] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 26: [2023-04-29 17:23:30,695] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 23: [2023-04-29 17:23:30,695] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 29: [2023-04-29 17:23:30,695] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 29: [2023-04-29 17:23:30,695] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 29: [2023-04-29 17:23:30,695] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 29: [2023-04-29 17:23:30,695] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 29: [2023-04-29 17:23:30,695] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 29: [2023-04-29 17:23:30,696] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 27: [2023-04-29 17:23:30,696] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 21: [2023-04-29 17:23:30,699] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 29: [2023-04-29 17:23:30,698] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 29: [2023-04-29 17:23:30,699] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 21: [2023-04-29 17:23:30,699] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 21: [2023-04-29 17:23:30,700] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 4: [2023-04-29 17:23:30,700] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 4: [2023-04-29 17:23:30,700] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 4: [2023-04-29 17:23:30,701] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 12: [2023-04-29 17:23:30,700] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 27: [2023-04-29 17:23:30,701] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 27: [2023-04-29 17:23:30,701] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 27: [2023-04-29 17:23:30,702] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 16: [2023-04-29 17:23:30,704] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 24: [2023-04-29 17:23:30,704] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 16: [2023-04-29 17:23:30,704] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 29: [2023-04-29 17:23:30,704] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 29: [2023-04-29 17:23:30,706] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 29: [2023-04-29 17:23:30,706] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 17: [2023-04-29 17:23:30,707] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 29: [2023-04-29 17:23:30,707] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 17: [2023-04-29 17:23:30,707] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 29: [2023-04-29 17:23:30,707] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 31: [2023-04-29 17:23:30,707] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 29: [2023-04-29 17:23:30,708] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 8: [2023-04-29 17:23:30,708] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 8: [2023-04-29 17:23:30,708] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 19: [2023-04-29 17:23:30,707] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 19: [2023-04-29 17:23:30,707] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 8: [2023-04-29 17:23:30,708] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 8: [2023-04-29 17:23:30,708] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 8: [2023-04-29 17:23:30,708] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 8: [2023-04-29 17:23:30,708] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 8: [2023-04-29 17:23:30,708] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 19: [2023-04-29 17:23:30,708] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 8: [2023-04-29 17:23:30,708] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 19: [2023-04-29 17:23:30,708] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 19: [2023-04-29 17:23:30,709] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 19: [2023-04-29 17:23:30,709] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 19: [2023-04-29 17:23:30,709] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 6: [2023-04-29 17:23:30,709] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 6: [2023-04-29 17:23:30,709] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 19: [2023-04-29 17:23:30,709] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 6: [2023-04-29 17:23:30,709] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 6: [2023-04-29 17:23:30,709] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 6: [2023-04-29 17:23:30,709] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 6: [2023-04-29 17:23:30,709] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 6: [2023-04-29 17:23:30,709] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 6: [2023-04-29 17:23:30,710] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 27: [2023-04-29 17:23:30,710] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 27: [2023-04-29 17:23:30,710] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 31: [2023-04-29 17:23:30,710] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 27: [2023-04-29 17:23:30,711] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 31: [2023-04-29 17:23:30,711] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 17: [2023-04-29 17:23:30,710] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 17: [2023-04-29 17:23:30,711] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 17: [2023-04-29 17:23:30,711] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 17: [2023-04-29 17:23:30,711] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 17: [2023-04-29 17:23:30,711] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 17: [2023-04-29 17:23:30,711] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 17: [2023-04-29 17:23:30,711] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 16: [2023-04-29 17:23:30,712] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 8: [2023-04-29 17:23:30,713] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 6: [2023-04-29 17:23:30,714] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 12: [2023-04-29 17:23:30,713] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 19: [2023-04-29 17:23:30,713] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 8: [2023-04-29 17:23:30,714] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 6: [2023-04-29 17:23:30,714] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 31: [2023-04-29 17:23:30,714] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 31: [2023-04-29 17:23:30,714] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 19: [2023-04-29 17:23:30,714] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 24: [2023-04-29 17:23:30,714] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 19: [2023-04-29 17:23:30,714] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 19: [2023-04-29 17:23:30,715] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 17: [2023-04-29 17:23:30,715] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 19: [2023-04-29 17:23:30,716] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 17: [2023-04-29 17:23:30,716] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 19: [2023-04-29 17:23:30,716] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 8: [2023-04-29 17:23:30,715] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 19: [2023-04-29 17:23:30,717] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 23: [2023-04-29 17:23:30,717] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 8: [2023-04-29 17:23:30,717] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 19: [2023-04-29 17:23:30,718] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 8: [2023-04-29 17:23:30,718] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 23: [2023-04-29 17:23:30,718] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 24: [2023-04-29 17:23:30,718] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 24: [2023-04-29 17:23:30,718] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 24: [2023-04-29 17:23:30,718] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 8: [2023-04-29 17:23:30,718] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 16: [2023-04-29 17:23:30,719] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 21: [2023-04-29 17:23:30,719] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 8: [2023-04-29 17:23:30,719] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 25: [2023-04-29 17:23:30,719] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 8: [2023-04-29 17:23:30,719] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 6: [2023-04-29 17:23:30,719] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 6: [2023-04-29 17:23:30,719] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 5: [2023-04-29 17:23:30,719] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 5: [2023-04-29 17:23:30,719] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 6: [2023-04-29 17:23:30,720] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 6: [2023-04-29 17:23:30,720] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 6: [2023-04-29 17:23:30,720] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 16: [2023-04-29 17:23:30,720] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 25: [2023-04-29 17:23:30,720] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 21: [2023-04-29 17:23:30,721] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 16: [2023-04-29 17:23:30,721] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 21: [2023-04-29 17:23:30,721] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 24: [2023-04-29 17:23:30,721] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 25: [2023-04-29 17:23:30,721] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 6: [2023-04-29 17:23:30,721] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 25: [2023-04-29 17:23:30,721] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 25: [2023-04-29 17:23:30,721] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 21: [2023-04-29 17:23:30,721] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 17: [2023-04-29 17:23:30,721] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 17: [2023-04-29 17:23:30,721] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 21: [2023-04-29 17:23:30,721] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 17: [2023-04-29 17:23:30,722] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 17: [2023-04-29 17:23:30,723] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 12: [2023-04-29 17:23:30,723] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 17: [2023-04-29 17:23:30,723] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 5: [2023-04-29 17:23:30,723] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 5: [2023-04-29 17:23:30,723] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 5: [2023-04-29 17:23:30,723] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 5: [2023-04-29 17:23:30,723] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 5: [2023-04-29 17:23:30,723] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 23: [2023-04-29 17:23:30,724] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 5: [2023-04-29 17:23:30,724] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 5: [2023-04-29 17:23:30,724] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 5: [2023-04-29 17:23:30,724] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 27: [2023-04-29 17:23:30,724] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 25: [2023-04-29 17:23:30,725] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 16: [2023-04-29 17:23:30,725] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 16: [2023-04-29 17:23:30,725] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 23: [2023-04-29 17:23:30,726] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 23: [2023-04-29 17:23:30,726] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 23: [2023-04-29 17:23:30,726] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 30: [2023-04-29 17:23:30,728] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 30: [2023-04-29 17:23:30,729] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 30: [2023-04-29 17:23:30,729] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 30: [2023-04-29 17:23:30,729] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 30: [2023-04-29 17:23:30,729] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 30: [2023-04-29 17:23:30,729] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 30: [2023-04-29 17:23:30,729] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 30: [2023-04-29 17:23:30,730] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 5: [2023-04-29 17:23:30,730] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 27: [2023-04-29 17:23:30,731] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 12: [2023-04-29 17:23:30,732] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 5: [2023-04-29 17:23:30,732] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 12: [2023-04-29 17:23:30,733] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 5: [2023-04-29 17:23:30,733] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 5: [2023-04-29 17:23:30,734] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 5: [2023-04-29 17:23:30,734] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 5: [2023-04-29 17:23:30,735] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 27: [2023-04-29 17:23:30,735] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 27: [2023-04-29 17:23:30,737] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 12: [2023-04-29 17:23:30,736] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 12: [2023-04-29 17:23:30,736] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 12: [2023-04-29 17:23:30,736] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 12: [2023-04-29 17:23:30,737] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 18: [2023-04-29 17:23:30,736] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 18: [2023-04-29 17:23:30,736] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 18: [2023-04-29 17:23:30,736] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 18: [2023-04-29 17:23:30,737] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 18: [2023-04-29 17:23:30,737] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 18: [2023-04-29 17:23:30,737] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 18: [2023-04-29 17:23:30,737] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 18: [2023-04-29 17:23:30,737] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 12: [2023-04-29 17:23:30,738] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 24: [2023-04-29 17:23:30,738] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 9: [2023-04-29 17:23:30,738] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 30: [2023-04-29 17:23:30,740] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 30: [2023-04-29 17:23:30,740] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 30: [2023-04-29 17:23:30,741] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 30: [2023-04-29 17:23:30,741] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 30: [2023-04-29 17:23:30,741] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 24: [2023-04-29 17:23:30,741] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 30: [2023-04-29 17:23:30,741] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 24: [2023-04-29 17:23:30,741] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 30: [2023-04-29 17:23:30,742] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 7: [2023-04-29 17:23:30,742] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 7: [2023-04-29 17:23:30,742] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 7: [2023-04-29 17:23:30,742] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 7: [2023-04-29 17:23:30,743] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 7: [2023-04-29 17:23:30,743] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 7: [2023-04-29 17:23:30,743] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 7: [2023-04-29 17:23:30,743] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 7: [2023-04-29 17:23:30,743] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 0: [2023-04-29 17:23:30,743] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 30: [2023-04-29 17:23:30,743] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 27: [2023-04-29 17:23:30,744] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 27: [2023-04-29 17:23:30,744] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 7: [2023-04-29 17:23:30,746] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 27: [2023-04-29 17:23:30,745] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 0: [2023-04-29 17:23:30,746] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 9: [2023-04-29 17:23:30,747] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 9: [2023-04-29 17:23:30,747] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 9: [2023-04-29 17:23:30,747] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 9: [2023-04-29 17:23:30,747] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 7: [2023-04-29 17:23:30,747] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 7: [2023-04-29 17:23:30,747] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 9: [2023-04-29 17:23:30,748] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 18: [2023-04-29 17:23:30,749] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 7: [2023-04-29 17:23:30,749] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 7: [2023-04-29 17:23:30,750] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 22: [2023-04-29 17:23:30,750] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 22: [2023-04-29 17:23:30,750] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 29: [2023-04-29 17:23:30,750] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 7: [2023-04-29 17:23:30,750] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 7: [2023-04-29 17:23:30,750] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 18: [2023-04-29 17:23:30,750] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 7: [2023-04-29 17:23:30,751] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 18: [2023-04-29 17:23:30,751] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 24: [2023-04-29 17:23:30,751] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 22: [2023-04-29 17:23:30,751] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 18: [2023-04-29 17:23:30,751] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 22: [2023-04-29 17:23:30,751] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 22: [2023-04-29 17:23:30,751] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 22: [2023-04-29 17:23:30,751] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 22: [2023-04-29 17:23:30,751] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 22: [2023-04-29 17:23:30,752] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 18: [2023-04-29 17:23:30,752] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 18: [2023-04-29 17:23:30,752] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 9: [2023-04-29 17:23:30,752] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 9: [2023-04-29 17:23:30,752] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 24: [2023-04-29 17:23:30,752] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 24: [2023-04-29 17:23:30,752] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 18: [2023-04-29 17:23:30,753] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 22: [2023-04-29 17:23:30,754] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 29: [2023-04-29 17:23:30,754] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 22: [2023-04-29 17:23:30,754] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 18: [2023-04-29 17:23:30,755] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 28: [2023-04-29 17:23:30,756] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 28: [2023-04-29 17:23:30,756] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 28: [2023-04-29 17:23:30,756] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 28: [2023-04-29 17:23:30,756] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 28: [2023-04-29 17:23:30,756] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 28: [2023-04-29 17:23:30,756] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 28: [2023-04-29 17:23:30,756] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 28: [2023-04-29 17:23:30,756] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 24: [2023-04-29 17:23:30,758] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 8: [2023-04-29 17:23:30,761] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 22: [2023-04-29 17:23:30,760] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 22: [2023-04-29 17:23:30,761] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 3: [2023-04-29 17:23:30,762] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 3: [2023-04-29 17:23:30,762] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 22: [2023-04-29 17:23:30,762] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 22: [2023-04-29 17:23:30,762] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 9: [2023-04-29 17:23:30,763] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 8: [2023-04-29 17:23:30,763] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 22: [2023-04-29 17:23:30,763] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 28: [2023-04-29 17:23:30,763] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 22: [2023-04-29 17:23:30,763] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 3: [2023-04-29 17:23:30,764] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 12: [2023-04-29 17:23:30,764] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 12: [2023-04-29 17:23:30,764] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 3: [2023-04-29 17:23:30,764] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 3: [2023-04-29 17:23:30,764] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 3: [2023-04-29 17:23:30,764] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 3: [2023-04-29 17:23:30,764] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 3: [2023-04-29 17:23:30,765] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 12: [2023-04-29 17:23:30,766] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 6: [2023-04-29 17:23:30,766] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 3: [2023-04-29 17:23:30,766] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 3: [2023-04-29 17:23:30,766] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 6: [2023-04-29 17:23:30,767] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 17: [2023-04-29 17:23:30,766] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 19: [2023-04-29 17:23:30,768] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 19: [2023-04-29 17:23:30,768] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 0: [2023-04-29 17:23:30,769] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 19: [2023-04-29 17:23:30,769] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 28: [2023-04-29 17:23:30,769] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 12: [2023-04-29 17:23:30,770] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 17: [2023-04-29 17:23:30,770] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 28: [2023-04-29 17:23:30,770] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 28: [2023-04-29 17:23:30,770] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 28: [2023-04-29 17:23:30,770] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 29: [2023-04-29 17:23:30,771] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 28: [2023-04-29 17:23:30,771] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 29: [2023-04-29 17:23:30,771] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 0: [2023-04-29 17:23:30,771] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 28: [2023-04-29 17:23:30,771] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 24: [2023-04-29 17:23:30,771] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 24: [2023-04-29 17:23:30,771] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 0: [2023-04-29 17:23:30,772] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 12: [2023-04-29 17:23:30,772] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 28: [2023-04-29 17:23:30,772] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 12: [2023-04-29 17:23:30,772] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 29: [2023-04-29 17:23:30,772] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 3: [2023-04-29 17:23:30,773] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 3: [2023-04-29 17:23:30,773] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 3: [2023-04-29 17:23:30,774] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 3: [2023-04-29 17:23:30,774] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 3: [2023-04-29 17:23:30,774] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 0: [2023-04-29 17:23:30,774] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 3: [2023-04-29 17:23:30,775] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 9: [2023-04-29 17:23:30,775] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 9: [2023-04-29 17:23:30,775] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 5: [2023-04-29 17:23:30,775] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 5: [2023-04-29 17:23:30,775] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 29: [2023-04-29 17:23:30,775] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 9: [2023-04-29 17:23:30,776] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 9: [2023-04-29 17:23:30,776] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 9: [2023-04-29 17:23:30,776] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 9: [2023-04-29 17:23:30,778] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 29: [2023-04-29 17:23:30,778] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 29: [2023-04-29 17:23:30,778] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 0: [2023-04-29 17:23:30,779] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 0: [2023-04-29 17:23:30,779] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 0: [2023-04-29 17:23:30,779] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 0: [2023-04-29 17:23:30,779] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 8: [2023-04-29 17:23:30,779] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 9: [2023-04-29 17:23:30,780] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 13: [2023-04-29 17:23:30,780] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 13: [2023-04-29 17:23:30,780] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 13: [2023-04-29 17:23:30,780] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 13: [2023-04-29 17:23:30,780] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 13: [2023-04-29 17:23:30,780] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 13: [2023-04-29 17:23:30,780] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 13: [2023-04-29 17:23:30,780] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 13: [2023-04-29 17:23:30,781] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 19: [2023-04-29 17:23:30,782] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 19: [2023-04-29 17:23:30,782] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 19: [2023-04-29 17:23:30,782] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 19: [2023-04-29 17:23:30,782] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 8: [2023-04-29 17:23:30,782] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 8: [2023-04-29 17:23:30,782] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 8: [2023-04-29 17:23:30,783] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 8: [2023-04-29 17:23:30,783] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 8: [2023-04-29 17:23:30,783] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 8: [2023-04-29 17:23:30,783] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 19: [2023-04-29 17:23:30,783] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 13: [2023-04-29 17:23:30,786] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 13: [2023-04-29 17:23:30,786] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 17: [2023-04-29 17:23:30,785] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 6: [2023-04-29 17:23:30,787] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 13: [2023-04-29 17:23:30,787] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 13: [2023-04-29 17:23:30,787] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 6: [2023-04-29 17:23:30,787] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 8: [2023-04-29 17:23:30,787] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 6: [2023-04-29 17:23:30,788] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 6: [2023-04-29 17:23:30,788] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 17: [2023-04-29 17:23:30,789] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 13: [2023-04-29 17:23:30,789] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 6: [2023-04-29 17:23:30,790] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 5: [2023-04-29 17:23:30,790] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 19: [2023-04-29 17:23:30,790] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 13: [2023-04-29 17:23:30,790] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 7: [2023-04-29 17:23:30,791] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 13: [2023-04-29 17:23:30,791] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 13: [2023-04-29 17:23:30,792] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 19: [2023-04-29 17:23:30,792] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 29: [2023-04-29 17:23:30,793] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 17: [2023-04-29 17:23:30,793] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 17: [2023-04-29 17:23:30,793] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 19: [2023-04-29 17:23:30,793] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 17: [2023-04-29 17:23:30,793] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 17: [2023-04-29 17:23:30,794] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 5: [2023-04-29 17:23:30,795] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 5: [2023-04-29 17:23:30,795] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 11: [2023-04-29 17:23:30,795] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 11: [2023-04-29 17:23:30,795] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 11: [2023-04-29 17:23:30,797] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 11: [2023-04-29 17:23:30,798] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 11: [2023-04-29 17:23:30,798] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 11: [2023-04-29 17:23:30,798] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 11: [2023-04-29 17:23:30,798] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 11: [2023-04-29 17:23:30,798] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 29: [2023-04-29 17:23:30,800] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 11: [2023-04-29 17:23:30,800] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 11: [2023-04-29 17:23:30,800] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 11: [2023-04-29 17:23:30,800] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 6: [2023-04-29 17:23:30,801] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 6: [2023-04-29 17:23:30,801] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 29: [2023-04-29 17:23:30,801] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 29: [2023-04-29 17:23:30,802] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 17: [2023-04-29 17:23:30,802] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 17: [2023-04-29 17:23:30,802] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 8: [2023-04-29 17:23:30,804] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 11: [2023-04-29 17:23:30,805] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 6: [2023-04-29 17:23:30,806] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 11: [2023-04-29 17:23:30,806] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 7: [2023-04-29 17:23:30,806] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 11: [2023-04-29 17:23:30,807] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 22: [2023-04-29 17:23:30,806] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 22: [2023-04-29 17:23:30,806] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 5: [2023-04-29 17:23:30,807] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 5: [2023-04-29 17:23:30,807] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 11: [2023-04-29 17:23:30,807] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 29: [2023-04-29 17:23:30,808] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 11: [2023-04-29 17:23:30,808] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 29: [2023-04-29 17:23:30,808] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 7: [2023-04-29 17:23:30,809] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 7: [2023-04-29 17:23:30,810] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 5: [2023-04-29 17:23:30,810] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 5: [2023-04-29 17:23:30,810] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 5: [2023-04-29 17:23:30,810] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 7: [2023-04-29 17:23:30,811] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 19: [2023-04-29 17:23:30,812] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 19: [2023-04-29 17:23:30,812] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 19: [2023-04-29 17:23:30,812] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 8: [2023-04-29 17:23:30,812] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 8: [2023-04-29 17:23:30,813] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 8: [2023-04-29 17:23:30,813] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 8: [2023-04-29 17:23:30,814] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 19: [2023-04-29 17:23:30,814] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 30: [2023-04-29 17:23:30,813] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 8: [2023-04-29 17:23:30,815] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 5: [2023-04-29 17:23:30,815] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 19: [2023-04-29 17:23:30,815] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 1: [2023-04-29 17:23:30,816] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 1: [2023-04-29 17:23:30,816] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 1: [2023-04-29 17:23:30,816] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 1: [2023-04-29 17:23:30,816] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 1: [2023-04-29 17:23:30,816] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 1: [2023-04-29 17:23:30,816] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 1: [2023-04-29 17:23:30,816] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 1: [2023-04-29 17:23:30,816] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 17: [2023-04-29 17:23:30,816] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 6: [2023-04-29 17:23:30,818] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 3: [2023-04-29 17:23:30,818] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 3: [2023-04-29 17:23:30,818] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 6: [2023-04-29 17:23:30,819] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 7: [2023-04-29 17:23:30,820] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 7: [2023-04-29 17:23:30,820] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 7: [2023-04-29 17:23:30,820] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 6: [2023-04-29 17:23:30,821] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 1: [2023-04-29 17:23:30,821] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 7: [2023-04-29 17:23:30,821] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 1: [2023-04-29 17:23:30,821] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 22: [2023-04-29 17:23:30,821] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 1: [2023-04-29 17:23:30,822] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 1: [2023-04-29 17:23:30,823] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 1: [2023-04-29 17:23:30,823] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 1: [2023-04-29 17:23:30,823] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 1: [2023-04-29 17:23:30,823] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 0: [2023-04-29 17:23:30,797] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 29: [2023-04-29 17:23:30,823] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 0: [2023-04-29 17:23:30,799] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 0: [2023-04-29 17:23:30,809] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 0: [2023-04-29 17:23:30,812] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 0: [2023-04-29 17:23:30,814] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 0: [2023-04-29 17:23:30,814] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 1: [2023-04-29 17:23:30,824] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 28: [2023-04-29 17:23:30,826] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 18: [2023-04-29 17:23:30,826] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 17: [2023-04-29 17:23:30,827] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 15: [2023-04-29 17:23:30,827] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 15: [2023-04-29 17:23:30,827] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 15: [2023-04-29 17:23:30,827] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 15: [2023-04-29 17:23:30,827] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 15: [2023-04-29 17:23:30,827] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 15: [2023-04-29 17:23:30,827] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 15: [2023-04-29 17:23:30,827] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 15: [2023-04-29 17:23:30,827] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 17: [2023-04-29 17:23:30,828] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 22: [2023-04-29 17:23:30,828] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 29: [2023-04-29 17:23:30,828] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 22: [2023-04-29 17:23:30,828] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 18: [2023-04-29 17:23:30,828] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 18: [2023-04-29 17:23:30,828] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 17: [2023-04-29 17:23:30,829] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 17: [2023-04-29 17:23:30,831] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 14: [2023-04-29 17:23:30,831] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 18: [2023-04-29 17:23:30,831] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 14: [2023-04-29 17:23:30,831] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 14: [2023-04-29 17:23:30,832] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 14: [2023-04-29 17:23:30,832] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 14: [2023-04-29 17:23:30,832] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 14: [2023-04-29 17:23:30,832] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 14: [2023-04-29 17:23:30,832] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 22: [2023-04-29 17:23:30,832] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 22: [2023-04-29 17:23:30,832] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 17: [2023-04-29 17:23:30,832] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 14: [2023-04-29 17:23:30,832] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 22: [2023-04-29 17:23:30,832] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 30: [2023-04-29 17:23:30,831] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 30: [2023-04-29 17:23:30,831] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 30: [2023-04-29 17:23:30,831] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 30: [2023-04-29 17:23:30,831] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 30: [2023-04-29 17:23:30,831] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 6: [2023-04-29 17:23:30,832] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 30: [2023-04-29 17:23:30,832] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 30: [2023-04-29 17:23:30,833] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 5: [2023-04-29 17:23:30,835] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 14: [2023-04-29 17:23:30,835] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 14: [2023-04-29 17:23:30,835] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 7: [2023-04-29 17:23:30,835] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 6: [2023-04-29 17:23:30,836] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 6: [2023-04-29 17:23:30,836] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 5: [2023-04-29 17:23:30,836] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 7: [2023-04-29 17:23:30,836] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 7: [2023-04-29 17:23:30,837] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 15: [2023-04-29 17:23:30,838] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 30: [2023-04-29 17:23:30,838] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 15: [2023-04-29 17:23:30,838] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 15: [2023-04-29 17:23:30,839] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 3: [2023-04-29 17:23:30,839] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 22: [2023-04-29 17:23:30,840] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 15: [2023-04-29 17:23:30,840] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 13: [2023-04-29 17:23:30,840] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 3: [2023-04-29 17:23:30,840] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 15: [2023-04-29 17:23:30,840] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 13: [2023-04-29 17:23:30,840] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 3: [2023-04-29 17:23:30,840] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 15: [2023-04-29 17:23:30,841] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 15: [2023-04-29 17:23:30,841] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 14: [2023-04-29 17:23:30,841] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 14: [2023-04-29 17:23:30,842] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 14: [2023-04-29 17:23:30,842] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 15: [2023-04-29 17:23:30,842] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt... 14: [2023-04-29 17:23:30,842] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 14: [2023-04-29 17:23:30,843] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 5: [2023-04-29 17:23:30,843] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 14: [2023-04-29 17:23:30,843] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 5: [2023-04-29 17:23:30,844] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 5: [2023-04-29 17:23:30,844] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 3: [2023-04-29 17:23:30,845] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 3: [2023-04-29 17:23:30,845] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 3: [2023-04-29 17:23:30,845] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 3: [2023-04-29 17:23:30,845] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 3: [2023-04-29 17:23:30,845] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 7: [2023-04-29 17:23:30,847] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 22: [2023-04-29 17:23:30,848] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 13: [2023-04-29 17:23:30,848] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 7: [2023-04-29 17:23:30,850] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 22: [2023-04-29 17:23:30,850] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 28: [2023-04-29 17:23:30,851] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 28: [2023-04-29 17:23:30,851] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 7: [2023-04-29 17:23:30,852] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 13: [2023-04-29 17:23:30,851] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 7: [2023-04-29 17:23:30,852] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 18: [2023-04-29 17:23:30,852] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 28: [2023-04-29 17:23:30,853] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 11: [2023-04-29 17:23:30,855] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 11: [2023-04-29 17:23:30,855] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 11: [2023-04-29 17:23:30,855] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 18: [2023-04-29 17:23:30,857] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 18: [2023-04-29 17:23:30,857] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 18: [2023-04-29 17:23:30,857] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 18: [2023-04-29 17:23:30,857] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 18: [2023-04-29 17:23:30,860] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 18: [2023-04-29 17:23:30,860] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 11: [2023-04-29 17:23:30,861] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 22: [2023-04-29 17:23:30,861] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 13: [2023-04-29 17:23:30,862] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 13: [2023-04-29 17:23:30,863] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 18: [2023-04-29 17:23:30,863] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 30: [2023-04-29 17:23:30,864] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 22: [2023-04-29 17:23:30,865] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 22: [2023-04-29 17:23:30,865] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 28: [2023-04-29 17:23:30,865] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 28: [2023-04-29 17:23:30,865] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 28: [2023-04-29 17:23:30,865] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 28: [2023-04-29 17:23:30,865] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 28: [2023-04-29 17:23:30,865] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 13: [2023-04-29 17:23:30,866] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 3: [2023-04-29 17:23:30,867] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 30: [2023-04-29 17:23:30,867] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 22: [2023-04-29 17:23:30,869] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 13: [2023-04-29 17:23:30,871] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 13: [2023-04-29 17:23:30,872] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 30: [2023-04-29 17:23:30,872] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 30: [2023-04-29 17:23:30,872] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 1: [2023-04-29 17:23:30,872] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 11: [2023-04-29 17:23:30,873] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 11: [2023-04-29 17:23:30,873] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 11: [2023-04-29 17:23:30,874] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 13: [2023-04-29 17:23:30,875] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 30: [2023-04-29 17:23:30,875] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 11: [2023-04-29 17:23:30,875] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 30: [2023-04-29 17:23:30,875] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 30: [2023-04-29 17:23:30,875] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 3: [2023-04-29 17:23:30,876] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 22: [2023-04-29 17:23:30,877] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 3: [2023-04-29 17:23:30,877] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 28: [2023-04-29 17:23:30,877] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 13: [2023-04-29 17:23:30,878] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 11: [2023-04-29 17:23:30,878] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 11: [2023-04-29 17:23:30,878] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 11: [2023-04-29 17:23:30,878] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 3: [2023-04-29 17:23:30,878] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 3: [2023-04-29 17:23:30,880] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 28: [2023-04-29 17:23:30,880] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 13: [2023-04-29 17:23:30,880] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 3: [2023-04-29 17:23:30,880] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 1: [2023-04-29 17:23:30,880] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 1: [2023-04-29 17:23:30,880] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 1: [2023-04-29 17:23:30,880] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 1: [2023-04-29 17:23:30,885] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 1: [2023-04-29 17:23:30,886] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 14: [2023-04-29 17:23:30,886] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 18: [2023-04-29 17:23:30,887] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 18: [2023-04-29 17:23:30,887] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 11: [2023-04-29 17:23:30,887] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 1: [2023-04-29 17:23:30,887] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 1: [2023-04-29 17:23:30,887] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 14: [2023-04-29 17:23:30,888] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 18: [2023-04-29 17:23:30,888] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 18: [2023-04-29 17:23:30,889] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 13: [2023-04-29 17:23:30,892] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 28: [2023-04-29 17:23:30,896] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 28: [2023-04-29 17:23:30,897] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 1: [2023-04-29 17:23:30,899] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 28: [2023-04-29 17:23:30,899] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 13: [2023-04-29 17:23:30,900] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 13: [2023-04-29 17:23:30,901] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 11: [2023-04-29 17:23:30,902] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 1: [2023-04-29 17:23:30,904] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 28: [2023-04-29 17:23:30,904] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 28: [2023-04-29 17:23:30,904] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 11: [2023-04-29 17:23:30,905] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 11: [2023-04-29 17:23:30,905] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 11: [2023-04-29 17:23:30,905] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 1: [2023-04-29 17:23:30,905] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 14: [2023-04-29 17:23:30,905] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 13: [2023-04-29 17:23:30,905] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 1: [2023-04-29 17:23:30,906] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 14: [2023-04-29 17:23:30,907] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 14: [2023-04-29 17:23:30,912] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 14: [2023-04-29 17:23:30,912] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 1: [2023-04-29 17:23:30,913] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 1: [2023-04-29 17:23:30,914] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 15: [2023-04-29 17:23:30,913] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 15: [2023-04-29 17:23:30,913] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 2: [2023-04-29 17:23:30,914] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 2: [2023-04-29 17:23:30,914] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 1: [2023-04-29 17:23:30,915] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 1: [2023-04-29 17:23:30,916] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 15: [2023-04-29 17:23:30,915] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 14: [2023-04-29 17:23:30,916] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 14: [2023-04-29 17:23:30,916] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 14: [2023-04-29 17:23:30,916] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 14: [2023-04-29 17:23:30,916] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 2: [2023-04-29 17:23:30,917] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 2: [2023-04-29 17:23:30,917] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 2: [2023-04-29 17:23:30,917] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 2: [2023-04-29 17:23:30,917] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 2: [2023-04-29 17:23:30,917] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 2: [2023-04-29 17:23:30,918] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 2: [2023-04-29 17:23:30,919] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 2: [2023-04-29 17:23:30,920] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 15: [2023-04-29 17:23:30,920] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 2: [2023-04-29 17:23:30,922] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 2: [2023-04-29 17:23:30,924] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 2: [2023-04-29 17:23:30,925] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 2: [2023-04-29 17:23:30,927] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 2: [2023-04-29 17:23:30,927] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 2: [2023-04-29 17:23:30,928] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 15: [2023-04-29 17:23:30,939] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 15: [2023-04-29 17:23:30,942] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 14: [2023-04-29 17:23:30,941] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 15: [2023-04-29 17:23:30,943] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 14: [2023-04-29 17:23:30,942] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 20: [2023-04-29 17:23:30,944] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 20: [2023-04-29 17:23:30,944] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 15: [2023-04-29 17:23:30,945] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 15: [2023-04-29 17:23:30,945] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 15: [2023-04-29 17:23:30,946] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_33-model_00-model_states.pt. 20: [2023-04-29 17:23:30,946] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 20: [2023-04-29 17:23:30,947] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 20: [2023-04-29 17:23:30,947] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 20: [2023-04-29 17:23:30,947] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 4: [2023-04-29 17:23:30,947] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 20: [2023-04-29 17:23:30,947] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 14: [2023-04-29 17:23:30,947] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 20: [2023-04-29 17:23:30,947] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 4: [2023-04-29 17:23:30,947] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 15: [2023-04-29 17:23:30,947] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 14: [2023-04-29 17:23:30,950] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 4: [2023-04-29 17:23:30,950] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 4: [2023-04-29 17:23:30,951] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 4: [2023-04-29 17:23:30,951] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 4: [2023-04-29 17:23:30,951] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 4: [2023-04-29 17:23:30,951] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 20: [2023-04-29 17:23:30,951] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 4: [2023-04-29 17:23:30,951] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 4: [2023-04-29 17:23:30,951] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 20: [2023-04-29 17:23:30,952] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 20: [2023-04-29 17:23:30,952] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 20: [2023-04-29 17:23:30,952] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 14: [2023-04-29 17:23:30,953] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 14: [2023-04-29 17:23:30,953] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 20: [2023-04-29 17:23:30,953] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 20: [2023-04-29 17:23:30,954] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 15: [2023-04-29 17:23:30,954] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 4: [2023-04-29 17:23:30,955] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 4: [2023-04-29 17:23:30,956] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 20: [2023-04-29 17:23:30,955] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 20: [2023-04-29 17:23:30,956] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 4: [2023-04-29 17:23:30,960] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 4: [2023-04-29 17:23:30,961] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 4: [2023-04-29 17:23:30,962] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 4: [2023-04-29 17:23:30,962] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 4: [2023-04-29 17:23:30,963] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 15: [2023-04-29 17:23:30,968] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 27: [2023-04-29 17:23:30,969] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 27: [2023-04-29 17:23:30,970] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 27: [2023-04-29 17:23:30,970] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 27: [2023-04-29 17:23:30,970] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 27: [2023-04-29 17:23:30,970] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 27: [2023-04-29 17:23:30,970] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 27: [2023-04-29 17:23:30,970] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 15: [2023-04-29 17:23:30,970] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 27: [2023-04-29 17:23:30,970] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 27: [2023-04-29 17:23:30,973] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 2: [2023-04-29 17:23:30,974] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 2: [2023-04-29 17:23:30,974] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 2: [2023-04-29 17:23:30,974] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 15: [2023-04-29 17:23:30,976] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 15: [2023-04-29 17:23:30,977] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 24: [2023-04-29 17:23:30,977] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 24: [2023-04-29 17:23:30,978] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 24: [2023-04-29 17:23:30,978] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 24: [2023-04-29 17:23:30,978] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 24: [2023-04-29 17:23:30,978] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 24: [2023-04-29 17:23:30,978] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 24: [2023-04-29 17:23:30,978] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 2: [2023-04-29 17:23:30,981] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 27: [2023-04-29 17:23:30,982] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 27: [2023-04-29 17:23:30,982] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 27: [2023-04-29 17:23:30,983] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 27: [2023-04-29 17:23:30,983] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 27: [2023-04-29 17:23:30,983] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 27: [2023-04-29 17:23:30,984] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 27: [2023-04-29 17:23:30,985] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 2: [2023-04-29 17:23:30,994] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 2: [2023-04-29 17:23:30,994] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 2: [2023-04-29 17:23:30,994] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 2: [2023-04-29 17:23:30,996] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 2: [2023-04-29 17:23:30,996] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 2: [2023-04-29 17:23:30,999] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 20: [2023-04-29 17:23:30,998] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 2: [2023-04-29 17:23:30,999] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 20: [2023-04-29 17:23:31,000] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 4: [2023-04-29 17:23:31,003] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 4: [2023-04-29 17:23:31,004] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 2: [2023-04-29 17:23:31,006] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 20: [2023-04-29 17:23:31,010] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 20: [2023-04-29 17:23:31,014] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 27: [2023-04-29 17:23:31,015] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 26: [2023-04-29 17:23:31,014] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 26: [2023-04-29 17:23:31,014] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 21: [2023-04-29 17:23:31,015] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 21: [2023-04-29 17:23:31,015] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 21: [2023-04-29 17:23:31,015] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 21: [2023-04-29 17:23:31,015] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 21: [2023-04-29 17:23:31,015] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 21: [2023-04-29 17:23:31,015] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 21: [2023-04-29 17:23:31,015] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 26: [2023-04-29 17:23:31,015] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 26: [2023-04-29 17:23:31,015] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 21: [2023-04-29 17:23:31,016] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 26: [2023-04-29 17:23:31,015] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 26: [2023-04-29 17:23:31,016] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 26: [2023-04-29 17:23:31,016] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 26: [2023-04-29 17:23:31,016] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 9: [2023-04-29 17:23:31,017] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 9: [2023-04-29 17:23:31,017] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 9: [2023-04-29 17:23:31,017] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 9: [2023-04-29 17:23:31,017] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 9: [2023-04-29 17:23:31,017] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 9: [2023-04-29 17:23:31,017] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 9: [2023-04-29 17:23:31,017] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 9: [2023-04-29 17:23:31,017] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 24: [2023-04-29 17:23:30,978] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 24: [2023-04-29 17:23:30,982] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 24: [2023-04-29 17:23:30,989] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 24: [2023-04-29 17:23:30,989] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 24: [2023-04-29 17:23:30,990] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 24: [2023-04-29 17:23:30,991] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 24: [2023-04-29 17:23:30,991] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 24: [2023-04-29 17:23:30,991] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 24: [2023-04-29 17:23:30,992] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 26: [2023-04-29 17:23:31,020] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 21: [2023-04-29 17:23:31,020] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 21: [2023-04-29 17:23:31,020] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 21: [2023-04-29 17:23:31,021] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 21: [2023-04-29 17:23:31,021] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 21: [2023-04-29 17:23:31,021] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 9: [2023-04-29 17:23:31,021] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 9: [2023-04-29 17:23:31,021] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 9: [2023-04-29 17:23:31,022] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 9: [2023-04-29 17:23:31,022] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 20: [2023-04-29 17:23:31,022] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 21: [2023-04-29 17:23:31,022] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 26: [2023-04-29 17:23:31,022] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 21: [2023-04-29 17:23:31,022] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 20: [2023-04-29 17:23:31,022] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 20: [2023-04-29 17:23:31,022] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 20: [2023-04-29 17:23:31,022] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 9: [2023-04-29 17:23:31,022] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 26: [2023-04-29 17:23:31,023] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 21: [2023-04-29 17:23:31,023] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 26: [2023-04-29 17:23:31,023] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 9: [2023-04-29 17:23:31,023] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 26: [2023-04-29 17:23:31,023] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 9: [2023-04-29 17:23:31,023] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 9: [2023-04-29 17:23:31,023] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 26: [2023-04-29 17:23:31,024] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 4: [2023-04-29 17:23:31,024] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 26: [2023-04-29 17:23:31,024] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 26: [2023-04-29 17:23:31,024] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 4: [2023-04-29 17:23:31,025] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 2: [2023-04-29 17:23:31,026] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 2: [2023-04-29 17:23:31,026] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 2: [2023-04-29 17:23:31,026] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 2: [2023-04-29 17:23:31,026] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 20: [2023-04-29 17:23:31,027] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 20: [2023-04-29 17:23:31,027] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 12: [2023-04-29 17:23:31,028] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 12: [2023-04-29 17:23:31,028] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 10: [2023-04-29 17:23:31,030] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 10: [2023-04-29 17:23:31,030] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 10: [2023-04-29 17:23:31,030] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 12: [2023-04-29 17:23:31,030] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 10: [2023-04-29 17:23:31,031] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 12: [2023-04-29 17:23:31,031] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 10: [2023-04-29 17:23:31,031] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 10: [2023-04-29 17:23:31,031] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 10: [2023-04-29 17:23:31,031] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 10: [2023-04-29 17:23:31,031] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 12: [2023-04-29 17:23:31,031] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 12: [2023-04-29 17:23:31,031] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 12: [2023-04-29 17:23:31,031] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 12: [2023-04-29 17:23:31,031] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 12: [2023-04-29 17:23:31,032] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 4: [2023-04-29 17:23:31,032] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 12: [2023-04-29 17:23:31,033] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 4: [2023-04-29 17:23:31,033] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 4: [2023-04-29 17:23:31,034] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 27: [2023-04-29 17:23:31,034] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 4: [2023-04-29 17:23:31,036] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 10: [2023-04-29 17:23:31,036] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 10: [2023-04-29 17:23:31,037] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 10: [2023-04-29 17:23:31,037] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 10: [2023-04-29 17:23:31,037] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 10: [2023-04-29 17:23:31,038] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 20: [2023-04-29 17:23:31,039] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 20: [2023-04-29 17:23:31,040] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 4: [2023-04-29 17:23:31,040] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 4: [2023-04-29 17:23:31,040] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 10: [2023-04-29 17:23:31,040] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 10: [2023-04-29 17:23:31,040] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 10: [2023-04-29 17:23:31,040] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 12: [2023-04-29 17:23:31,041] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 12: [2023-04-29 17:23:31,042] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 12: [2023-04-29 17:23:31,042] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 12: [2023-04-29 17:23:31,042] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 12: [2023-04-29 17:23:31,043] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 12: [2023-04-29 17:23:31,044] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 16: [2023-04-29 17:23:31,046] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 16: [2023-04-29 17:23:31,046] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 16: [2023-04-29 17:23:31,046] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 16: [2023-04-29 17:23:31,047] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 16: [2023-04-29 17:23:31,047] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 16: [2023-04-29 17:23:31,047] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 16: [2023-04-29 17:23:31,047] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 16: [2023-04-29 17:23:31,047] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 16: [2023-04-29 17:23:31,052] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 16: [2023-04-29 17:23:31,052] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 16: [2023-04-29 17:23:31,052] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 16: [2023-04-29 17:23:31,053] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 16: [2023-04-29 17:23:31,054] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 16: [2023-04-29 17:23:31,054] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 16: [2023-04-29 17:23:31,054] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 20: [2023-04-29 17:23:31,054] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 16: [2023-04-29 17:23:31,054] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 27: [2023-04-29 17:23:31,058] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 27: [2023-04-29 17:23:31,058] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 27: [2023-04-29 17:23:31,058] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 20: [2023-04-29 17:23:31,060] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 4: [2023-04-29 17:23:31,060] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 29: [2023-04-29 17:23:31,060] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 29: [2023-04-29 17:23:31,060] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 27: [2023-04-29 17:23:31,060] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 27: [2023-04-29 17:23:31,060] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 27: [2023-04-29 17:23:31,060] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 27: [2023-04-29 17:23:31,060] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 7: [2023-04-29 17:23:31,061] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 7: [2023-04-29 17:23:31,061] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 7: [2023-04-29 17:23:31,061] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 7: [2023-04-29 17:23:31,062] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 7: [2023-04-29 17:23:31,062] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 7: [2023-04-29 17:23:31,062] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 7: [2023-04-29 17:23:31,062] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 7: [2023-04-29 17:23:31,062] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 20: [2023-04-29 17:23:31,062] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 20: [2023-04-29 17:23:31,062] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 24: [2023-04-29 17:23:31,032] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 24: [2023-04-29 17:23:31,053] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 24: [2023-04-29 17:23:31,060] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 31: [2023-04-29 17:23:31,063] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 31: [2023-04-29 17:23:31,063] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 31: [2023-04-29 17:23:31,063] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 31: [2023-04-29 17:23:31,064] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 31: [2023-04-29 17:23:31,064] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 31: [2023-04-29 17:23:31,064] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 31: [2023-04-29 17:23:31,064] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 31: [2023-04-29 17:23:31,064] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 4: [2023-04-29 17:23:31,064] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 29: [2023-04-29 17:23:31,065] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 29: [2023-04-29 17:23:31,065] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 29: [2023-04-29 17:23:31,065] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 29: [2023-04-29 17:23:31,065] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 29: [2023-04-29 17:23:31,065] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 29: [2023-04-29 17:23:31,065] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 29: [2023-04-29 17:23:31,065] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 29: [2023-04-29 17:23:31,065] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 7: [2023-04-29 17:23:31,065] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 7: [2023-04-29 17:23:31,066] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 24: [2023-04-29 17:23:31,066] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 24: [2023-04-29 17:23:31,066] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 7: [2023-04-29 17:23:31,066] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 7: [2023-04-29 17:23:31,068] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 31: [2023-04-29 17:23:31,068] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 31: [2023-04-29 17:23:31,068] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 31: [2023-04-29 17:23:31,069] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 7: [2023-04-29 17:23:31,069] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 7: [2023-04-29 17:23:31,069] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 31: [2023-04-29 17:23:31,069] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 4: [2023-04-29 17:23:31,069] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 4: [2023-04-29 17:23:31,069] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 7: [2023-04-29 17:23:31,069] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 7: [2023-04-29 17:23:31,070] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 31: [2023-04-29 17:23:31,070] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 31: [2023-04-29 17:23:31,070] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 6: [2023-04-29 17:23:31,070] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 6: [2023-04-29 17:23:31,070] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 31: [2023-04-29 17:23:31,071] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 6: [2023-04-29 17:23:31,071] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 29: [2023-04-29 17:23:31,071] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 31: [2023-04-29 17:23:31,071] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 6: [2023-04-29 17:23:31,071] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 6: [2023-04-29 17:23:31,071] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 6: [2023-04-29 17:23:31,071] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 6: [2023-04-29 17:23:31,071] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 6: [2023-04-29 17:23:31,071] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 24: [2023-04-29 17:23:31,072] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 24: [2023-04-29 17:23:31,072] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 22: [2023-04-29 17:23:31,073] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 22: [2023-04-29 17:23:31,073] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 22: [2023-04-29 17:23:31,073] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 22: [2023-04-29 17:23:31,073] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 22: [2023-04-29 17:23:31,073] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 22: [2023-04-29 17:23:31,073] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 22: [2023-04-29 17:23:31,073] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 22: [2023-04-29 17:23:31,074] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 9: [2023-04-29 17:23:31,073] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 6: [2023-04-29 17:23:31,074] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 29: [2023-04-29 17:23:31,074] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 6: [2023-04-29 17:23:31,075] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 9: [2023-04-29 17:23:31,075] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 29: [2023-04-29 17:23:31,076] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 29: [2023-04-29 17:23:31,076] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 21: [2023-04-29 17:23:31,076] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 21: [2023-04-29 17:23:31,076] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 29: [2023-04-29 17:23:31,076] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 29: [2023-04-29 17:23:31,077] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 12: [2023-04-29 17:23:31,077] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 21: [2023-04-29 17:23:31,076] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 12: [2023-04-29 17:23:31,077] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 22: [2023-04-29 17:23:31,077] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 22: [2023-04-29 17:23:31,078] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 4: [2023-04-29 17:23:31,078] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 4: [2023-04-29 17:23:31,078] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 26: [2023-04-29 17:23:31,079] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 26: [2023-04-29 17:23:31,079] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 21: [2023-04-29 17:23:31,079] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 6: [2023-04-29 17:23:31,080] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 6: [2023-04-29 17:23:31,081] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 24: [2023-04-29 17:23:31,081] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 26: [2023-04-29 17:23:31,081] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 6: [2023-04-29 17:23:31,081] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 26: [2023-04-29 17:23:31,081] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 6: [2023-04-29 17:23:31,081] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 26: [2023-04-29 17:23:31,081] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 26: [2023-04-29 17:23:31,081] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 6: [2023-04-29 17:23:31,082] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 6: [2023-04-29 17:23:31,082] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 24: [2023-04-29 17:23:31,083] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 9: [2023-04-29 17:23:31,084] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 9: [2023-04-29 17:23:31,084] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 22: [2023-04-29 17:23:31,083] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 9: [2023-04-29 17:23:31,084] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 22: [2023-04-29 17:23:31,084] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 22: [2023-04-29 17:23:31,085] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 22: [2023-04-29 17:23:31,085] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 22: [2023-04-29 17:23:31,086] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 22: [2023-04-29 17:23:31,086] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 9: [2023-04-29 17:23:31,087] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 9: [2023-04-29 17:23:31,087] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 9: [2023-04-29 17:23:31,087] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 14: [2023-04-29 17:23:31,087] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 14: [2023-04-29 17:23:31,087] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 14: [2023-04-29 17:23:31,087] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 14: [2023-04-29 17:23:31,087] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 14: [2023-04-29 17:23:31,088] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 14: [2023-04-29 17:23:31,088] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 14: [2023-04-29 17:23:31,088] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 14: [2023-04-29 17:23:31,088] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 24: [2023-04-29 17:23:31,089] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 21: [2023-04-29 17:23:31,091] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 21: [2023-04-29 17:23:31,091] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 21: [2023-04-29 17:23:31,091] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 21: [2023-04-29 17:23:31,091] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 14: [2023-04-29 17:23:31,091] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 14: [2023-04-29 17:23:31,091] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 10: [2023-04-29 17:23:31,093] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 10: [2023-04-29 17:23:31,093] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 10: [2023-04-29 17:23:31,093] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 10: [2023-04-29 17:23:31,093] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 27: [2023-04-29 17:23:31,093] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 27: [2023-04-29 17:23:31,094] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 27: [2023-04-29 17:23:31,095] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 27: [2023-04-29 17:23:31,095] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 27: [2023-04-29 17:23:31,096] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 9: [2023-04-29 17:23:31,096] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 12: [2023-04-29 17:23:31,098] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 14: [2023-04-29 17:23:31,098] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 27: [2023-04-29 17:23:31,099] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 14: [2023-04-29 17:23:31,099] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 27: [2023-04-29 17:23:31,099] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 10: [2023-04-29 17:23:31,099] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 10: [2023-04-29 17:23:31,099] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 14: [2023-04-29 17:23:31,099] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 10: [2023-04-29 17:23:31,099] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 10: [2023-04-29 17:23:31,099] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 24: [2023-04-29 17:23:31,099] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 24: [2023-04-29 17:23:31,099] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 14: [2023-04-29 17:23:31,100] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 14: [2023-04-29 17:23:31,100] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 14: [2023-04-29 17:23:31,101] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 9: [2023-04-29 17:23:31,101] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 21: [2023-04-29 17:23:31,102] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 21: [2023-04-29 17:23:31,102] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 12: [2023-04-29 17:23:31,102] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 21: [2023-04-29 17:23:31,102] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 26: [2023-04-29 17:23:31,104] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 26: [2023-04-29 17:23:31,105] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 24: [2023-04-29 17:23:31,106] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 26: [2023-04-29 17:23:31,107] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 26: [2023-04-29 17:23:31,107] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 26: [2023-04-29 17:23:31,108] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 16: [2023-04-29 17:23:31,108] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 16: [2023-04-29 17:23:31,109] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 12: [2023-04-29 17:23:31,109] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 24: [2023-04-29 17:23:31,110] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 26: [2023-04-29 17:23:31,110] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 12: [2023-04-29 17:23:31,109] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 21: [2023-04-29 17:23:31,109] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 26: [2023-04-29 17:23:31,111] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 26: [2023-04-29 17:23:31,111] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 9: [2023-04-29 17:23:31,111] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 9: [2023-04-29 17:23:31,112] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 16: [2023-04-29 17:23:31,112] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 9: [2023-04-29 17:23:31,113] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 9: [2023-04-29 17:23:31,113] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 9: [2023-04-29 17:23:31,113] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 16: [2023-04-29 17:23:31,114] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 24: [2023-04-29 17:23:31,114] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 24: [2023-04-29 17:23:31,115] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 12: [2023-04-29 17:23:31,115] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 12: [2023-04-29 17:23:31,115] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 12: [2023-04-29 17:23:31,115] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 12: [2023-04-29 17:23:31,115] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 9: [2023-04-29 17:23:31,116] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 29: [2023-04-29 17:23:31,117] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 29: [2023-04-29 17:23:31,117] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 5: [2023-04-29 17:23:31,118] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 5: [2023-04-29 17:23:31,118] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 6: [2023-04-29 17:23:31,118] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 10: [2023-04-29 17:23:31,119] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 7: [2023-04-29 17:23:31,119] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 7: [2023-04-29 17:23:31,120] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 5: [2023-04-29 17:23:31,122] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 5: [2023-04-29 17:23:31,122] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 5: [2023-04-29 17:23:31,122] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 5: [2023-04-29 17:23:31,122] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 5: [2023-04-29 17:23:31,122] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 5: [2023-04-29 17:23:31,122] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 7: [2023-04-29 17:23:31,122] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 5: [2023-04-29 17:23:31,123] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 31: [2023-04-29 17:23:31,122] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 31: [2023-04-29 17:23:31,122] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 31: [2023-04-29 17:23:31,122] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 5: [2023-04-29 17:23:31,123] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 21: [2023-04-29 17:23:31,123] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 10: [2023-04-29 17:23:31,124] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 10: [2023-04-29 17:23:31,124] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 21: [2023-04-29 17:23:31,124] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 10: [2023-04-29 17:23:31,124] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 11: [2023-04-29 17:23:31,124] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 11: [2023-04-29 17:23:31,124] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 17: [2023-04-29 17:23:31,124] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 17: [2023-04-29 17:23:31,124] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 11: [2023-04-29 17:23:31,125] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 11: [2023-04-29 17:23:31,125] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 11: [2023-04-29 17:23:31,125] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 11: [2023-04-29 17:23:31,125] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 21: [2023-04-29 17:23:31,125] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 21: [2023-04-29 17:23:31,125] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 11: [2023-04-29 17:23:31,125] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 17: [2023-04-29 17:23:31,125] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 17: [2023-04-29 17:23:31,125] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 11: [2023-04-29 17:23:31,125] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 17: [2023-04-29 17:23:31,126] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 17: [2023-04-29 17:23:31,126] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 17: [2023-04-29 17:23:31,126] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 17: [2023-04-29 17:23:31,126] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 31: [2023-04-29 17:23:31,127] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 7: [2023-04-29 17:23:31,127] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 16: [2023-04-29 17:23:31,128] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 16: [2023-04-29 17:23:31,128] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 16: [2023-04-29 17:23:31,128] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 16: [2023-04-29 17:23:31,128] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 26: [2023-04-29 17:23:31,128] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 1: [2023-04-29 17:23:31,128] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 1: [2023-04-29 17:23:31,128] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 1: [2023-04-29 17:23:31,129] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 6: [2023-04-29 17:23:31,129] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 1: [2023-04-29 17:23:31,129] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 1: [2023-04-29 17:23:31,129] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 1: [2023-04-29 17:23:31,129] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 1: [2023-04-29 17:23:31,129] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 11: [2023-04-29 17:23:31,129] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 1: [2023-04-29 17:23:31,129] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 11: [2023-04-29 17:23:31,129] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 26: [2023-04-29 17:23:31,129] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 10: [2023-04-29 17:23:31,130] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 22: [2023-04-29 17:23:31,130] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 22: [2023-04-29 17:23:31,130] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 17: [2023-04-29 17:23:31,130] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 11: [2023-04-29 17:23:31,130] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 17: [2023-04-29 17:23:31,131] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 3: [2023-04-29 17:23:31,131] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 23: [2023-04-29 17:23:31,131] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 23: [2023-04-29 17:23:31,131] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 23: [2023-04-29 17:23:31,131] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 5: [2023-04-29 17:23:31,131] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 3: [2023-04-29 17:23:31,131] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 3: [2023-04-29 17:23:31,131] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 23: [2023-04-29 17:23:31,132] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 3: [2023-04-29 17:23:31,132] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 3: [2023-04-29 17:23:31,132] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 3: [2023-04-29 17:23:31,132] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 3: [2023-04-29 17:23:31,132] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 5: [2023-04-29 17:23:31,131] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 5: [2023-04-29 17:23:31,132] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 3: [2023-04-29 17:23:31,132] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 23: [2023-04-29 17:23:31,132] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 11: [2023-04-29 17:23:31,132] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 23: [2023-04-29 17:23:31,132] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 23: [2023-04-29 17:23:31,132] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 23: [2023-04-29 17:23:31,132] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 5: [2023-04-29 17:23:31,132] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 11: [2023-04-29 17:23:31,133] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 10: [2023-04-29 17:23:31,133] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 5: [2023-04-29 17:23:31,133] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 17: [2023-04-29 17:23:31,132] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 29: [2023-04-29 17:23:31,133] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 16: [2023-04-29 17:23:31,133] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 16: [2023-04-29 17:23:31,133] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 11: [2023-04-29 17:23:31,133] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 5: [2023-04-29 17:23:31,134] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 11: [2023-04-29 17:23:31,134] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 1: [2023-04-29 17:23:31,134] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 1: [2023-04-29 17:23:31,134] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 1: [2023-04-29 17:23:31,134] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 1: [2023-04-29 17:23:31,134] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 10: [2023-04-29 17:23:31,134] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 10: [2023-04-29 17:23:31,134] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 1: [2023-04-29 17:23:31,135] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 11: [2023-04-29 17:23:31,135] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 12: [2023-04-29 17:23:31,135] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 12: [2023-04-29 17:23:31,135] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 3: [2023-04-29 17:23:31,135] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 17: [2023-04-29 17:23:31,135] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 17: [2023-04-29 17:23:31,135] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 3: [2023-04-29 17:23:31,136] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 1: [2023-04-29 17:23:31,136] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 17: [2023-04-29 17:23:31,136] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 1: [2023-04-29 17:23:31,136] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 13: [2023-04-29 17:23:31,135] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 13: [2023-04-29 17:23:31,136] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 13: [2023-04-29 17:23:31,136] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 13: [2023-04-29 17:23:31,136] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 13: [2023-04-29 17:23:31,136] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 13: [2023-04-29 17:23:31,137] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 13: [2023-04-29 17:23:31,137] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 17: [2023-04-29 17:23:31,137] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 13: [2023-04-29 17:23:31,137] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 17: [2023-04-29 17:23:31,137] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 23: [2023-04-29 17:23:31,137] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 30: [2023-04-29 17:23:31,137] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 16: [2023-04-29 17:23:31,137] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 29: [2023-04-29 17:23:31,138] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 23: [2023-04-29 17:23:31,138] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 23: [2023-04-29 17:23:31,138] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 30: [2023-04-29 17:23:31,138] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 30: [2023-04-29 17:23:31,138] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 30: [2023-04-29 17:23:31,138] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 30: [2023-04-29 17:23:31,138] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 30: [2023-04-29 17:23:31,138] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 16: [2023-04-29 17:23:31,138] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 30: [2023-04-29 17:23:31,138] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 1: [2023-04-29 17:23:31,138] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 30: [2023-04-29 17:23:31,138] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 29: [2023-04-29 17:23:31,139] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 6: [2023-04-29 17:23:31,139] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 7: [2023-04-29 17:23:31,140] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 7: [2023-04-29 17:23:31,140] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 7: [2023-04-29 17:23:31,140] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 3: [2023-04-29 17:23:31,140] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 3: [2023-04-29 17:23:31,140] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 31: [2023-04-29 17:23:31,140] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 31: [2023-04-29 17:23:31,140] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 31: [2023-04-29 17:23:31,140] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 31: [2023-04-29 17:23:31,140] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 23: [2023-04-29 17:23:31,141] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 3: [2023-04-29 17:23:31,141] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 7: [2023-04-29 17:23:31,141] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 3: [2023-04-29 17:23:31,141] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 3: [2023-04-29 17:23:31,142] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 13: [2023-04-29 17:23:31,141] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 13: [2023-04-29 17:23:31,142] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 13: [2023-04-29 17:23:31,142] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 0: [2023-04-29 17:23:31,142] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 23: [2023-04-29 17:23:31,142] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 0: [2023-04-29 17:23:31,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 0: [2023-04-29 17:23:31,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 7: [2023-04-29 17:23:31,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 13: [2023-04-29 17:23:31,143] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 0: [2023-04-29 17:23:31,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 0: [2023-04-29 17:23:31,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 23: [2023-04-29 17:23:31,143] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 0: [2023-04-29 17:23:31,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 0: [2023-04-29 17:23:31,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 13: [2023-04-29 17:23:31,143] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 0: [2023-04-29 17:23:31,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 3: [2023-04-29 17:23:31,143] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 14: [2023-04-29 17:23:31,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 7: [2023-04-29 17:23:31,143] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 23: [2023-04-29 17:23:31,144] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 23: [2023-04-29 17:23:31,144] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 25: [2023-04-29 17:23:31,144] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 25: [2023-04-29 17:23:31,144] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 13: [2023-04-29 17:23:31,144] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 31: [2023-04-29 17:23:31,145] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 14: [2023-04-29 17:23:31,145] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 12: [2023-04-29 17:23:31,146] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 31: [2023-04-29 17:23:31,146] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 31: [2023-04-29 17:23:31,146] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 28: [2023-04-29 17:23:31,146] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 28: [2023-04-29 17:23:31,146] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 28: [2023-04-29 17:23:31,146] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 13: [2023-04-29 17:23:31,146] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 28: [2023-04-29 17:23:31,146] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 28: [2023-04-29 17:23:31,146] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 28: [2023-04-29 17:23:31,146] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 28: [2023-04-29 17:23:31,146] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 13: [2023-04-29 17:23:31,146] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 28: [2023-04-29 17:23:31,146] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 7: [2023-04-29 17:23:31,147] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 30: [2023-04-29 17:23:31,146] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 30: [2023-04-29 17:23:31,148] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 30: [2023-04-29 17:23:31,148] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 12: [2023-04-29 17:23:31,149] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 25: [2023-04-29 17:23:31,149] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 25: [2023-04-29 17:23:31,149] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 25: [2023-04-29 17:23:31,149] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 25: [2023-04-29 17:23:31,149] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 25: [2023-04-29 17:23:31,149] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 25: [2023-04-29 17:23:31,149] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 25: [2023-04-29 17:23:31,149] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 25: [2023-04-29 17:23:31,149] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 30: [2023-04-29 17:23:31,150] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 6: [2023-04-29 17:23:31,150] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 30: [2023-04-29 17:23:31,150] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 6: [2023-04-29 17:23:31,150] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 31: [2023-04-29 17:23:31,150] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 22: [2023-04-29 17:23:31,151] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 30: [2023-04-29 17:23:31,151] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 22: [2023-04-29 17:23:31,151] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 12: [2023-04-29 17:23:31,151] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 0: [2023-04-29 17:23:31,151] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 12: [2023-04-29 17:23:31,152] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 30: [2023-04-29 17:23:31,152] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 16: [2023-04-29 17:23:31,153] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 22: [2023-04-29 17:23:31,153] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 22: [2023-04-29 17:23:31,153] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 22: [2023-04-29 17:23:31,153] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 7: [2023-04-29 17:23:31,154] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 29: [2023-04-29 17:23:31,154] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 29: [2023-04-29 17:23:31,154] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 29: [2023-04-29 17:23:31,154] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 29: [2023-04-29 17:23:31,154] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 29: [2023-04-29 17:23:31,154] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 25: [2023-04-29 17:23:31,155] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 0: [2023-04-29 17:23:31,155] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 16: [2023-04-29 17:23:31,155] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 30: [2023-04-29 17:23:31,155] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 0: [2023-04-29 17:23:31,155] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 0: [2023-04-29 17:23:31,156] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 0: [2023-04-29 17:23:31,156] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 0: [2023-04-29 17:23:31,156] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 22: [2023-04-29 17:23:31,156] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 22: [2023-04-29 17:23:31,156] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 22: [2023-04-29 17:23:31,156] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 6: [2023-04-29 17:23:31,157] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 6: [2023-04-29 17:23:31,157] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 6: [2023-04-29 17:23:31,157] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 6: [2023-04-29 17:23:31,157] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 6: [2023-04-29 17:23:31,157] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 16: [2023-04-29 17:23:31,157] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 16: [2023-04-29 17:23:31,157] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 25: [2023-04-29 17:23:31,158] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 25: [2023-04-29 17:23:31,159] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 0: [2023-04-29 17:23:31,159] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 28: [2023-04-29 17:23:31,159] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 0: [2023-04-29 17:23:31,159] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 25: [2023-04-29 17:23:31,159] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 28: [2023-04-29 17:23:31,159] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 25: [2023-04-29 17:23:31,160] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 25: [2023-04-29 17:23:31,160] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 28: [2023-04-29 17:23:31,160] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 29: [2023-04-29 17:23:31,160] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 28: [2023-04-29 17:23:31,160] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 28: [2023-04-29 17:23:31,161] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 28: [2023-04-29 17:23:31,161] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 14: [2023-04-29 17:23:31,162] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 28: [2023-04-29 17:23:31,162] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 28: [2023-04-29 17:23:31,163] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 14: [2023-04-29 17:23:31,164] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 14: [2023-04-29 17:23:31,167] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 7: [2023-04-29 17:23:31,166] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 15: [2023-04-29 17:23:31,168] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 15: [2023-04-29 17:23:31,168] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 15: [2023-04-29 17:23:31,168] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 15: [2023-04-29 17:23:31,168] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 15: [2023-04-29 17:23:31,168] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 15: [2023-04-29 17:23:31,168] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 15: [2023-04-29 17:23:31,168] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 15: [2023-04-29 17:23:31,168] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 31: [2023-04-29 17:23:31,169] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 7: [2023-04-29 17:23:31,169] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 31: [2023-04-29 17:23:31,169] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 7: [2023-04-29 17:23:31,170] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 7: [2023-04-29 17:23:31,170] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 31: [2023-04-29 17:23:31,172] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 31: [2023-04-29 17:23:31,172] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 18: [2023-04-29 17:23:31,172] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 18: [2023-04-29 17:23:31,172] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 18: [2023-04-29 17:23:31,172] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 18: [2023-04-29 17:23:31,172] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 18: [2023-04-29 17:23:31,172] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 18: [2023-04-29 17:23:31,172] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 18: [2023-04-29 17:23:31,172] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 18: [2023-04-29 17:23:31,172] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 14: [2023-04-29 17:23:31,172] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 14: [2023-04-29 17:23:31,172] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 5: [2023-04-29 17:23:31,174] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 5: [2023-04-29 17:23:31,174] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 11: [2023-04-29 17:23:31,176] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 6: [2023-04-29 17:23:31,178] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 14: [2023-04-29 17:23:31,179] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 14: [2023-04-29 17:23:31,179] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 14: [2023-04-29 17:23:31,179] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 15: [2023-04-29 17:23:31,181] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 17: [2023-04-29 17:23:31,182] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 15: [2023-04-29 17:23:31,181] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 15: [2023-04-29 17:23:31,181] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 15: [2023-04-29 17:23:31,183] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 18: [2023-04-29 17:23:31,183] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 15: [2023-04-29 17:23:31,183] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 15: [2023-04-29 17:23:31,183] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 29: [2023-04-29 17:23:31,183] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 15: [2023-04-29 17:23:31,183] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 15: [2023-04-29 17:23:31,184] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 18: [2023-04-29 17:23:31,184] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 18: [2023-04-29 17:23:31,184] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 19: [2023-04-29 17:23:31,185] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 19: [2023-04-29 17:23:31,185] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 17: [2023-04-29 17:23:31,185] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 29: [2023-04-29 17:23:31,185] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 18: [2023-04-29 17:23:31,185] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 22: [2023-04-29 17:23:31,186] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 18: [2023-04-29 17:23:31,186] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 29: [2023-04-29 17:23:31,186] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 29: [2023-04-29 17:23:31,187] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 18: [2023-04-29 17:23:31,187] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 22: [2023-04-29 17:23:31,187] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 18: [2023-04-29 17:23:31,187] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 11: [2023-04-29 17:23:31,187] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 11: [2023-04-29 17:23:31,187] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 22: [2023-04-29 17:23:31,188] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 3: [2023-04-29 17:23:31,187] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 3: [2023-04-29 17:23:31,187] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 29: [2023-04-29 17:23:31,188] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 1: [2023-04-29 17:23:31,187] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 19: [2023-04-29 17:23:31,188] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 19: [2023-04-29 17:23:31,188] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 19: [2023-04-29 17:23:31,189] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 19: [2023-04-29 17:23:31,189] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 19: [2023-04-29 17:23:31,189] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 19: [2023-04-29 17:23:31,189] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 19: [2023-04-29 17:23:31,189] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 22: [2023-04-29 17:23:31,189] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 6: [2023-04-29 17:23:31,189] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 6: [2023-04-29 17:23:31,189] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 6: [2023-04-29 17:23:31,190] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 11: [2023-04-29 17:23:31,190] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 19: [2023-04-29 17:23:31,190] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 6: [2023-04-29 17:23:31,191] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 2: [2023-04-29 17:23:31,190] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 2: [2023-04-29 17:23:31,191] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 18: [2023-04-29 17:23:31,190] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 22: [2023-04-29 17:23:31,191] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 22: [2023-04-29 17:23:31,191] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 5: [2023-04-29 17:23:31,191] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 6: [2023-04-29 17:23:31,192] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 2: [2023-04-29 17:23:31,192] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 11: [2023-04-29 17:23:31,193] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 8: [2023-04-29 17:23:31,193] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 2: [2023-04-29 17:23:31,193] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 2: [2023-04-29 17:23:31,193] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 2: [2023-04-29 17:23:31,193] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 2: [2023-04-29 17:23:31,193] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 1: [2023-04-29 17:23:31,193] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 1: [2023-04-29 17:23:31,193] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 1: [2023-04-29 17:23:31,193] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 1: [2023-04-29 17:23:31,193] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 8: [2023-04-29 17:23:31,193] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 2: [2023-04-29 17:23:31,193] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 8: [2023-04-29 17:23:31,193] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 8: [2023-04-29 17:23:31,193] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 8: [2023-04-29 17:23:31,193] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 8: [2023-04-29 17:23:31,193] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 8: [2023-04-29 17:23:31,193] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 5: [2023-04-29 17:23:31,193] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 8: [2023-04-29 17:23:31,193] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 14: [2023-04-29 17:23:31,193] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 23: [2023-04-29 17:23:31,194] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 5: [2023-04-29 17:23:31,194] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 19: [2023-04-29 17:23:31,193] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 23: [2023-04-29 17:23:31,194] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 2: [2023-04-29 17:23:31,195] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 2: [2023-04-29 17:23:31,196] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 2: [2023-04-29 17:23:31,196] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 11: [2023-04-29 17:23:31,197] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 4: [2023-04-29 17:23:31,198] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 4: [2023-04-29 17:23:31,198] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 4: [2023-04-29 17:23:31,198] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 4: [2023-04-29 17:23:31,198] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 4: [2023-04-29 17:23:31,198] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 4: [2023-04-29 17:23:31,198] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 4: [2023-04-29 17:23:31,198] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 19: [2023-04-29 17:23:31,198] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 19: [2023-04-29 17:23:31,198] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 19: [2023-04-29 17:23:31,198] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 4: [2023-04-29 17:23:31,198] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 19: [2023-04-29 17:23:31,199] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 1: [2023-04-29 17:23:31,199] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 1: [2023-04-29 17:23:31,199] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 19: [2023-04-29 17:23:31,199] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 13: [2023-04-29 17:23:31,198] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 13: [2023-04-29 17:23:31,199] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 14: [2023-04-29 17:23:31,200] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 8: [2023-04-29 17:23:31,200] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 8: [2023-04-29 17:23:31,200] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 23: [2023-04-29 17:23:31,201] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 8: [2023-04-29 17:23:31,201] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 25: [2023-04-29 17:23:31,200] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 25: [2023-04-29 17:23:31,200] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 4: [2023-04-29 17:23:31,202] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 2: [2023-04-29 17:23:31,202] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 4: [2023-04-29 17:23:31,202] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 17: [2023-04-29 17:23:31,202] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 8: [2023-04-29 17:23:31,202] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 8: [2023-04-29 17:23:31,202] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 2: [2023-04-29 17:23:31,202] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 1: [2023-04-29 17:23:31,202] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 14: [2023-04-29 17:23:31,203] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 2: [2023-04-29 17:23:31,203] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 17: [2023-04-29 17:23:31,203] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 8: [2023-04-29 17:23:31,203] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 2: [2023-04-29 17:23:31,203] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 8: [2023-04-29 17:23:31,204] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 2: [2023-04-29 17:23:31,204] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 8: [2023-04-29 17:23:31,204] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt... 13: [2023-04-29 17:23:31,206] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 13: [2023-04-29 17:23:31,206] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 13: [2023-04-29 17:23:31,206] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 11: [2023-04-29 17:23:31,206] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 3: [2023-04-29 17:23:31,206] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 3: [2023-04-29 17:23:31,206] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 11: [2023-04-29 17:23:31,207] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 11: [2023-04-29 17:23:31,207] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 3: [2023-04-29 17:23:31,208] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 4: [2023-04-29 17:23:31,208] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 17: [2023-04-29 17:23:31,208] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 3: [2023-04-29 17:23:31,208] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 17: [2023-04-29 17:23:31,209] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 3: [2023-04-29 17:23:31,209] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 5: [2023-04-29 17:23:31,209] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 5: [2023-04-29 17:23:31,209] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 5: [2023-04-29 17:23:31,209] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 5: [2023-04-29 17:23:31,209] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 13: [2023-04-29 17:23:31,209] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 5: [2023-04-29 17:23:31,209] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 4: [2023-04-29 17:23:31,210] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 4: [2023-04-29 17:23:31,210] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 14: [2023-04-29 17:23:31,210] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 17: [2023-04-29 17:23:31,210] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 17: [2023-04-29 17:23:31,210] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 17: [2023-04-29 17:23:31,210] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 4: [2023-04-29 17:23:31,210] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 1: [2023-04-29 17:23:31,211] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 4: [2023-04-29 17:23:31,211] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 11: [2023-04-29 17:23:31,211] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 14: [2023-04-29 17:23:31,212] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 14: [2023-04-29 17:23:31,212] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 4: [2023-04-29 17:23:31,212] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 11: [2023-04-29 17:23:31,213] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 17: [2023-04-29 17:23:31,214] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 23: [2023-04-29 17:23:31,216] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 23: [2023-04-29 17:23:31,217] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 23: [2023-04-29 17:23:31,217] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 1: [2023-04-29 17:23:31,217] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 11: [2023-04-29 17:23:31,218] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 1: [2023-04-29 17:23:31,218] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 5: [2023-04-29 17:23:31,219] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 1: [2023-04-29 17:23:31,219] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 25: [2023-04-29 17:23:31,220] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 25: [2023-04-29 17:23:31,220] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 23: [2023-04-29 17:23:31,220] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 23: [2023-04-29 17:23:31,220] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 23: [2023-04-29 17:23:31,220] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 23: [2023-04-29 17:23:31,221] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 25: [2023-04-29 17:23:31,221] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 13: [2023-04-29 17:23:31,222] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 1: [2023-04-29 17:23:31,222] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 11: [2023-04-29 17:23:31,222] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 25: [2023-04-29 17:23:31,222] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 0: [2023-04-29 17:23:31,223] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 3: [2023-04-29 17:23:31,223] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 30: [2023-04-29 17:23:31,223] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 3: [2023-04-29 17:23:31,226] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 1: [2023-04-29 17:23:31,226] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 1: [2023-04-29 17:23:31,227] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 23: [2023-04-29 17:23:31,228] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 13: [2023-04-29 17:23:31,229] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 3: [2023-04-29 17:23:31,229] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 13: [2023-04-29 17:23:31,229] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 30: [2023-04-29 17:23:31,231] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 30: [2023-04-29 17:23:31,231] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 1: [2023-04-29 17:23:31,231] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 17: [2023-04-29 17:23:31,232] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 13: [2023-04-29 17:23:31,233] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 13: [2023-04-29 17:23:31,233] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 13: [2023-04-29 17:23:31,234] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 25: [2023-04-29 17:23:31,234] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 19: [2023-04-29 17:23:31,235] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 3: [2023-04-29 17:23:31,235] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 30: [2023-04-29 17:23:31,236] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 13: [2023-04-29 17:23:31,236] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 3: [2023-04-29 17:23:31,236] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 28: [2023-04-29 17:23:31,236] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 28: [2023-04-29 17:23:31,236] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 28: [2023-04-29 17:23:31,237] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 11: [2023-04-29 17:23:31,237] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 11: [2023-04-29 17:23:31,237] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 3: [2023-04-29 17:23:31,238] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 25: [2023-04-29 17:23:31,239] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 25: [2023-04-29 17:23:31,239] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 25: [2023-04-29 17:23:31,239] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 17: [2023-04-29 17:23:31,239] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 11: [2023-04-29 17:23:31,239] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 0: [2023-04-29 17:23:31,241] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 0: [2023-04-29 17:23:31,241] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 0: [2023-04-29 17:23:31,241] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 17: [2023-04-29 17:23:31,242] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 17: [2023-04-29 17:23:31,242] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 25: [2023-04-29 17:23:31,243] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 2: [2023-04-29 17:23:31,243] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 5: [2023-04-29 17:23:31,244] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 17: [2023-04-29 17:23:31,245] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 0: [2023-04-29 17:23:31,245] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 25: [2023-04-29 17:23:31,245] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 13: [2023-04-29 17:23:31,245] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 5: [2023-04-29 17:23:31,246] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 0: [2023-04-29 17:23:31,246] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 30: [2023-04-29 17:23:31,247] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 5: [2023-04-29 17:23:31,247] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 17: [2023-04-29 17:23:31,248] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 23: [2023-04-29 17:23:31,248] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 30: [2023-04-29 17:23:31,249] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 5: [2023-04-29 17:23:31,250] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 5: [2023-04-29 17:23:31,250] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 23: [2023-04-29 17:23:31,250] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 19: [2023-04-29 17:23:31,250] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 28: [2023-04-29 17:23:31,250] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 28: [2023-04-29 17:23:31,251] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 28: [2023-04-29 17:23:31,251] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 28: [2023-04-29 17:23:31,252] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 28: [2023-04-29 17:23:31,252] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 0: [2023-04-29 17:23:31,252] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 23: [2023-04-29 17:23:31,252] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 23: [2023-04-29 17:23:31,253] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 23: [2023-04-29 17:23:31,254] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 4: [2023-04-29 17:23:31,253] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 4: [2023-04-29 17:23:31,253] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 2: [2023-04-29 17:23:31,254] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 2: [2023-04-29 17:23:31,254] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 19: [2023-04-29 17:23:31,254] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 3: [2023-04-29 17:23:31,255] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 19: [2023-04-29 17:23:31,255] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 8: [2023-04-29 17:23:31,256] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 8: [2023-04-29 17:23:31,256] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 3: [2023-04-29 17:23:31,257] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 8: [2023-04-29 17:23:31,257] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 8: [2023-04-29 17:23:31,257] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 13: [2023-04-29 17:23:31,257] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 3: [2023-04-29 17:23:31,258] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 2: [2023-04-29 17:23:31,260] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 13: [2023-04-29 17:23:31,260] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 18: [2023-04-29 17:23:31,261] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 18: [2023-04-29 17:23:31,261] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 15: [2023-04-29 17:23:31,261] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 15: [2023-04-29 17:23:31,261] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 15: [2023-04-29 17:23:31,261] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 15: [2023-04-29 17:23:31,261] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 28: [2023-04-29 17:23:31,262] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 30: [2023-04-29 17:23:31,263] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 30: [2023-04-29 17:23:31,263] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 18: [2023-04-29 17:23:31,263] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 18: [2023-04-29 17:23:31,263] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 18: [2023-04-29 17:23:31,263] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 19: [2023-04-29 17:23:31,264] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 28: [2023-04-29 17:23:31,264] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 15: [2023-04-29 17:23:31,265] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 15: [2023-04-29 17:23:31,265] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 15: [2023-04-29 17:23:31,265] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 15: [2023-04-29 17:23:31,265] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 2: [2023-04-29 17:23:31,266] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 28: [2023-04-29 17:23:31,266] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 19: [2023-04-29 17:23:31,266] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 30: [2023-04-29 17:23:31,266] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 30: [2023-04-29 17:23:31,266] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 25: [2023-04-29 17:23:31,268] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 25: [2023-04-29 17:23:31,268] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 25: [2023-04-29 17:23:31,268] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 8: [2023-04-29 17:23:31,268] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 8: [2023-04-29 17:23:31,268] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 30: [2023-04-29 17:23:31,269] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 25: [2023-04-29 17:23:31,269] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 19: [2023-04-29 17:23:31,270] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 19: [2023-04-29 17:23:31,270] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 19: [2023-04-29 17:23:31,270] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 8: [2023-04-29 17:23:31,271] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 8: [2023-04-29 17:23:31,271] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 2: [2023-04-29 17:23:31,272] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 2: [2023-04-29 17:23:31,272] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 2: [2023-04-29 17:23:31,272] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 2: [2023-04-29 17:23:31,272] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 4: [2023-04-29 17:23:31,274] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 19: [2023-04-29 17:23:31,274] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 0: [2023-04-29 17:23:31,275] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 4: [2023-04-29 17:23:31,275] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 0: [2023-04-29 17:23:31,275] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 0: [2023-04-29 17:23:31,275] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 30: [2023-04-29 17:23:31,276] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 19: [2023-04-29 17:23:31,278] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 2: [2023-04-29 17:23:31,278] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 0: [2023-04-29 17:23:31,278] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 0: [2023-04-29 17:23:31,278] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 2: [2023-04-29 17:23:31,278] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 30: [2023-04-29 17:23:31,279] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 8: [2023-04-29 17:23:31,279] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 0: [2023-04-29 17:23:31,281] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 4: [2023-04-29 17:23:31,281] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 4: [2023-04-29 17:23:31,281] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 0: [2023-04-29 17:23:31,282] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 4: [2023-04-29 17:23:31,282] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 8: [2023-04-29 17:23:31,282] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 8: [2023-04-29 17:23:31,283] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 4: [2023-04-29 17:23:31,284] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 4: [2023-04-29 17:23:31,284] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 4: [2023-04-29 17:23:31,284] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 8: [2023-04-29 17:23:31,284] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 28: [2023-04-29 17:23:31,285] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 2: [2023-04-29 17:23:31,285] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 28: [2023-04-29 17:23:31,286] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 28: [2023-04-29 17:23:31,288] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 28: [2023-04-29 17:23:31,291] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 19: [2023-04-29 17:23:31,291] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 28: [2023-04-29 17:23:31,291] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 18: [2023-04-29 17:23:31,294] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 18: [2023-04-29 17:23:31,294] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 18: [2023-04-29 17:23:31,294] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_34-model_00-model_states.pt. 30: [2023-04-29 17:23:31,295] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 12: [2023-04-29 17:23:31,295] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 30: [2023-04-29 17:23:31,295] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 12: [2023-04-29 17:23:31,296] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 18: [2023-04-29 17:23:31,296] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 12: [2023-04-29 17:23:31,296] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 12: [2023-04-29 17:23:31,296] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 30: [2023-04-29 17:23:31,296] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 12: [2023-04-29 17:23:31,296] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 12: [2023-04-29 17:23:31,296] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 12: [2023-04-29 17:23:31,296] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 12: [2023-04-29 17:23:31,296] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 18: [2023-04-29 17:23:31,296] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 18: [2023-04-29 17:23:31,297] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 8: [2023-04-29 17:23:31,297] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 20: [2023-04-29 17:23:31,297] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 20: [2023-04-29 17:23:31,297] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 8: [2023-04-29 17:23:31,297] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 19: [2023-04-29 17:23:31,297] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 20: [2023-04-29 17:23:31,298] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 2: [2023-04-29 17:23:31,298] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 19: [2023-04-29 17:23:31,298] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 8: [2023-04-29 17:23:31,298] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 20: [2023-04-29 17:23:31,298] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 20: [2023-04-29 17:23:31,298] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 20: [2023-04-29 17:23:31,299] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 20: [2023-04-29 17:23:31,299] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 19: [2023-04-29 17:23:31,299] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 20: [2023-04-29 17:23:31,299] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 12: [2023-04-29 17:23:31,299] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 15: [2023-04-29 17:23:31,300] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 8: [2023-04-29 17:23:31,300] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 18: [2023-04-29 17:23:31,300] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 12: [2023-04-29 17:23:31,301] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 18: [2023-04-29 17:23:31,301] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 19: [2023-04-29 17:23:31,301] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 15: [2023-04-29 17:23:31,301] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 15: [2023-04-29 17:23:31,302] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 15: [2023-04-29 17:23:31,302] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 0: [2023-04-29 17:23:31,303] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 0: [2023-04-29 17:23:31,303] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 20: [2023-04-29 17:23:31,303] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 20: [2023-04-29 17:23:31,303] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 2: [2023-04-29 17:23:31,304] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 2: [2023-04-29 17:23:31,304] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 15: [2023-04-29 17:23:31,304] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 15: [2023-04-29 17:23:31,305] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 20: [2023-04-29 17:23:31,305] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 2: [2023-04-29 17:23:31,305] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 12: [2023-04-29 17:23:31,305] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 12: [2023-04-29 17:23:31,306] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 15: [2023-04-29 17:23:31,307] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 15: [2023-04-29 17:23:31,307] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 12: [2023-04-29 17:23:31,307] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 12: [2023-04-29 17:23:31,308] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 20: [2023-04-29 17:23:31,307] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 20: [2023-04-29 17:23:31,308] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 9: [2023-04-29 17:23:31,308] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 9: [2023-04-29 17:23:31,308] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 9: [2023-04-29 17:23:31,308] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 12: [2023-04-29 17:23:31,308] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 9: [2023-04-29 17:23:31,308] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 9: [2023-04-29 17:23:31,308] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 9: [2023-04-29 17:23:31,308] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 9: [2023-04-29 17:23:31,308] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 9: [2023-04-29 17:23:31,309] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 20: [2023-04-29 17:23:31,309] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 12: [2023-04-29 17:23:31,309] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 20: [2023-04-29 17:23:31,309] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 20: [2023-04-29 17:23:31,309] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 10: [2023-04-29 17:23:31,313] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 10: [2023-04-29 17:23:31,313] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 10: [2023-04-29 17:23:31,313] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 10: [2023-04-29 17:23:31,313] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 10: [2023-04-29 17:23:31,313] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 10: [2023-04-29 17:23:31,313] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 10: [2023-04-29 17:23:31,313] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 10: [2023-04-29 17:23:31,313] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 9: [2023-04-29 17:23:31,314] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 9: [2023-04-29 17:23:31,314] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 9: [2023-04-29 17:23:31,314] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 9: [2023-04-29 17:23:31,314] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 9: [2023-04-29 17:23:31,315] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 9: [2023-04-29 17:23:31,315] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 9: [2023-04-29 17:23:31,315] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 9: [2023-04-29 17:23:31,315] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 10: [2023-04-29 17:23:31,318] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 10: [2023-04-29 17:23:31,318] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 10: [2023-04-29 17:23:31,318] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 10: [2023-04-29 17:23:31,319] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 4: [2023-04-29 17:23:31,319] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 10: [2023-04-29 17:23:31,319] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 10: [2023-04-29 17:23:31,320] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 18: [2023-04-29 17:23:31,320] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 4: [2023-04-29 17:23:31,321] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 4: [2023-04-29 17:23:31,321] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 10: [2023-04-29 17:23:31,321] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 18: [2023-04-29 17:23:31,321] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 10: [2023-04-29 17:23:31,321] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 18: [2023-04-29 17:23:31,322] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 4: [2023-04-29 17:23:31,326] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 4: [2023-04-29 17:23:31,328] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 4: [2023-04-29 17:23:31,329] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 21: [2023-04-29 17:23:31,334] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 21: [2023-04-29 17:23:31,334] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 21: [2023-04-29 17:23:31,334] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 21: [2023-04-29 17:23:31,334] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 21: [2023-04-29 17:23:31,334] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 21: [2023-04-29 17:23:31,334] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 21: [2023-04-29 17:23:31,334] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 21: [2023-04-29 17:23:31,334] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 21: [2023-04-29 17:23:31,339] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 27: [2023-04-29 17:23:31,339] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 21: [2023-04-29 17:23:31,339] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 21: [2023-04-29 17:23:31,340] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 27: [2023-04-29 17:23:31,340] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 21: [2023-04-29 17:23:31,340] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 27: [2023-04-29 17:23:31,340] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 27: [2023-04-29 17:23:31,340] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 27: [2023-04-29 17:23:31,340] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 27: [2023-04-29 17:23:31,340] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 27: [2023-04-29 17:23:31,340] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 27: [2023-04-29 17:23:31,340] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 21: [2023-04-29 17:23:31,340] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 21: [2023-04-29 17:23:31,341] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 21: [2023-04-29 17:23:31,341] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 21: [2023-04-29 17:23:31,341] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 27: [2023-04-29 17:23:31,343] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 29: [2023-04-29 17:23:31,344] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 29: [2023-04-29 17:23:31,344] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 16: [2023-04-29 17:23:31,344] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 16: [2023-04-29 17:23:31,344] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 16: [2023-04-29 17:23:31,345] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 16: [2023-04-29 17:23:31,345] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 16: [2023-04-29 17:23:31,345] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 16: [2023-04-29 17:23:31,345] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 16: [2023-04-29 17:23:31,345] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 16: [2023-04-29 17:23:31,345] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 29: [2023-04-29 17:23:31,348] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 29: [2023-04-29 17:23:31,348] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 29: [2023-04-29 17:23:31,348] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 29: [2023-04-29 17:23:31,348] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 29: [2023-04-29 17:23:31,348] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 29: [2023-04-29 17:23:31,348] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 29: [2023-04-29 17:23:31,349] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 29: [2023-04-29 17:23:31,349] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 16: [2023-04-29 17:23:31,351] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 16: [2023-04-29 17:23:31,351] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 16: [2023-04-29 17:23:31,351] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 27: [2023-04-29 17:23:31,351] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 27: [2023-04-29 17:23:31,351] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 16: [2023-04-29 17:23:31,351] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 16: [2023-04-29 17:23:31,352] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 16: [2023-04-29 17:23:31,352] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 27: [2023-04-29 17:23:31,352] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 12: [2023-04-29 17:23:31,352] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 12: [2023-04-29 17:23:31,352] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 27: [2023-04-29 17:23:31,352] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 16: [2023-04-29 17:23:31,352] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 16: [2023-04-29 17:23:31,352] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 27: [2023-04-29 17:23:31,353] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 27: [2023-04-29 17:23:31,353] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 27: [2023-04-29 17:23:31,355] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 20: [2023-04-29 17:23:31,357] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 20: [2023-04-29 17:23:31,357] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 29: [2023-04-29 17:23:31,358] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 29: [2023-04-29 17:23:31,358] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 29: [2023-04-29 17:23:31,359] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 29: [2023-04-29 17:23:31,359] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 29: [2023-04-29 17:23:31,360] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 20: [2023-04-29 17:23:31,360] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 29: [2023-04-29 17:23:31,360] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 12: [2023-04-29 17:23:31,367] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 9: [2023-04-29 17:23:31,367] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 10: [2023-04-29 17:23:31,369] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 10: [2023-04-29 17:23:31,371] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 20: [2023-04-29 17:23:31,373] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 20: [2023-04-29 17:23:31,373] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 20: [2023-04-29 17:23:31,374] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 20: [2023-04-29 17:23:31,374] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 20: [2023-04-29 17:23:31,374] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 12: [2023-04-29 17:23:31,375] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 12: [2023-04-29 17:23:31,375] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 12: [2023-04-29 17:23:31,375] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 12: [2023-04-29 17:23:31,375] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 9: [2023-04-29 17:23:31,375] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 9: [2023-04-29 17:23:31,375] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 9: [2023-04-29 17:23:31,377] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 9: [2023-04-29 17:23:31,377] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 9: [2023-04-29 17:23:31,378] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 9: [2023-04-29 17:23:31,378] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 9: [2023-04-29 17:23:31,378] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 6: [2023-04-29 17:23:31,379] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 6: [2023-04-29 17:23:31,379] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 20: [2023-04-29 17:23:31,379] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 6: [2023-04-29 17:23:31,379] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 6: [2023-04-29 17:23:31,380] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 6: [2023-04-29 17:23:31,380] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 6: [2023-04-29 17:23:31,380] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 6: [2023-04-29 17:23:31,380] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 6: [2023-04-29 17:23:31,380] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 10: [2023-04-29 17:23:31,381] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 10: [2023-04-29 17:23:31,381] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 10: [2023-04-29 17:23:31,381] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 20: [2023-04-29 17:23:31,381] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 6: [2023-04-29 17:23:31,384] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 20: [2023-04-29 17:23:31,384] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 6: [2023-04-29 17:23:31,384] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 10: [2023-04-29 17:23:31,386] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 12: [2023-04-29 17:23:31,386] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 12: [2023-04-29 17:23:31,386] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 12: [2023-04-29 17:23:31,386] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 10: [2023-04-29 17:23:31,387] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 10: [2023-04-29 17:23:31,387] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 6: [2023-04-29 17:23:31,389] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 6: [2023-04-29 17:23:31,390] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 6: [2023-04-29 17:23:31,390] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 9: [2023-04-29 17:23:31,391] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 6: [2023-04-29 17:23:31,391] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 6: [2023-04-29 17:23:31,391] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 6: [2023-04-29 17:23:31,391] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 10: [2023-04-29 17:23:31,392] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 10: [2023-04-29 17:23:31,392] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 12: [2023-04-29 17:23:31,393] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 27: [2023-04-29 17:23:31,393] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 21: [2023-04-29 17:23:31,394] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 21: [2023-04-29 17:23:31,394] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 21: [2023-04-29 17:23:31,394] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 7: [2023-04-29 17:23:31,396] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 7: [2023-04-29 17:23:31,396] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 7: [2023-04-29 17:23:31,396] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 7: [2023-04-29 17:23:31,396] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 7: [2023-04-29 17:23:31,396] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 7: [2023-04-29 17:23:31,396] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 7: [2023-04-29 17:23:31,396] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 7: [2023-04-29 17:23:31,397] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 20: [2023-04-29 17:23:31,399] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 7: [2023-04-29 17:23:31,400] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 29: [2023-04-29 17:23:31,400] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 29: [2023-04-29 17:23:31,400] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 7: [2023-04-29 17:23:31,401] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 12: [2023-04-29 17:23:31,401] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 7: [2023-04-29 17:23:31,401] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 12: [2023-04-29 17:23:31,402] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 7: [2023-04-29 17:23:31,402] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 7: [2023-04-29 17:23:31,403] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 9: [2023-04-29 17:23:31,403] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 9: [2023-04-29 17:23:31,403] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 7: [2023-04-29 17:23:31,403] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 9: [2023-04-29 17:23:31,403] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 9: [2023-04-29 17:23:31,404] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 7: [2023-04-29 17:23:31,404] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 25: [2023-04-29 17:23:31,404] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 25: [2023-04-29 17:23:31,404] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 7: [2023-04-29 17:23:31,404] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 20: [2023-04-29 17:23:31,404] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 17: [2023-04-29 17:23:31,404] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 17: [2023-04-29 17:23:31,404] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 17: [2023-04-29 17:23:31,404] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 17: [2023-04-29 17:23:31,404] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 17: [2023-04-29 17:23:31,404] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 20: [2023-04-29 17:23:31,404] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 20: [2023-04-29 17:23:31,404] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 17: [2023-04-29 17:23:31,404] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 17: [2023-04-29 17:23:31,404] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 20: [2023-04-29 17:23:31,404] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 20: [2023-04-29 17:23:31,404] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 20: [2023-04-29 17:23:31,404] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 20: [2023-04-29 17:23:31,404] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 20: [2023-04-29 17:23:31,405] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 17: [2023-04-29 17:23:31,404] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 20: [2023-04-29 17:23:31,405] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 9: [2023-04-29 17:23:31,405] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 9: [2023-04-29 17:23:31,405] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 20: [2023-04-29 17:23:31,406] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 20: [2023-04-29 17:23:31,406] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 25: [2023-04-29 17:23:31,406] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 25: [2023-04-29 17:23:31,406] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 25: [2023-04-29 17:23:31,406] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 25: [2023-04-29 17:23:31,406] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 25: [2023-04-29 17:23:31,406] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 16: [2023-04-29 17:23:31,405] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 16: [2023-04-29 17:23:31,405] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 25: [2023-04-29 17:23:31,406] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 9: [2023-04-29 17:23:31,406] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 20: [2023-04-29 17:23:31,407] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 20: [2023-04-29 17:23:31,407] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 20: [2023-04-29 17:23:31,407] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 20: [2023-04-29 17:23:31,407] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 20: [2023-04-29 17:23:31,407] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 20: [2023-04-29 17:23:31,407] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 20: [2023-04-29 17:23:31,407] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 20: [2023-04-29 17:23:31,407] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 20: [2023-04-29 17:23:31,407] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 20: [2023-04-29 17:23:31,407] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 20: [2023-04-29 17:23:31,407] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 20: [2023-04-29 17:23:31,407] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 20: [2023-04-29 17:23:31,407] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 20: [2023-04-29 17:23:31,407] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 20: [2023-04-29 17:23:31,407] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 20: [2023-04-29 17:23:31,408] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 20: [2023-04-29 17:23:31,408] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 21: [2023-04-29 17:23:31,408] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 21: [2023-04-29 17:23:31,408] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 21: [2023-04-29 17:23:31,408] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 21: [2023-04-29 17:23:31,408] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 21: [2023-04-29 17:23:31,408] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 11: [2023-04-29 17:23:31,408] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 11: [2023-04-29 17:23:31,408] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 25: [2023-04-29 17:23:31,408] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 25: [2023-04-29 17:23:31,409] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 17: [2023-04-29 17:23:31,409] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 27: [2023-04-29 17:23:31,410] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 10: [2023-04-29 17:23:31,410] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 17: [2023-04-29 17:23:31,411] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 16: [2023-04-29 17:23:31,411] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 11: [2023-04-29 17:23:31,411] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 11: [2023-04-29 17:23:31,412] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 11: [2023-04-29 17:23:31,412] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 11: [2023-04-29 17:23:31,412] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 11: [2023-04-29 17:23:31,412] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 11: [2023-04-29 17:23:31,412] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 10: [2023-04-29 17:23:31,413] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 17: [2023-04-29 17:23:31,413] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 11: [2023-04-29 17:23:31,413] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 17: [2023-04-29 17:23:31,413] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 11: [2023-04-29 17:23:31,413] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 27: [2023-04-29 17:23:31,414] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 27: [2023-04-29 17:23:31,414] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 10: [2023-04-29 17:23:31,413] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 27: [2023-04-29 17:23:31,414] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 10: [2023-04-29 17:23:31,414] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 12: [2023-04-29 17:23:31,415] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 17: [2023-04-29 17:23:31,415] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 17: [2023-04-29 17:23:31,415] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 17: [2023-04-29 17:23:31,416] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 25: [2023-04-29 17:23:31,415] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 25: [2023-04-29 17:23:31,416] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 12: [2023-04-29 17:23:31,416] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 11: [2023-04-29 17:23:31,416] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 17: [2023-04-29 17:23:31,416] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 12: [2023-04-29 17:23:31,417] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 25: [2023-04-29 17:23:31,417] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 25: [2023-04-29 17:23:31,417] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 25: [2023-04-29 17:23:31,417] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 25: [2023-04-29 17:23:31,418] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 10: [2023-04-29 17:23:31,418] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 10: [2023-04-29 17:23:31,418] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 11: [2023-04-29 17:23:31,419] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 29: [2023-04-29 17:23:31,420] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 29: [2023-04-29 17:23:31,421] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 16: [2023-04-29 17:23:31,421] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 16: [2023-04-29 17:23:31,421] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 16: [2023-04-29 17:23:31,421] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 16: [2023-04-29 17:23:31,421] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 16: [2023-04-29 17:23:31,421] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 27: [2023-04-29 17:23:31,421] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 11: [2023-04-29 17:23:31,421] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 11: [2023-04-29 17:23:31,422] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 11: [2023-04-29 17:23:31,422] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 11: [2023-04-29 17:23:31,423] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 21: [2023-04-29 17:23:31,423] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 21: [2023-04-29 17:23:31,424] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 31: [2023-04-29 17:23:31,426] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 31: [2023-04-29 17:23:31,426] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 31: [2023-04-29 17:23:31,426] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 29: [2023-04-29 17:23:31,427] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 29: [2023-04-29 17:23:31,427] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 31: [2023-04-29 17:23:31,427] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 31: [2023-04-29 17:23:31,427] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 31: [2023-04-29 17:23:31,427] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 31: [2023-04-29 17:23:31,427] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 21: [2023-04-29 17:23:31,427] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 31: [2023-04-29 17:23:31,427] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 16: [2023-04-29 17:23:31,428] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 16: [2023-04-29 17:23:31,428] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 27: [2023-04-29 17:23:31,429] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 27: [2023-04-29 17:23:31,429] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 31: [2023-04-29 17:23:31,430] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 31: [2023-04-29 17:23:31,431] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 31: [2023-04-29 17:23:31,431] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 29: [2023-04-29 17:23:31,432] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 29: [2023-04-29 17:23:31,432] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 27: [2023-04-29 17:23:31,434] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 31: [2023-04-29 17:23:31,434] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 31: [2023-04-29 17:23:31,434] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 31: [2023-04-29 17:23:31,434] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 31: [2023-04-29 17:23:31,434] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 31: [2023-04-29 17:23:31,435] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 27: [2023-04-29 17:23:31,436] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 23: [2023-04-29 17:23:31,436] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 23: [2023-04-29 17:23:31,436] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 5: [2023-04-29 17:23:31,437] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 21: [2023-04-29 17:23:31,437] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 5: [2023-04-29 17:23:31,437] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 6: [2023-04-29 17:23:31,437] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 6: [2023-04-29 17:23:31,437] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 21: [2023-04-29 17:23:31,438] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 23: [2023-04-29 17:23:31,438] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 23: [2023-04-29 17:23:31,438] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 21: [2023-04-29 17:23:31,438] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 23: [2023-04-29 17:23:31,439] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 16: [2023-04-29 17:23:31,439] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 23: [2023-04-29 17:23:31,439] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 23: [2023-04-29 17:23:31,439] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 23: [2023-04-29 17:23:31,439] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 21: [2023-04-29 17:23:31,439] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 21: [2023-04-29 17:23:31,439] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 5: [2023-04-29 17:23:31,440] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 5: [2023-04-29 17:23:31,441] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 5: [2023-04-29 17:23:31,441] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 5: [2023-04-29 17:23:31,441] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 5: [2023-04-29 17:23:31,441] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 5: [2023-04-29 17:23:31,441] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 5: [2023-04-29 17:23:31,441] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 29: [2023-04-29 17:23:31,441] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 29: [2023-04-29 17:23:31,441] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 23: [2023-04-29 17:23:31,444] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 5: [2023-04-29 17:23:31,444] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 5: [2023-04-29 17:23:31,445] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 23: [2023-04-29 17:23:31,445] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 27: [2023-04-29 17:23:31,445] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 23: [2023-04-29 17:23:31,445] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 23: [2023-04-29 17:23:31,445] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 16: [2023-04-29 17:23:31,446] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 7: [2023-04-29 17:23:31,446] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 23: [2023-04-29 17:23:31,447] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 16: [2023-04-29 17:23:31,447] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 23: [2023-04-29 17:23:31,448] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 27: [2023-04-29 17:23:31,448] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 23: [2023-04-29 17:23:31,449] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 27: [2023-04-29 17:23:31,449] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 27: [2023-04-29 17:23:31,449] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 27: [2023-04-29 17:23:31,449] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 16: [2023-04-29 17:23:31,449] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 23: [2023-04-29 17:23:31,450] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 5: [2023-04-29 17:23:31,450] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 5: [2023-04-29 17:23:31,451] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 16: [2023-04-29 17:23:31,451] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 16: [2023-04-29 17:23:31,451] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 5: [2023-04-29 17:23:31,451] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 5: [2023-04-29 17:23:31,452] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 5: [2023-04-29 17:23:31,452] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 27: [2023-04-29 17:23:31,454] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 29: [2023-04-29 17:23:31,456] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 27: [2023-04-29 17:23:31,457] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 6: [2023-04-29 17:23:31,457] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 6: [2023-04-29 17:23:31,457] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 29: [2023-04-29 17:23:31,457] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 27: [2023-04-29 17:23:31,458] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 27: [2023-04-29 17:23:31,458] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 6: [2023-04-29 17:23:31,458] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 27: [2023-04-29 17:23:31,458] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 6: [2023-04-29 17:23:31,458] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 25: [2023-04-29 17:23:31,459] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 25: [2023-04-29 17:23:31,459] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 27: [2023-04-29 17:23:31,460] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 7: [2023-04-29 17:23:31,460] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 7: [2023-04-29 17:23:31,460] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 27: [2023-04-29 17:23:31,461] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 27: [2023-04-29 17:23:31,461] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 6: [2023-04-29 17:23:31,460] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 27: [2023-04-29 17:23:31,461] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 29: [2023-04-29 17:23:31,462] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 6: [2023-04-29 17:23:31,462] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 6: [2023-04-29 17:23:31,462] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 6: [2023-04-29 17:23:31,462] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 29: [2023-04-29 17:23:31,462] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 6: [2023-04-29 17:23:31,462] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 6: [2023-04-29 17:23:31,463] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 6: [2023-04-29 17:23:31,463] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 17: [2023-04-29 17:23:31,464] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 7: [2023-04-29 17:23:31,464] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 7: [2023-04-29 17:23:31,464] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 7: [2023-04-29 17:23:31,467] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 11: [2023-04-29 17:23:31,467] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 11: [2023-04-29 17:23:31,467] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 11: [2023-04-29 17:23:31,467] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 27: [2023-04-29 17:23:31,468] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 17: [2023-04-29 17:23:31,468] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 27: [2023-04-29 17:23:31,469] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 27: [2023-04-29 17:23:31,469] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 27: [2023-04-29 17:23:31,469] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 27: [2023-04-29 17:23:31,469] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 27: [2023-04-29 17:23:31,470] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 27: [2023-04-29 17:23:31,470] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 27: [2023-04-29 17:23:31,470] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 7: [2023-04-29 17:23:31,472] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 7: [2023-04-29 17:23:31,472] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 29: [2023-04-29 17:23:31,472] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 7: [2023-04-29 17:23:31,473] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 29: [2023-04-29 17:23:31,473] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 6: [2023-04-29 17:23:31,473] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 17: [2023-04-29 17:23:31,474] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 3: [2023-04-29 17:23:31,476] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 3: [2023-04-29 17:23:31,476] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 3: [2023-04-29 17:23:31,477] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 6: [2023-04-29 17:23:31,478] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 27: [2023-04-29 17:23:31,478] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 3: [2023-04-29 17:23:31,478] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 3: [2023-04-29 17:23:31,478] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 3: [2023-04-29 17:23:31,478] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 27: [2023-04-29 17:23:31,478] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 3: [2023-04-29 17:23:31,478] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 27: [2023-04-29 17:23:31,478] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 3: [2023-04-29 17:23:31,478] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 7: [2023-04-29 17:23:31,479] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 27: [2023-04-29 17:23:31,478] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 17: [2023-04-29 17:23:31,479] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 25: [2023-04-29 17:23:31,480] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 6: [2023-04-29 17:23:31,480] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 3: [2023-04-29 17:23:31,480] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 3: [2023-04-29 17:23:31,480] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 25: [2023-04-29 17:23:31,481] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 19: [2023-04-29 17:23:31,480] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 19: [2023-04-29 17:23:31,480] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 27: [2023-04-29 17:23:31,481] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 27: [2023-04-29 17:23:31,481] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 27: [2023-04-29 17:23:31,481] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 27: [2023-04-29 17:23:31,482] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 7: [2023-04-29 17:23:31,482] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 7: [2023-04-29 17:23:31,482] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 19: [2023-04-29 17:23:31,482] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 19: [2023-04-29 17:23:31,482] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 19: [2023-04-29 17:23:31,482] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 19: [2023-04-29 17:23:31,482] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 19: [2023-04-29 17:23:31,482] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 19: [2023-04-29 17:23:31,483] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 31: [2023-04-29 17:23:31,483] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 19: [2023-04-29 17:23:31,484] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 11: [2023-04-29 17:23:31,484] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 11: [2023-04-29 17:23:31,485] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 19: [2023-04-29 17:23:31,485] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 25: [2023-04-29 17:23:31,485] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 25: [2023-04-29 17:23:31,485] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 25: [2023-04-29 17:23:31,485] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 25: [2023-04-29 17:23:31,485] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 11: [2023-04-29 17:23:31,486] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 11: [2023-04-29 17:23:31,486] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 7: [2023-04-29 17:23:31,486] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 31: [2023-04-29 17:23:31,486] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 31: [2023-04-29 17:23:31,486] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 17: [2023-04-29 17:23:31,486] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 20: [2023-04-29 17:23:31,486] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_163_mp_rank_00_optim_states.pt... 20: [2023-04-29 17:23:31,486] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_162_mp_rank_00_optim_states.pt... 20: [2023-04-29 17:23:31,486] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_160_mp_rank_00_optim_states.pt... 20: [2023-04-29 17:23:31,486] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_167_mp_rank_00_optim_states.pt... 7: [2023-04-29 17:23:31,486] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 20: [2023-04-29 17:23:31,486] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_164_mp_rank_00_optim_states.pt... 20: [2023-04-29 17:23:31,486] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_165_mp_rank_00_optim_states.pt... 20: [2023-04-29 17:23:31,486] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_161_mp_rank_00_optim_states.pt... 20: [2023-04-29 17:23:31,486] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_166_mp_rank_00_optim_states.pt... 6: [2023-04-29 17:23:31,486] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 7: [2023-04-29 17:23:31,487] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 19: [2023-04-29 17:23:31,487] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 7: [2023-04-29 17:23:31,487] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 7: [2023-04-29 17:23:31,487] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 7: [2023-04-29 17:23:31,487] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 7: [2023-04-29 17:23:31,487] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 6: [2023-04-29 17:23:31,487] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 6: [2023-04-29 17:23:31,487] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 6: [2023-04-29 17:23:31,487] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 3: [2023-04-29 17:23:31,487] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 3: [2023-04-29 17:23:31,487] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 7: [2023-04-29 17:23:31,488] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 3: [2023-04-29 17:23:31,488] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 6: [2023-04-29 17:23:31,488] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 6: [2023-04-29 17:23:31,488] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 6: [2023-04-29 17:23:31,488] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 3: [2023-04-29 17:23:31,488] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 6: [2023-04-29 17:23:31,488] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 3: [2023-04-29 17:23:31,489] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 25: [2023-04-29 17:23:31,489] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 25: [2023-04-29 17:23:31,489] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 3: [2023-04-29 17:23:31,489] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 11: [2023-04-29 17:23:31,490] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 6: [2023-04-29 17:23:31,490] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 7: [2023-04-29 17:23:31,490] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 7: [2023-04-29 17:23:31,491] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 6: [2023-04-29 17:23:31,491] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 6: [2023-04-29 17:23:31,491] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 6: [2023-04-29 17:23:31,491] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 7: [2023-04-29 17:23:31,491] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 24: [2023-04-29 17:23:31,491] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 7: [2023-04-29 17:23:31,492] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 7: [2023-04-29 17:23:31,492] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 7: [2023-04-29 17:23:31,492] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 19: [2023-04-29 17:23:31,491] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 19: [2023-04-29 17:23:31,491] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 19: [2023-04-29 17:23:31,492] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 19: [2023-04-29 17:23:31,492] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 7: [2023-04-29 17:23:31,492] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 7: [2023-04-29 17:23:31,492] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 24: [2023-04-29 17:23:31,492] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 24: [2023-04-29 17:23:31,492] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 24: [2023-04-29 17:23:31,492] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 24: [2023-04-29 17:23:31,492] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 24: [2023-04-29 17:23:31,492] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 24: [2023-04-29 17:23:31,492] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 19: [2023-04-29 17:23:31,493] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 24: [2023-04-29 17:23:31,493] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 17: [2023-04-29 17:23:31,493] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 11: [2023-04-29 17:23:31,493] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 5: [2023-04-29 17:23:31,493] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 5: [2023-04-29 17:23:31,493] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 2: [2023-04-29 17:23:31,493] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 2: [2023-04-29 17:23:31,493] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 2: [2023-04-29 17:23:31,494] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 17: [2023-04-29 17:23:31,494] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 2: [2023-04-29 17:23:31,494] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 2: [2023-04-29 17:23:31,494] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 11: [2023-04-29 17:23:31,495] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 2: [2023-04-29 17:23:31,494] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 2: [2023-04-29 17:23:31,494] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 11: [2023-04-29 17:23:31,495] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 11: [2023-04-29 17:23:31,495] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 11: [2023-04-29 17:23:31,495] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 2: [2023-04-29 17:23:31,495] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 11: [2023-04-29 17:23:31,495] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 11: [2023-04-29 17:23:31,495] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 11: [2023-04-29 17:23:31,495] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 24: [2023-04-29 17:23:31,495] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 11: [2023-04-29 17:23:31,497] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 11: [2023-04-29 17:23:31,497] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 11: [2023-04-29 17:23:31,498] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 11: [2023-04-29 17:23:31,498] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 23: [2023-04-29 17:23:31,498] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 2: [2023-04-29 17:23:31,498] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 2: [2023-04-29 17:23:31,499] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 2: [2023-04-29 17:23:31,499] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 17: [2023-04-29 17:23:31,499] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 17: [2023-04-29 17:23:31,499] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 17: [2023-04-29 17:23:31,500] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 31: [2023-04-29 17:23:31,501] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 31: [2023-04-29 17:23:31,501] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 31: [2023-04-29 17:23:31,501] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 31: [2023-04-29 17:23:31,501] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 31: [2023-04-29 17:23:31,501] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 27: [2023-04-29 17:23:31,501] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_219_mp_rank_00_optim_states.pt... 27: [2023-04-29 17:23:31,501] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_216_mp_rank_00_optim_states.pt... 27: [2023-04-29 17:23:31,501] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_222_mp_rank_00_optim_states.pt... 27: [2023-04-29 17:23:31,501] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_218_mp_rank_00_optim_states.pt... 27: [2023-04-29 17:23:31,501] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_220_mp_rank_00_optim_states.pt... 27: [2023-04-29 17:23:31,501] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_221_mp_rank_00_optim_states.pt... 27: [2023-04-29 17:23:31,501] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_217_mp_rank_00_optim_states.pt... 27: [2023-04-29 17:23:31,501] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_223_mp_rank_00_optim_states.pt... 2: [2023-04-29 17:23:31,503] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 17: [2023-04-29 17:23:31,503] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 23: [2023-04-29 17:23:31,503] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 2: [2023-04-29 17:23:31,504] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 7: [2023-04-29 17:23:31,504] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 2: [2023-04-29 17:23:31,504] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 24: [2023-04-29 17:23:31,504] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 2: [2023-04-29 17:23:31,504] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 24: [2023-04-29 17:23:31,504] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 6: [2023-04-29 17:23:31,505] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 7: [2023-04-29 17:23:31,505] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 7: [2023-04-29 17:23:31,505] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 24: [2023-04-29 17:23:31,505] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 7: [2023-04-29 17:23:31,505] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 30: [2023-04-29 17:23:31,505] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 6: [2023-04-29 17:23:31,505] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 6: [2023-04-29 17:23:31,505] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 24: [2023-04-29 17:23:31,505] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 2: [2023-04-29 17:23:31,505] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 24: [2023-04-29 17:23:31,505] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 6: [2023-04-29 17:23:31,506] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 30: [2023-04-29 17:23:31,506] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 30: [2023-04-29 17:23:31,506] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 30: [2023-04-29 17:23:31,506] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 30: [2023-04-29 17:23:31,506] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 30: [2023-04-29 17:23:31,506] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 30: [2023-04-29 17:23:31,506] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 30: [2023-04-29 17:23:31,506] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 24: [2023-04-29 17:23:31,507] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 24: [2023-04-29 17:23:31,507] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 6: [2023-04-29 17:23:31,507] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 31: [2023-04-29 17:23:31,507] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 6: [2023-04-29 17:23:31,508] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 6: [2023-04-29 17:23:31,508] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 6: [2023-04-29 17:23:31,508] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 8: [2023-04-29 17:23:31,508] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 8: [2023-04-29 17:23:31,508] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 17: [2023-04-29 17:23:31,509] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 8: [2023-04-29 17:23:31,509] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 7: [2023-04-29 17:23:31,509] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 8: [2023-04-29 17:23:31,509] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 8: [2023-04-29 17:23:31,509] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 8: [2023-04-29 17:23:31,509] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 8: [2023-04-29 17:23:31,509] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 31: [2023-04-29 17:23:31,509] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 8: [2023-04-29 17:23:31,509] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 6: [2023-04-29 17:23:31,510] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 23: [2023-04-29 17:23:31,510] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 7: [2023-04-29 17:23:31,510] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 7: [2023-04-29 17:23:31,510] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 6: [2023-04-29 17:23:31,510] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 6: [2023-04-29 17:23:31,510] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 7: [2023-04-29 17:23:31,510] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 6: [2023-04-29 17:23:31,510] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 1: [2023-04-29 17:23:31,511] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 1: [2023-04-29 17:23:31,511] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 1: [2023-04-29 17:23:31,511] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 7: [2023-04-29 17:23:31,511] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 1: [2023-04-29 17:23:31,511] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 1: [2023-04-29 17:23:31,511] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 1: [2023-04-29 17:23:31,511] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 1: [2023-04-29 17:23:31,511] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 4: [2023-04-29 17:23:31,511] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 4: [2023-04-29 17:23:31,511] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 26: [2023-04-29 17:23:31,510] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 26: [2023-04-29 17:23:31,510] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 26: [2023-04-29 17:23:31,510] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 26: [2023-04-29 17:23:31,510] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 26: [2023-04-29 17:23:31,510] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 14: [2023-04-29 17:23:31,511] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 26: [2023-04-29 17:23:31,511] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 26: [2023-04-29 17:23:31,511] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 26: [2023-04-29 17:23:31,511] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 1: [2023-04-29 17:23:31,511] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 7: [2023-04-29 17:23:31,511] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 7: [2023-04-29 17:23:31,511] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 14: [2023-04-29 17:23:31,511] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 14: [2023-04-29 17:23:31,511] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 14: [2023-04-29 17:23:31,511] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 7: [2023-04-29 17:23:31,512] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 14: [2023-04-29 17:23:31,512] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 14: [2023-04-29 17:23:31,512] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 14: [2023-04-29 17:23:31,512] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 14: [2023-04-29 17:23:31,512] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 23: [2023-04-29 17:23:31,512] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 31: [2023-04-29 17:23:31,513] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 5: [2023-04-29 17:23:31,513] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 14: [2023-04-29 17:23:31,513] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 4: [2023-04-29 17:23:31,513] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 4: [2023-04-29 17:23:31,513] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 4: [2023-04-29 17:23:31,513] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 4: [2023-04-29 17:23:31,513] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 4: [2023-04-29 17:23:31,513] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 5: [2023-04-29 17:23:31,514] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 4: [2023-04-29 17:23:31,514] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 8: [2023-04-29 17:23:31,513] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 14: [2023-04-29 17:23:31,514] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 4: [2023-04-29 17:23:31,515] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 4: [2023-04-29 17:23:31,515] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 8: [2023-04-29 17:23:31,515] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 23: [2023-04-29 17:23:31,516] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 25: [2023-04-29 17:23:31,516] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 23: [2023-04-29 17:23:31,516] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 26: [2023-04-29 17:23:31,516] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 0: [2023-04-29 17:23:31,516] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 0: [2023-04-29 17:23:31,516] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 8: [2023-04-29 17:23:31,516] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 11: [2023-04-29 17:23:31,516] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 0: [2023-04-29 17:23:31,516] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 1: [2023-04-29 17:23:31,516] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 1: [2023-04-29 17:23:31,517] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 26: [2023-04-29 17:23:31,517] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 8: [2023-04-29 17:23:31,517] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 11: [2023-04-29 17:23:31,517] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 0: [2023-04-29 17:23:31,517] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 0: [2023-04-29 17:23:31,517] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 0: [2023-04-29 17:23:31,517] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 0: [2023-04-29 17:23:31,517] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 0: [2023-04-29 17:23:31,517] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 26: [2023-04-29 17:23:31,517] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 11: [2023-04-29 17:23:31,517] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 11: [2023-04-29 17:23:31,517] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 11: [2023-04-29 17:23:31,517] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 30: [2023-04-29 17:23:31,517] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 1: [2023-04-29 17:23:31,517] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 11: [2023-04-29 17:23:31,517] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 1: [2023-04-29 17:23:31,517] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 11: [2023-04-29 17:23:31,517] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 26: [2023-04-29 17:23:31,517] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 8: [2023-04-29 17:23:31,517] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 1: [2023-04-29 17:23:31,517] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 1: [2023-04-29 17:23:31,517] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 11: [2023-04-29 17:23:31,518] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 1: [2023-04-29 17:23:31,518] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 30: [2023-04-29 17:23:31,518] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 26: [2023-04-29 17:23:31,518] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 11: [2023-04-29 17:23:31,518] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 25: [2023-04-29 17:23:31,518] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 25: [2023-04-29 17:23:31,518] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 30: [2023-04-29 17:23:31,518] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 1: [2023-04-29 17:23:31,518] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 30: [2023-04-29 17:23:31,518] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 11: [2023-04-29 17:23:31,518] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 8: [2023-04-29 17:23:31,518] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 30: [2023-04-29 17:23:31,518] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 11: [2023-04-29 17:23:31,518] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 11: [2023-04-29 17:23:31,518] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 14: [2023-04-29 17:23:31,518] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 26: [2023-04-29 17:23:31,518] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 8: [2023-04-29 17:23:31,518] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 26: [2023-04-29 17:23:31,519] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 26: [2023-04-29 17:23:31,519] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 30: [2023-04-29 17:23:31,518] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 11: [2023-04-29 17:23:31,519] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 11: [2023-04-29 17:23:31,519] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 11: [2023-04-29 17:23:31,519] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 8: [2023-04-29 17:23:31,519] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 11: [2023-04-29 17:23:31,519] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 25: [2023-04-29 17:23:31,520] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 30: [2023-04-29 17:23:31,520] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 30: [2023-04-29 17:23:31,520] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 5: [2023-04-29 17:23:31,521] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 23: [2023-04-29 17:23:31,521] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 25: [2023-04-29 17:23:31,521] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 14: [2023-04-29 17:23:31,521] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 11: [2023-04-29 17:23:31,521] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 18: [2023-04-29 17:23:31,522] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 18: [2023-04-29 17:23:31,521] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 18: [2023-04-29 17:23:31,521] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 11: [2023-04-29 17:23:31,522] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 11: [2023-04-29 17:23:31,522] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 18: [2023-04-29 17:23:31,522] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 18: [2023-04-29 17:23:31,522] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 18: [2023-04-29 17:23:31,522] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 18: [2023-04-29 17:23:31,522] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 25: [2023-04-29 17:23:31,522] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 11: [2023-04-29 17:23:31,522] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 18: [2023-04-29 17:23:31,522] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 14: [2023-04-29 17:23:31,522] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 14: [2023-04-29 17:23:31,523] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 4: [2023-04-29 17:23:31,523] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 14: [2023-04-29 17:23:31,523] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 5: [2023-04-29 17:23:31,523] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 5: [2023-04-29 17:23:31,523] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 14: [2023-04-29 17:23:31,523] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 0: [2023-04-29 17:23:31,524] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 4: [2023-04-29 17:23:31,524] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 15: [2023-04-29 17:23:31,523] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 15: [2023-04-29 17:23:31,523] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 15: [2023-04-29 17:23:31,523] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 15: [2023-04-29 17:23:31,523] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 15: [2023-04-29 17:23:31,523] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 15: [2023-04-29 17:23:31,523] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 15: [2023-04-29 17:23:31,523] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 15: [2023-04-29 17:23:31,524] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 5: [2023-04-29 17:23:31,524] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 4: [2023-04-29 17:23:31,524] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 17: [2023-04-29 17:23:31,524] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 0: [2023-04-29 17:23:31,525] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 4: [2023-04-29 17:23:31,525] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 4: [2023-04-29 17:23:31,525] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 4: [2023-04-29 17:23:31,526] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 22: [2023-04-29 17:23:31,526] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 22: [2023-04-29 17:23:31,526] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 5: [2023-04-29 17:23:31,526] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 5: [2023-04-29 17:23:31,527] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 23: [2023-04-29 17:23:31,528] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 22: [2023-04-29 17:23:31,528] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 22: [2023-04-29 17:23:31,528] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 22: [2023-04-29 17:23:31,528] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 22: [2023-04-29 17:23:31,528] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 22: [2023-04-29 17:23:31,528] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 22: [2023-04-29 17:23:31,528] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 17: [2023-04-29 17:23:31,529] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 31: [2023-04-29 17:23:31,530] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 31: [2023-04-29 17:23:31,530] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 31: [2023-04-29 17:23:31,530] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 0: [2023-04-29 17:23:31,531] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 17: [2023-04-29 17:23:31,531] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 0: [2023-04-29 17:23:31,531] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 17: [2023-04-29 17:23:31,531] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 22: [2023-04-29 17:23:31,531] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 0: [2023-04-29 17:23:31,531] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 22: [2023-04-29 17:23:31,532] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 3: [2023-04-29 17:23:31,531] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 3: [2023-04-29 17:23:31,531] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 0: [2023-04-29 17:23:31,532] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 19: [2023-04-29 17:23:31,531] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 0: [2023-04-29 17:23:31,532] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 31: [2023-04-29 17:23:31,532] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 31: [2023-04-29 17:23:31,532] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 23: [2023-04-29 17:23:31,534] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 0: [2023-04-29 17:23:31,534] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 18: [2023-04-29 17:23:31,535] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 18: [2023-04-29 17:23:31,535] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 15: [2023-04-29 17:23:31,535] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 15: [2023-04-29 17:23:31,535] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 15: [2023-04-29 17:23:31,535] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 15: [2023-04-29 17:23:31,535] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 18: [2023-04-29 17:23:31,536] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 18: [2023-04-29 17:23:31,537] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 18: [2023-04-29 17:23:31,537] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 18: [2023-04-29 17:23:31,537] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 15: [2023-04-29 17:23:31,537] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 15: [2023-04-29 17:23:31,537] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 15: [2023-04-29 17:23:31,537] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 18: [2023-04-29 17:23:31,538] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 18: [2023-04-29 17:23:31,538] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 22: [2023-04-29 17:23:31,538] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 15: [2023-04-29 17:23:31,539] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 22: [2023-04-29 17:23:31,539] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 23: [2023-04-29 17:23:31,539] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 22: [2023-04-29 17:23:31,540] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 23: [2023-04-29 17:23:31,540] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 22: [2023-04-29 17:23:31,540] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 23: [2023-04-29 17:23:31,540] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 22: [2023-04-29 17:23:31,541] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 22: [2023-04-29 17:23:31,541] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 19: [2023-04-29 17:23:31,543] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 19: [2023-04-29 17:23:31,543] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 24: [2023-04-29 17:23:31,545] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 23: [2023-04-29 17:23:31,548] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 6: [2023-04-29 17:23:31,549] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_50_mp_rank_00_optim_states.pt... 6: [2023-04-29 17:23:31,549] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_53_mp_rank_00_optim_states.pt... 6: [2023-04-29 17:23:31,549] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_49_mp_rank_00_optim_states.pt... 6: [2023-04-29 17:23:31,549] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_52_mp_rank_00_optim_states.pt... 23: [2023-04-29 17:23:31,549] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 6: [2023-04-29 17:23:31,549] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_54_mp_rank_00_optim_states.pt... 6: [2023-04-29 17:23:31,549] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_48_mp_rank_00_optim_states.pt... 6: [2023-04-29 17:23:31,549] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_55_mp_rank_00_optim_states.pt... 6: [2023-04-29 17:23:31,549] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_51_mp_rank_00_optim_states.pt... 5: [2023-04-29 17:23:31,552] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 3: [2023-04-29 17:23:31,552] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 19: [2023-04-29 17:23:31,553] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 3: [2023-04-29 17:23:31,554] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 2: [2023-04-29 17:23:31,554] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 2: [2023-04-29 17:23:31,554] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 2: [2023-04-29 17:23:31,554] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 3: [2023-04-29 17:23:31,555] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 5: [2023-04-29 17:23:31,558] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 14: [2023-04-29 17:23:31,557] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 3: [2023-04-29 17:23:31,558] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 3: [2023-04-29 17:23:31,558] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 3: [2023-04-29 17:23:31,558] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 3: [2023-04-29 17:23:31,558] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 2: [2023-04-29 17:23:31,558] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 23: [2023-04-29 17:23:31,560] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 19: [2023-04-29 17:23:31,560] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 19: [2023-04-29 17:23:31,560] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 19: [2023-04-29 17:23:31,560] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 19: [2023-04-29 17:23:31,560] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 7: [2023-04-29 17:23:31,561] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_57_mp_rank_00_optim_states.pt... 7: [2023-04-29 17:23:31,561] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_58_mp_rank_00_optim_states.pt... 7: [2023-04-29 17:23:31,561] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_56_mp_rank_00_optim_states.pt... 7: [2023-04-29 17:23:31,561] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_60_mp_rank_00_optim_states.pt... 7: [2023-04-29 17:23:31,561] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_63_mp_rank_00_optim_states.pt... 7: [2023-04-29 17:23:31,561] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_62_mp_rank_00_optim_states.pt... 7: [2023-04-29 17:23:31,561] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_61_mp_rank_00_optim_states.pt... 7: [2023-04-29 17:23:31,561] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_59_mp_rank_00_optim_states.pt... 19: [2023-04-29 17:23:31,562] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 8: [2023-04-29 17:23:31,562] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 3: [2023-04-29 17:23:31,562] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 28: [2023-04-29 17:23:31,562] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 28: [2023-04-29 17:23:31,562] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 28: [2023-04-29 17:23:31,562] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 28: [2023-04-29 17:23:31,562] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 28: [2023-04-29 17:23:31,562] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 28: [2023-04-29 17:23:31,562] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 28: [2023-04-29 17:23:31,562] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 5: [2023-04-29 17:23:31,563] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 28: [2023-04-29 17:23:31,563] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 5: [2023-04-29 17:23:31,563] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 8: [2023-04-29 17:23:31,564] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 5: [2023-04-29 17:23:31,566] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 5: [2023-04-29 17:23:31,566] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 24: [2023-04-29 17:23:31,566] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 1: [2023-04-29 17:23:31,566] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 14: [2023-04-29 17:23:31,566] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 4: [2023-04-29 17:23:31,566] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 4: [2023-04-29 17:23:31,566] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 19: [2023-04-29 17:23:31,568] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 23: [2023-04-29 17:23:31,569] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 24: [2023-04-29 17:23:31,569] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 19: [2023-04-29 17:23:31,568] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 24: [2023-04-29 17:23:31,569] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 24: [2023-04-29 17:23:31,569] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 2: [2023-04-29 17:23:31,570] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 2: [2023-04-29 17:23:31,570] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 28: [2023-04-29 17:23:31,570] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 26: [2023-04-29 17:23:31,570] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 26: [2023-04-29 17:23:31,570] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 2: [2023-04-29 17:23:31,573] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 2: [2023-04-29 17:23:31,573] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 26: [2023-04-29 17:23:31,573] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 26: [2023-04-29 17:23:31,575] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 14: [2023-04-29 17:23:31,576] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 28: [2023-04-29 17:23:31,576] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 28: [2023-04-29 17:23:31,576] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 28: [2023-04-29 17:23:31,577] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 2: [2023-04-29 17:23:31,577] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 2: [2023-04-29 17:23:31,577] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 28: [2023-04-29 17:23:31,577] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 28: [2023-04-29 17:23:31,577] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 28: [2023-04-29 17:23:31,578] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 1: [2023-04-29 17:23:31,578] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 1: [2023-04-29 17:23:31,578] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 1: [2023-04-29 17:23:31,578] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 1: [2023-04-29 17:23:31,578] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 2: [2023-04-29 17:23:31,579] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 28: [2023-04-29 17:23:31,579] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt... 14: [2023-04-29 17:23:31,580] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 14: [2023-04-29 17:23:31,580] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 14: [2023-04-29 17:23:31,581] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 14: [2023-04-29 17:23:31,581] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 26: [2023-04-29 17:23:31,581] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 26: [2023-04-29 17:23:31,581] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 26: [2023-04-29 17:23:31,581] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 24: [2023-04-29 17:23:31,581] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 24: [2023-04-29 17:23:31,581] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 26: [2023-04-29 17:23:31,581] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 2: [2023-04-29 17:23:31,582] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 2: [2023-04-29 17:23:31,582] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 2: [2023-04-29 17:23:31,582] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 2: [2023-04-29 17:23:31,582] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 24: [2023-04-29 17:23:31,582] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 2: [2023-04-29 17:23:31,582] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 2: [2023-04-29 17:23:31,582] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 2: [2023-04-29 17:23:31,582] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 2: [2023-04-29 17:23:31,582] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 2: [2023-04-29 17:23:31,583] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 8: [2023-04-29 17:23:31,583] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 8: [2023-04-29 17:23:31,583] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 1: [2023-04-29 17:23:31,583] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 1: [2023-04-29 17:23:31,583] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 1: [2023-04-29 17:23:31,583] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 8: [2023-04-29 17:23:31,583] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 8: [2023-04-29 17:23:31,584] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 8: [2023-04-29 17:23:31,584] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 8: [2023-04-29 17:23:31,584] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 22: [2023-04-29 17:23:31,583] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 22: [2023-04-29 17:23:31,583] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 24: [2023-04-29 17:23:31,584] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 2: [2023-04-29 17:23:31,584] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 24: [2023-04-29 17:23:31,584] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 24: [2023-04-29 17:23:31,584] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 14: [2023-04-29 17:23:31,585] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 2: [2023-04-29 17:23:31,585] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 24: [2023-04-29 17:23:31,585] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 2: [2023-04-29 17:23:31,585] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 3: [2023-04-29 17:23:31,585] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 14: [2023-04-29 17:23:31,585] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 14: [2023-04-29 17:23:31,585] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 2: [2023-04-29 17:23:31,585] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 8: [2023-04-29 17:23:31,585] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 14: [2023-04-29 17:23:31,585] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 8: [2023-04-29 17:23:31,587] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 1: [2023-04-29 17:23:31,588] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 4: [2023-04-29 17:23:31,588] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 11: [2023-04-29 17:23:31,589] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_95_mp_rank_00_optim_states.pt... 11: [2023-04-29 17:23:31,589] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_92_mp_rank_00_optim_states.pt... 11: [2023-04-29 17:23:31,589] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_91_mp_rank_00_optim_states.pt... 11: [2023-04-29 17:23:31,589] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_94_mp_rank_00_optim_states.pt... 11: [2023-04-29 17:23:31,589] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_88_mp_rank_00_optim_states.pt... 30: [2023-04-29 17:23:31,589] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 11: [2023-04-29 17:23:31,589] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_90_mp_rank_00_optim_states.pt... 11: [2023-04-29 17:23:31,589] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_93_mp_rank_00_optim_states.pt... 11: [2023-04-29 17:23:31,589] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_89_mp_rank_00_optim_states.pt... 4: [2023-04-29 17:23:31,590] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 19: [2023-04-29 17:23:31,590] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 3: [2023-04-29 17:23:31,590] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 0: [2023-04-29 17:23:31,591] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 4: [2023-04-29 17:23:31,591] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 4: [2023-04-29 17:23:31,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 4: [2023-04-29 17:23:31,591] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 4: [2023-04-29 17:23:31,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 3: [2023-04-29 17:23:31,591] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 3: [2023-04-29 17:23:31,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 4: [2023-04-29 17:23:31,592] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 4: [2023-04-29 17:23:31,592] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 3: [2023-04-29 17:23:31,592] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 19: [2023-04-29 17:23:31,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 14: [2023-04-29 17:23:31,593] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 19: [2023-04-29 17:23:31,593] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 4: [2023-04-29 17:23:31,594] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 4: [2023-04-29 17:23:31,594] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 3: [2023-04-29 17:23:31,594] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 2: [2023-04-29 17:23:31,595] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 2: [2023-04-29 17:23:31,596] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 2: [2023-04-29 17:23:31,596] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 2: [2023-04-29 17:23:31,596] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 26: [2023-04-29 17:23:31,596] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 26: [2023-04-29 17:23:31,596] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 19: [2023-04-29 17:23:31,596] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 4: [2023-04-29 17:23:31,597] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 1: [2023-04-29 17:23:31,599] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 1: [2023-04-29 17:23:31,599] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 4: [2023-04-29 17:23:31,600] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 4: [2023-04-29 17:23:31,600] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 4: [2023-04-29 17:23:31,600] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 19: [2023-04-29 17:23:31,601] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 2: [2023-04-29 17:23:31,601] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 2: [2023-04-29 17:23:31,601] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 2: [2023-04-29 17:23:31,601] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 2: [2023-04-29 17:23:31,602] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 26: [2023-04-29 17:23:31,602] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 2: [2023-04-29 17:23:31,602] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 1: [2023-04-29 17:23:31,603] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 14: [2023-04-29 17:23:31,603] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 2: [2023-04-29 17:23:31,603] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 2: [2023-04-29 17:23:31,603] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 2: [2023-04-29 17:23:31,603] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 26: [2023-04-29 17:23:31,603] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 1: [2023-04-29 17:23:31,603] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 2: [2023-04-29 17:23:31,604] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 1: [2023-04-29 17:23:31,604] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 1: [2023-04-29 17:23:31,604] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 2: [2023-04-29 17:23:31,604] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 2: [2023-04-29 17:23:31,604] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 1: [2023-04-29 17:23:31,604] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 22: [2023-04-29 17:23:31,604] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 1: [2023-04-29 17:23:31,605] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 2: [2023-04-29 17:23:31,605] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 22: [2023-04-29 17:23:31,605] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 1: [2023-04-29 17:23:31,605] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 1: [2023-04-29 17:23:31,605] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 1: [2023-04-29 17:23:31,606] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 14: [2023-04-29 17:23:31,606] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 14: [2023-04-29 17:23:31,607] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 14: [2023-04-29 17:23:31,607] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 14: [2023-04-29 17:23:31,607] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 14: [2023-04-29 17:23:31,607] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 14: [2023-04-29 17:23:31,607] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 1: [2023-04-29 17:23:31,607] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 14: [2023-04-29 17:23:31,607] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 22: [2023-04-29 17:23:31,607] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 22: [2023-04-29 17:23:31,607] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 22: [2023-04-29 17:23:31,607] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 22: [2023-04-29 17:23:31,607] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 1: [2023-04-29 17:23:31,608] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 1: [2023-04-29 17:23:31,608] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 1: [2023-04-29 17:23:31,608] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 22: [2023-04-29 17:23:31,608] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 22: [2023-04-29 17:23:31,608] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 1: [2023-04-29 17:23:31,608] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 26: [2023-04-29 17:23:31,608] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 22: [2023-04-29 17:23:31,608] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 22: [2023-04-29 17:23:31,608] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 1: [2023-04-29 17:23:31,608] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 22: [2023-04-29 17:23:31,608] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 1: [2023-04-29 17:23:31,608] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 1: [2023-04-29 17:23:31,608] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 8: [2023-04-29 17:23:31,608] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 1: [2023-04-29 17:23:31,609] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 26: [2023-04-29 17:23:31,609] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 26: [2023-04-29 17:23:31,609] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 1: [2023-04-29 17:23:31,609] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 26: [2023-04-29 17:23:31,609] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 26: [2023-04-29 17:23:31,609] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 26: [2023-04-29 17:23:31,609] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 26: [2023-04-29 17:23:31,609] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 26: [2023-04-29 17:23:31,609] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 1: [2023-04-29 17:23:31,609] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 1: [2023-04-29 17:23:31,609] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 26: [2023-04-29 17:23:31,609] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 26: [2023-04-29 17:23:31,609] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 26: [2023-04-29 17:23:31,609] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 30: [2023-04-29 17:23:31,609] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 30: [2023-04-29 17:23:31,609] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 30: [2023-04-29 17:23:31,609] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 30: [2023-04-29 17:23:31,609] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 30: [2023-04-29 17:23:31,609] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 1: [2023-04-29 17:23:31,609] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 30: [2023-04-29 17:23:31,609] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 1: [2023-04-29 17:23:31,609] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 1: [2023-04-29 17:23:31,609] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 1: [2023-04-29 17:23:31,610] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 26: [2023-04-29 17:23:31,610] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 1: [2023-04-29 17:23:31,610] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 26: [2023-04-29 17:23:31,610] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 26: [2023-04-29 17:23:31,611] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 1: [2023-04-29 17:23:31,611] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 1: [2023-04-29 17:23:31,611] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 0: [2023-04-29 17:23:31,611] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 26: [2023-04-29 17:23:31,611] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 1: [2023-04-29 17:23:31,611] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 26: [2023-04-29 17:23:31,611] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 26: [2023-04-29 17:23:31,611] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 26: [2023-04-29 17:23:31,611] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 26: [2023-04-29 17:23:31,611] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 26: [2023-04-29 17:23:31,611] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 26: [2023-04-29 17:23:31,612] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 26: [2023-04-29 17:23:31,612] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 15: [2023-04-29 17:23:31,611] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 15: [2023-04-29 17:23:31,612] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 26: [2023-04-29 17:23:31,612] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 26: [2023-04-29 17:23:31,612] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 22: [2023-04-29 17:23:31,611] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 8: [2023-04-29 17:23:31,612] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 26: [2023-04-29 17:23:31,613] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 26: [2023-04-29 17:23:31,613] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 26: [2023-04-29 17:23:31,613] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 18: [2023-04-29 17:23:31,613] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 18: [2023-04-29 17:23:31,613] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 18: [2023-04-29 17:23:31,613] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 26: [2023-04-29 17:23:31,613] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 8: [2023-04-29 17:23:31,613] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 8: [2023-04-29 17:23:31,613] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 24: [2023-04-29 17:23:31,614] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 30: [2023-04-29 17:23:31,614] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 24: [2023-04-29 17:23:31,614] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 24: [2023-04-29 17:23:31,614] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 24: [2023-04-29 17:23:31,615] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 22: [2023-04-29 17:23:31,615] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 22: [2023-04-29 17:23:31,615] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 8: [2023-04-29 17:23:31,616] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 8: [2023-04-29 17:23:31,616] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 24: [2023-04-29 17:23:31,617] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 24: [2023-04-29 17:23:31,617] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 24: [2023-04-29 17:23:31,617] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 24: [2023-04-29 17:23:31,618] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 14: [2023-04-29 17:23:31,618] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 24: [2023-04-29 17:23:31,618] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 24: [2023-04-29 17:23:31,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 24: [2023-04-29 17:23:31,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 24: [2023-04-29 17:23:31,618] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 14: [2023-04-29 17:23:31,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 14: [2023-04-29 17:23:31,618] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 24: [2023-04-29 17:23:31,618] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 24: [2023-04-29 17:23:31,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 24: [2023-04-29 17:23:31,619] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 14: [2023-04-29 17:23:31,619] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 24: [2023-04-29 17:23:31,619] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 0: [2023-04-29 17:23:31,619] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 0: [2023-04-29 17:23:31,621] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 24: [2023-04-29 17:23:31,621] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 24: [2023-04-29 17:23:31,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 24: [2023-04-29 17:23:31,622] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 13: [2023-04-29 17:23:31,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 13: [2023-04-29 17:23:31,622] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 24: [2023-04-29 17:23:31,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 13: [2023-04-29 17:23:31,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 13: [2023-04-29 17:23:31,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 13: [2023-04-29 17:23:31,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 13: [2023-04-29 17:23:31,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 13: [2023-04-29 17:23:31,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 24: [2023-04-29 17:23:31,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 13: [2023-04-29 17:23:31,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 24: [2023-04-29 17:23:31,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 24: [2023-04-29 17:23:31,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 24: [2023-04-29 17:23:31,623] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 15: [2023-04-29 17:23:31,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 15: [2023-04-29 17:23:31,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 15: [2023-04-29 17:23:31,623] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 4: [2023-04-29 17:23:31,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 24: [2023-04-29 17:23:31,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 24: [2023-04-29 17:23:31,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 24: [2023-04-29 17:23:31,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 4: [2023-04-29 17:23:31,624] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 24: [2023-04-29 17:23:31,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 30: [2023-04-29 17:23:31,624] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 4: [2023-04-29 17:23:31,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 4: [2023-04-29 17:23:31,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 4: [2023-04-29 17:23:31,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 4: [2023-04-29 17:23:31,625] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 4: [2023-04-29 17:23:31,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 4: [2023-04-29 17:23:31,625] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 15: [2023-04-29 17:23:31,627] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 0: [2023-04-29 17:23:31,627] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 0: [2023-04-29 17:23:31,627] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 0: [2023-04-29 17:23:31,627] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 18: [2023-04-29 17:23:31,627] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 13: [2023-04-29 17:23:31,628] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 18: [2023-04-29 17:23:31,627] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 0: [2023-04-29 17:23:31,628] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 0: [2023-04-29 17:23:31,628] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 18: [2023-04-29 17:23:31,628] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 18: [2023-04-29 17:23:31,628] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 18: [2023-04-29 17:23:31,628] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 13: [2023-04-29 17:23:31,629] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 15: [2023-04-29 17:23:31,631] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 15: [2023-04-29 17:23:31,631] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 13: [2023-04-29 17:23:31,631] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 13: [2023-04-29 17:23:31,632] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 14: [2023-04-29 17:23:31,632] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 4: [2023-04-29 17:23:31,632] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 14: [2023-04-29 17:23:31,632] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 14: [2023-04-29 17:23:31,632] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 4: [2023-04-29 17:23:31,632] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 4: [2023-04-29 17:23:31,632] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 4: [2023-04-29 17:23:31,633] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 4: [2023-04-29 17:23:31,633] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 14: [2023-04-29 17:23:31,633] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 4: [2023-04-29 17:23:31,633] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 4: [2023-04-29 17:23:31,633] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 4: [2023-04-29 17:23:31,633] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 4: [2023-04-29 17:23:31,633] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 4: [2023-04-29 17:23:31,633] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 4: [2023-04-29 17:23:31,633] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 4: [2023-04-29 17:23:31,633] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 13: [2023-04-29 17:23:31,634] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 4: [2023-04-29 17:23:31,634] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 13: [2023-04-29 17:23:31,634] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 4: [2023-04-29 17:23:31,635] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 4: [2023-04-29 17:23:31,635] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 13: [2023-04-29 17:23:31,635] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 4: [2023-04-29 17:23:31,635] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 13: [2023-04-29 17:23:31,635] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 14: [2023-04-29 17:23:31,637] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 14: [2023-04-29 17:23:31,637] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 14: [2023-04-29 17:23:31,637] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 14: [2023-04-29 17:23:31,638] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 22: [2023-04-29 17:23:31,640] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 14: [2023-04-29 17:23:31,640] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 14: [2023-04-29 17:23:31,640] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 0: [2023-04-29 17:23:31,640] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 14: [2023-04-29 17:23:31,640] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 14: [2023-04-29 17:23:31,640] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 22: [2023-04-29 17:23:31,640] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 14: [2023-04-29 17:23:31,640] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 22: [2023-04-29 17:23:31,640] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 14: [2023-04-29 17:23:31,640] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 18: [2023-04-29 17:23:31,640] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 14: [2023-04-29 17:23:31,641] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 14: [2023-04-29 17:23:31,641] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 22: [2023-04-29 17:23:31,641] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 22: [2023-04-29 17:23:31,641] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 28: [2023-04-29 17:23:31,640] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 15: [2023-04-29 17:23:31,641] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 22: [2023-04-29 17:23:31,641] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 18: [2023-04-29 17:23:31,641] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 15: [2023-04-29 17:23:31,641] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 22: [2023-04-29 17:23:31,641] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 22: [2023-04-29 17:23:31,641] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 22: [2023-04-29 17:23:31,642] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 22: [2023-04-29 17:23:31,642] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 22: [2023-04-29 17:23:31,642] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 22: [2023-04-29 17:23:31,642] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 30: [2023-04-29 17:23:31,643] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 18: [2023-04-29 17:23:31,644] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 30: [2023-04-29 17:23:31,644] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 30: [2023-04-29 17:23:31,644] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 22: [2023-04-29 17:23:31,645] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 10: [2023-04-29 17:23:31,645] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 10: [2023-04-29 17:23:31,645] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 10: [2023-04-29 17:23:31,645] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 10: [2023-04-29 17:23:31,645] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 22: [2023-04-29 17:23:31,645] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 22: [2023-04-29 17:23:31,645] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 10: [2023-04-29 17:23:31,645] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 10: [2023-04-29 17:23:31,645] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 10: [2023-04-29 17:23:31,645] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 22: [2023-04-29 17:23:31,646] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 10: [2023-04-29 17:23:31,646] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 22: [2023-04-29 17:23:31,646] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 22: [2023-04-29 17:23:31,646] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 22: [2023-04-29 17:23:31,646] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 22: [2023-04-29 17:23:31,646] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 30: [2023-04-29 17:23:31,647] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 22: [2023-04-29 17:23:31,648] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 22: [2023-04-29 17:23:31,649] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 22: [2023-04-29 17:23:31,649] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 22: [2023-04-29 17:23:31,649] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 30: [2023-04-29 17:23:31,650] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 30: [2023-04-29 17:23:31,651] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 10: [2023-04-29 17:23:31,651] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 10: [2023-04-29 17:23:31,651] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 10: [2023-04-29 17:23:31,651] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 10: [2023-04-29 17:23:31,652] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 0: [2023-04-29 17:23:31,652] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 10: [2023-04-29 17:23:31,653] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 10: [2023-04-29 17:23:31,653] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 10: [2023-04-29 17:23:31,654] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 10: [2023-04-29 17:23:31,654] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 28: [2023-04-29 17:23:31,656] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 28: [2023-04-29 17:23:31,656] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 15: [2023-04-29 17:23:31,658] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 30: [2023-04-29 17:23:31,658] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 15: [2023-04-29 17:23:31,658] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 18: [2023-04-29 17:23:31,660] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 24: [2023-04-29 17:23:31,660] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_194_mp_rank_00_optim_states.pt... 24: [2023-04-29 17:23:31,660] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_198_mp_rank_00_optim_states.pt... 24: [2023-04-29 17:23:31,660] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_196_mp_rank_00_optim_states.pt... 24: [2023-04-29 17:23:31,660] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_192_mp_rank_00_optim_states.pt... 18: [2023-04-29 17:23:31,662] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 15: [2023-04-29 17:23:31,662] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 15: [2023-04-29 17:23:31,662] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 15: [2023-04-29 17:23:31,663] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 2: [2023-04-29 17:23:31,663] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_16_mp_rank_00_optim_states.pt... 2: [2023-04-29 17:23:31,663] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_19_mp_rank_00_optim_states.pt... 2: [2023-04-29 17:23:31,663] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_22_mp_rank_00_optim_states.pt... 2: [2023-04-29 17:23:31,663] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_17_mp_rank_00_optim_states.pt... 2: [2023-04-29 17:23:31,663] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_18_mp_rank_00_optim_states.pt... 2: [2023-04-29 17:23:31,663] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_20_mp_rank_00_optim_states.pt... 2: [2023-04-29 17:23:31,663] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_23_mp_rank_00_optim_states.pt... 18: [2023-04-29 17:23:31,664] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 18: [2023-04-29 17:23:31,665] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 18: [2023-04-29 17:23:31,665] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 0: [2023-04-29 17:23:31,666] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 0: [2023-04-29 17:23:31,666] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 0: [2023-04-29 17:23:31,666] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 0: [2023-04-29 17:23:31,666] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 0: [2023-04-29 17:23:31,666] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 15: [2023-04-29 17:23:31,667] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 14: [2023-04-29 17:23:31,667] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_119_mp_rank_00_optim_states.pt... 14: [2023-04-29 17:23:31,667] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_114_mp_rank_00_optim_states.pt... 14: [2023-04-29 17:23:31,667] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_113_mp_rank_00_optim_states.pt... 14: [2023-04-29 17:23:31,667] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_118_mp_rank_00_optim_states.pt... 14: [2023-04-29 17:23:31,667] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_116_mp_rank_00_optim_states.pt... 14: [2023-04-29 17:23:31,667] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_117_mp_rank_00_optim_states.pt... 14: [2023-04-29 17:23:31,667] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_112_mp_rank_00_optim_states.pt... 14: [2023-04-29 17:23:31,668] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_115_mp_rank_00_optim_states.pt... 28: [2023-04-29 17:23:31,669] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 28: [2023-04-29 17:23:31,671] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 28: [2023-04-29 17:23:31,671] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 28: [2023-04-29 17:23:31,671] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 28: [2023-04-29 17:23:31,671] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 28: [2023-04-29 17:23:31,671] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_35-model_00-model_states.pt. 4: [2023-04-29 17:23:31,681] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_34_mp_rank_00_optim_states.pt... 4: [2023-04-29 17:23:31,681] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_39_mp_rank_00_optim_states.pt... 4: [2023-04-29 17:23:31,681] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_33_mp_rank_00_optim_states.pt... 4: [2023-04-29 17:23:31,681] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_35_mp_rank_00_optim_states.pt... 4: [2023-04-29 17:23:31,681] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_32_mp_rank_00_optim_states.pt... 4: [2023-04-29 17:23:31,681] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_38_mp_rank_00_optim_states.pt... 4: [2023-04-29 17:23:31,681] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_37_mp_rank_00_optim_states.pt... 4: [2023-04-29 17:23:31,681] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_36_mp_rank_00_optim_states.pt... 13: [2023-04-29 17:23:31,681] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 1: [2023-04-29 17:23:31,682] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_8_mp_rank_00_optim_states.pt... 1: [2023-04-29 17:23:31,682] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_14_mp_rank_00_optim_states.pt... 1: [2023-04-29 17:23:31,682] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_9_mp_rank_00_optim_states.pt... 1: [2023-04-29 17:23:31,682] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_15_mp_rank_00_optim_states.pt... 1: [2023-04-29 17:23:31,682] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_10_mp_rank_00_optim_states.pt... 1: [2023-04-29 17:23:31,682] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_13_mp_rank_00_optim_states.pt... 1: [2023-04-29 17:23:31,682] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_12_mp_rank_00_optim_states.pt... 1: [2023-04-29 17:23:31,682] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_11_mp_rank_00_optim_states.pt... 13: [2023-04-29 17:23:31,683] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 28: [2023-04-29 17:23:31,684] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 28: [2023-04-29 17:23:31,685] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 26: [2023-04-29 17:23:31,692] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_209_mp_rank_00_optim_states.pt... 26: [2023-04-29 17:23:31,692] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_210_mp_rank_00_optim_states.pt... 26: [2023-04-29 17:23:31,692] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_214_mp_rank_00_optim_states.pt... 26: [2023-04-29 17:23:31,692] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_208_mp_rank_00_optim_states.pt... 26: [2023-04-29 17:23:31,692] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_212_mp_rank_00_optim_states.pt... 26: [2023-04-29 17:23:31,692] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_213_mp_rank_00_optim_states.pt... 26: [2023-04-29 17:23:31,692] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_215_mp_rank_00_optim_states.pt... 26: [2023-04-29 17:23:31,692] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_211_mp_rank_00_optim_states.pt... 29: [2023-04-29 17:23:31,696] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 29: [2023-04-29 17:23:31,696] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 29: [2023-04-29 17:23:31,698] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 29: [2023-04-29 17:23:31,698] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 22: [2023-04-29 17:23:31,698] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_177_mp_rank_00_optim_states.pt... 22: [2023-04-29 17:23:31,698] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_178_mp_rank_00_optim_states.pt... 22: [2023-04-29 17:23:31,698] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_182_mp_rank_00_optim_states.pt... 22: [2023-04-29 17:23:31,698] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_176_mp_rank_00_optim_states.pt... 29: [2023-04-29 17:23:31,698] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 29: [2023-04-29 17:23:31,698] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 29: [2023-04-29 17:23:31,698] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 29: [2023-04-29 17:23:31,698] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 22: [2023-04-29 17:23:31,698] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_183_mp_rank_00_optim_states.pt... 22: [2023-04-29 17:23:31,698] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_179_mp_rank_00_optim_states.pt... 22: [2023-04-29 17:23:31,698] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_180_mp_rank_00_optim_states.pt... 22: [2023-04-29 17:23:31,698] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_181_mp_rank_00_optim_states.pt... 29: [2023-04-29 17:23:31,700] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 29: [2023-04-29 17:23:31,700] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 13: [2023-04-29 17:23:31,702] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 13: [2023-04-29 17:23:31,702] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 13: [2023-04-29 17:23:31,702] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 13: [2023-04-29 17:23:31,702] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 24: [2023-04-29 17:23:31,660] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_199_mp_rank_00_optim_states.pt... 24: [2023-04-29 17:23:31,660] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_193_mp_rank_00_optim_states.pt... 24: [2023-04-29 17:23:31,660] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_197_mp_rank_00_optim_states.pt... 24: [2023-04-29 17:23:31,660] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_195_mp_rank_00_optim_states.pt... 28: [2023-04-29 17:23:31,703] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 13: [2023-04-29 17:23:31,705] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 13: [2023-04-29 17:23:31,705] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 28: [2023-04-29 17:23:31,706] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 13: [2023-04-29 17:23:31,705] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 28: [2023-04-29 17:23:31,706] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 13: [2023-04-29 17:23:31,707] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 13: [2023-04-29 17:23:31,707] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 13: [2023-04-29 17:23:31,707] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 2: [2023-04-29 17:23:31,663] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_21_mp_rank_00_optim_states.pt... 28: [2023-04-29 17:23:31,707] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 13: [2023-04-29 17:23:31,707] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 13: [2023-04-29 17:23:31,708] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 13: [2023-04-29 17:23:31,708] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 13: [2023-04-29 17:23:31,708] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 29: [2023-04-29 17:23:31,708] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 29: [2023-04-29 17:23:31,708] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 10: [2023-04-29 17:23:31,708] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 10: [2023-04-29 17:23:31,708] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 10: [2023-04-29 17:23:31,708] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 10: [2023-04-29 17:23:31,708] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 29: [2023-04-29 17:23:31,709] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 29: [2023-04-29 17:23:31,709] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 28: [2023-04-29 17:23:31,710] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 29: [2023-04-29 17:23:31,710] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 29: [2023-04-29 17:23:31,710] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 10: [2023-04-29 17:23:31,714] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 10: [2023-04-29 17:23:31,715] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 10: [2023-04-29 17:23:31,715] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 10: [2023-04-29 17:23:31,715] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 25: [2023-04-29 17:23:31,715] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 25: [2023-04-29 17:23:31,715] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 25: [2023-04-29 17:23:31,718] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 25: [2023-04-29 17:23:31,718] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 25: [2023-04-29 17:23:31,718] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 25: [2023-04-29 17:23:31,718] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 25: [2023-04-29 17:23:31,718] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 25: [2023-04-29 17:23:31,719] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 25: [2023-04-29 17:23:31,720] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 25: [2023-04-29 17:23:31,720] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 25: [2023-04-29 17:23:31,726] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 25: [2023-04-29 17:23:31,727] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 25: [2023-04-29 17:23:31,728] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 25: [2023-04-29 17:23:31,729] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 25: [2023-04-29 17:23:31,729] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 25: [2023-04-29 17:23:31,730] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 13: [2023-04-29 17:23:31,730] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 13: [2023-04-29 17:23:31,730] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 13: [2023-04-29 17:23:31,731] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 13: [2023-04-29 17:23:31,731] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 13: [2023-04-29 17:23:31,731] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 13: [2023-04-29 17:23:31,731] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 13: [2023-04-29 17:23:31,731] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 13: [2023-04-29 17:23:31,731] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 13: [2023-04-29 17:23:31,734] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 10: [2023-04-29 17:23:31,734] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 13: [2023-04-29 17:23:31,735] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 13: [2023-04-29 17:23:31,735] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 13: [2023-04-29 17:23:31,735] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 10: [2023-04-29 17:23:31,735] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 10: [2023-04-29 17:23:31,736] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 10: [2023-04-29 17:23:31,736] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 13: [2023-04-29 17:23:31,739] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 13: [2023-04-29 17:23:31,740] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 13: [2023-04-29 17:23:31,740] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 13: [2023-04-29 17:23:31,740] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 13: [2023-04-29 17:23:31,741] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 13: [2023-04-29 17:23:31,741] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 13: [2023-04-29 17:23:31,741] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 13: [2023-04-29 17:23:31,741] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 13: [2023-04-29 17:23:31,741] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 13: [2023-04-29 17:23:31,741] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 13: [2023-04-29 17:23:31,741] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 13: [2023-04-29 17:23:31,741] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 10: [2023-04-29 17:23:31,741] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 10: [2023-04-29 17:23:31,743] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 10: [2023-04-29 17:23:31,744] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 10: [2023-04-29 17:23:31,745] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 10: [2023-04-29 17:23:31,747] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 10: [2023-04-29 17:23:31,747] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 10: [2023-04-29 17:23:31,747] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 10: [2023-04-29 17:23:31,747] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 10: [2023-04-29 17:23:31,747] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 10: [2023-04-29 17:23:31,747] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 10: [2023-04-29 17:23:31,747] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 10: [2023-04-29 17:23:31,747] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 10: [2023-04-29 17:23:31,747] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 10: [2023-04-29 17:23:31,747] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 10: [2023-04-29 17:23:31,747] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 10: [2023-04-29 17:23:31,747] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 10: [2023-04-29 17:23:31,747] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 10: [2023-04-29 17:23:31,747] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 10: [2023-04-29 17:23:31,747] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 10: [2023-04-29 17:23:31,747] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 10: [2023-04-29 17:23:31,748] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 29: [2023-04-29 17:23:31,751] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 29: [2023-04-29 17:23:31,755] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 9: [2023-04-29 17:23:31,759] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 9: [2023-04-29 17:23:31,759] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 9: [2023-04-29 17:23:31,759] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 9: [2023-04-29 17:23:31,759] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 9: [2023-04-29 17:23:31,759] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 9: [2023-04-29 17:23:31,759] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 9: [2023-04-29 17:23:31,759] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 9: [2023-04-29 17:23:31,760] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 9: [2023-04-29 17:23:31,763] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 9: [2023-04-29 17:23:31,764] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 9: [2023-04-29 17:23:31,765] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 9: [2023-04-29 17:23:31,765] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 9: [2023-04-29 17:23:31,765] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 9: [2023-04-29 17:23:31,765] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 9: [2023-04-29 17:23:31,765] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 9: [2023-04-29 17:23:31,765] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 12: [2023-04-29 17:23:31,766] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 12: [2023-04-29 17:23:31,766] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 12: [2023-04-29 17:23:31,766] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 12: [2023-04-29 17:23:31,766] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 12: [2023-04-29 17:23:31,766] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 12: [2023-04-29 17:23:31,766] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 12: [2023-04-29 17:23:31,766] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 12: [2023-04-29 17:23:31,767] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 12: [2023-04-29 17:23:31,770] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 12: [2023-04-29 17:23:31,771] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 29: [2023-04-29 17:23:31,772] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 25: [2023-04-29 17:23:31,771] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 25: [2023-04-29 17:23:31,771] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 29: [2023-04-29 17:23:31,775] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 29: [2023-04-29 17:23:31,775] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 29: [2023-04-29 17:23:31,775] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 29: [2023-04-29 17:23:31,775] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 29: [2023-04-29 17:23:31,776] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 29: [2023-04-29 17:23:31,776] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 29: [2023-04-29 17:23:31,776] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 12: [2023-04-29 17:23:31,776] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 12: [2023-04-29 17:23:31,778] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 12: [2023-04-29 17:23:31,778] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 29: [2023-04-29 17:23:31,778] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 29: [2023-04-29 17:23:31,778] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 12: [2023-04-29 17:23:31,778] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 12: [2023-04-29 17:23:31,778] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 12: [2023-04-29 17:23:31,779] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 5: [2023-04-29 17:23:31,780] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 5: [2023-04-29 17:23:31,780] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 29: [2023-04-29 17:23:31,781] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 29: [2023-04-29 17:23:31,781] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 29: [2023-04-29 17:23:31,782] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 29: [2023-04-29 17:23:31,782] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 5: [2023-04-29 17:23:31,782] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 5: [2023-04-29 17:23:31,782] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 5: [2023-04-29 17:23:31,782] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 5: [2023-04-29 17:23:31,782] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 5: [2023-04-29 17:23:31,782] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 5: [2023-04-29 17:23:31,783] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 5: [2023-04-29 17:23:31,785] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 5: [2023-04-29 17:23:31,785] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 25: [2023-04-29 17:23:31,787] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 25: [2023-04-29 17:23:31,787] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 23: [2023-04-29 17:23:31,789] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 23: [2023-04-29 17:23:31,789] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 23: [2023-04-29 17:23:31,789] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 23: [2023-04-29 17:23:31,789] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 23: [2023-04-29 17:23:31,790] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 5: [2023-04-29 17:23:31,790] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 23: [2023-04-29 17:23:31,790] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 23: [2023-04-29 17:23:31,790] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 23: [2023-04-29 17:23:31,790] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 10: [2023-04-29 17:23:31,748] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 10: [2023-04-29 17:23:31,748] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 10: [2023-04-29 17:23:31,748] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 10: [2023-04-29 17:23:31,748] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 10: [2023-04-29 17:23:31,748] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 10: [2023-04-29 17:23:31,748] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 10: [2023-04-29 17:23:31,748] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 5: [2023-04-29 17:23:31,791] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 5: [2023-04-29 17:23:31,792] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 25: [2023-04-29 17:23:31,792] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 5: [2023-04-29 17:23:31,792] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 5: [2023-04-29 17:23:31,793] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 25: [2023-04-29 17:23:31,793] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 5: [2023-04-29 17:23:31,794] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 23: [2023-04-29 17:23:31,794] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 25: [2023-04-29 17:23:31,795] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 25: [2023-04-29 17:23:31,795] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 25: [2023-04-29 17:23:31,796] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 25: [2023-04-29 17:23:31,796] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 23: [2023-04-29 17:23:31,796] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 25: [2023-04-29 17:23:31,796] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 25: [2023-04-29 17:23:31,796] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 23: [2023-04-29 17:23:31,797] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 23: [2023-04-29 17:23:31,799] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 23: [2023-04-29 17:23:31,799] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 23: [2023-04-29 17:23:31,800] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 23: [2023-04-29 17:23:31,801] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 23: [2023-04-29 17:23:31,802] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 13: [2023-04-29 17:23:31,805] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_106_mp_rank_00_optim_states.pt... 13: [2023-04-29 17:23:31,805] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_105_mp_rank_00_optim_states.pt... 13: [2023-04-29 17:23:31,805] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_109_mp_rank_00_optim_states.pt... 13: [2023-04-29 17:23:31,805] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_108_mp_rank_00_optim_states.pt... 13: [2023-04-29 17:23:31,805] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_107_mp_rank_00_optim_states.pt... 13: [2023-04-29 17:23:31,805] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_104_mp_rank_00_optim_states.pt... 13: [2023-04-29 17:23:31,805] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_110_mp_rank_00_optim_states.pt... 13: [2023-04-29 17:23:31,805] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_111_mp_rank_00_optim_states.pt... 25: [2023-04-29 17:23:31,806] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 25: [2023-04-29 17:23:31,806] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 25: [2023-04-29 17:23:31,806] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 25: [2023-04-29 17:23:31,807] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 29: [2023-04-29 17:23:31,808] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 29: [2023-04-29 17:23:31,809] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 29: [2023-04-29 17:23:31,809] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 29: [2023-04-29 17:23:31,809] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 29: [2023-04-29 17:23:31,810] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 29: [2023-04-29 17:23:31,811] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 29: [2023-04-29 17:23:31,811] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 29: [2023-04-29 17:23:31,811] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 29: [2023-04-29 17:23:31,811] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 29: [2023-04-29 17:23:31,812] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 29: [2023-04-29 17:23:31,812] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 25: [2023-04-29 17:23:31,812] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 29: [2023-04-29 17:23:31,812] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 29: [2023-04-29 17:23:31,813] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 25: [2023-04-29 17:23:31,813] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 25: [2023-04-29 17:23:31,813] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 25: [2023-04-29 17:23:31,813] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 25: [2023-04-29 17:23:31,813] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 29: [2023-04-29 17:23:31,813] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 29: [2023-04-29 17:23:31,813] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 25: [2023-04-29 17:23:31,814] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 25: [2023-04-29 17:23:31,814] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 25: [2023-04-29 17:23:31,814] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 29: [2023-04-29 17:23:31,814] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 12: [2023-04-29 17:23:31,814] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 29: [2023-04-29 17:23:31,815] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 29: [2023-04-29 17:23:31,815] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 29: [2023-04-29 17:23:31,816] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 29: [2023-04-29 17:23:31,816] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 29: [2023-04-29 17:23:31,816] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 29: [2023-04-29 17:23:31,816] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 29: [2023-04-29 17:23:31,816] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 21: [2023-04-29 17:23:31,817] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 21: [2023-04-29 17:23:31,817] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 21: [2023-04-29 17:23:31,817] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 29: [2023-04-29 17:23:31,817] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 21: [2023-04-29 17:23:31,817] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 21: [2023-04-29 17:23:31,817] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 21: [2023-04-29 17:23:31,817] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 21: [2023-04-29 17:23:31,817] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 21: [2023-04-29 17:23:31,817] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 21: [2023-04-29 17:23:31,822] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 21: [2023-04-29 17:23:31,822] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 21: [2023-04-29 17:23:31,822] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 21: [2023-04-29 17:23:31,823] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 21: [2023-04-29 17:23:31,824] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 9: [2023-04-29 17:23:31,824] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 21: [2023-04-29 17:23:31,824] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 21: [2023-04-29 17:23:31,824] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 9: [2023-04-29 17:23:31,824] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 21: [2023-04-29 17:23:31,825] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 9: [2023-04-29 17:23:31,825] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 9: [2023-04-29 17:23:31,825] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 9: [2023-04-29 17:23:31,826] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 9: [2023-04-29 17:23:31,826] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 9: [2023-04-29 17:23:31,827] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 9: [2023-04-29 17:23:31,829] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 12: [2023-04-29 17:23:31,830] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 12: [2023-04-29 17:23:31,836] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 10: [2023-04-29 17:23:31,837] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_81_mp_rank_00_optim_states.pt... 10: [2023-04-29 17:23:31,837] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_86_mp_rank_00_optim_states.pt... 10: [2023-04-29 17:23:31,837] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_85_mp_rank_00_optim_states.pt... 10: [2023-04-29 17:23:31,837] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_82_mp_rank_00_optim_states.pt... 10: [2023-04-29 17:23:31,837] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_80_mp_rank_00_optim_states.pt... 10: [2023-04-29 17:23:31,837] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_83_mp_rank_00_optim_states.pt... 10: [2023-04-29 17:23:31,837] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_84_mp_rank_00_optim_states.pt... 10: [2023-04-29 17:23:31,837] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_87_mp_rank_00_optim_states.pt... 5: [2023-04-29 17:23:31,836] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 5: [2023-04-29 17:23:31,836] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 25: [2023-04-29 17:23:31,837] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 25: [2023-04-29 17:23:31,838] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 25: [2023-04-29 17:23:31,838] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 25: [2023-04-29 17:23:31,838] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 25: [2023-04-29 17:23:31,838] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 25: [2023-04-29 17:23:31,838] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 25: [2023-04-29 17:23:31,838] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 25: [2023-04-29 17:23:31,839] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 25: [2023-04-29 17:23:31,839] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 25: [2023-04-29 17:23:31,839] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 25: [2023-04-29 17:23:31,839] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 25: [2023-04-29 17:23:31,839] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 25: [2023-04-29 17:23:31,839] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 25: [2023-04-29 17:23:31,839] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 25: [2023-04-29 17:23:31,839] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 25: [2023-04-29 17:23:31,839] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 12: [2023-04-29 17:23:31,842] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 12: [2023-04-29 17:23:31,843] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 12: [2023-04-29 17:23:31,843] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 12: [2023-04-29 17:23:31,845] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 12: [2023-04-29 17:23:31,846] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 23: [2023-04-29 17:23:31,848] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 12: [2023-04-29 17:23:31,851] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 12: [2023-04-29 17:23:31,851] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 12: [2023-04-29 17:23:31,851] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 23: [2023-04-29 17:23:31,851] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 9: [2023-04-29 17:23:31,851] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 9: [2023-04-29 17:23:31,851] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 12: [2023-04-29 17:23:31,851] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 9: [2023-04-29 17:23:31,853] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 9: [2023-04-29 17:23:31,853] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 9: [2023-04-29 17:23:31,853] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 9: [2023-04-29 17:23:31,854] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 12: [2023-04-29 17:23:31,854] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 9: [2023-04-29 17:23:31,854] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 9: [2023-04-29 17:23:31,854] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 5: [2023-04-29 17:23:31,855] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 5: [2023-04-29 17:23:31,856] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 5: [2023-04-29 17:23:31,856] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 12: [2023-04-29 17:23:31,856] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 12: [2023-04-29 17:23:31,856] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 5: [2023-04-29 17:23:31,857] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 12: [2023-04-29 17:23:31,857] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 5: [2023-04-29 17:23:31,857] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 23: [2023-04-29 17:23:31,858] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 5: [2023-04-29 17:23:31,860] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 5: [2023-04-29 17:23:31,860] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 5: [2023-04-29 17:23:31,860] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 5: [2023-04-29 17:23:31,860] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 5: [2023-04-29 17:23:31,860] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 5: [2023-04-29 17:23:31,860] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 9: [2023-04-29 17:23:31,861] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 9: [2023-04-29 17:23:31,861] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 9: [2023-04-29 17:23:31,861] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 9: [2023-04-29 17:23:31,861] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 9: [2023-04-29 17:23:31,861] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 9: [2023-04-29 17:23:31,861] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 9: [2023-04-29 17:23:31,861] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 9: [2023-04-29 17:23:31,861] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 9: [2023-04-29 17:23:31,861] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 9: [2023-04-29 17:23:31,861] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 9: [2023-04-29 17:23:31,861] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 9: [2023-04-29 17:23:31,861] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 9: [2023-04-29 17:23:31,861] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 27: [2023-04-29 17:23:31,862] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_222_mp_rank_00_optim_states.pt. 27: [2023-04-29 17:23:31,862] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 222 23: [2023-04-29 17:23:31,866] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 27: [2023-04-29 17:23:31,868] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 222 23: [2023-04-29 17:23:31,871] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 12: [2023-04-29 17:23:31,872] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 12: [2023-04-29 17:23:31,872] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 12: [2023-04-29 17:23:31,872] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 20: [2023-04-29 17:23:31,872] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_161_mp_rank_00_optim_states.pt. 20: [2023-04-29 17:23:31,872] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_166_mp_rank_00_optim_states.pt. 12: [2023-04-29 17:23:31,873] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 20: [2023-04-29 17:23:31,873] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 161 20: [2023-04-29 17:23:31,873] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 166 12: [2023-04-29 17:23:31,873] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 12: [2023-04-29 17:23:31,874] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 12: [2023-04-29 17:23:31,874] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 23: [2023-04-29 17:23:31,874] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 12: [2023-04-29 17:23:31,874] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 29: [2023-04-29 17:23:31,874] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_233_mp_rank_00_optim_states.pt... 29: [2023-04-29 17:23:31,874] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_234_mp_rank_00_optim_states.pt... 29: [2023-04-29 17:23:31,874] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_232_mp_rank_00_optim_states.pt... 29: [2023-04-29 17:23:31,874] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_239_mp_rank_00_optim_states.pt... 29: [2023-04-29 17:23:31,875] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_238_mp_rank_00_optim_states.pt... 29: [2023-04-29 17:23:31,875] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_235_mp_rank_00_optim_states.pt... 29: [2023-04-29 17:23:31,875] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_236_mp_rank_00_optim_states.pt... 29: [2023-04-29 17:23:31,875] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_237_mp_rank_00_optim_states.pt... 21: [2023-04-29 17:23:31,875] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 21: [2023-04-29 17:23:31,875] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 21: [2023-04-29 17:23:31,875] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 5: [2023-04-29 17:23:31,877] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 5: [2023-04-29 17:23:31,877] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 5: [2023-04-29 17:23:31,877] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 20: [2023-04-29 17:23:31,878] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 161 20: [2023-04-29 17:23:31,879] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 166 23: [2023-04-29 17:23:31,880] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 23: [2023-04-29 17:23:31,880] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 23: [2023-04-29 17:23:31,880] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 23: [2023-04-29 17:23:31,880] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 23: [2023-04-29 17:23:31,880] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 23: [2023-04-29 17:23:31,880] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 23: [2023-04-29 17:23:31,880] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 23: [2023-04-29 17:23:31,881] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 23: [2023-04-29 17:23:31,883] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 12: [2023-04-29 17:23:31,884] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 23: [2023-04-29 17:23:31,884] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 12: [2023-04-29 17:23:31,884] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 12: [2023-04-29 17:23:31,884] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 12: [2023-04-29 17:23:31,884] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 12: [2023-04-29 17:23:31,884] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 12: [2023-04-29 17:23:31,884] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 12: [2023-04-29 17:23:31,884] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 12: [2023-04-29 17:23:31,885] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 12: [2023-04-29 17:23:31,885] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 5: [2023-04-29 17:23:31,885] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 12: [2023-04-29 17:23:31,885] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 12: [2023-04-29 17:23:31,885] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 12: [2023-04-29 17:23:31,885] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 12: [2023-04-29 17:23:31,885] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 12: [2023-04-29 17:23:31,885] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 12: [2023-04-29 17:23:31,885] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 12: [2023-04-29 17:23:31,885] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 5: [2023-04-29 17:23:31,885] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 5: [2023-04-29 17:23:31,885] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 5: [2023-04-29 17:23:31,886] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 23: [2023-04-29 17:23:31,886] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 27: [2023-04-29 17:23:31,886] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_221_mp_rank_00_optim_states.pt. 27: [2023-04-29 17:23:31,886] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 221 23: [2023-04-29 17:23:31,886] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 23: [2023-04-29 17:23:31,887] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 5: [2023-04-29 17:23:31,887] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 23: [2023-04-29 17:23:31,887] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 5: [2023-04-29 17:23:31,887] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 5: [2023-04-29 17:23:31,887] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 5: [2023-04-29 17:23:31,887] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 5: [2023-04-29 17:23:31,887] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 5: [2023-04-29 17:23:31,888] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 5: [2023-04-29 17:23:31,888] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 5: [2023-04-29 17:23:31,888] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 31: [2023-04-29 17:23:31,890] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 31: [2023-04-29 17:23:31,890] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 31: [2023-04-29 17:23:31,890] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 25: [2023-04-29 17:23:31,890] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_204_mp_rank_00_optim_states.pt... 25: [2023-04-29 17:23:31,890] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_206_mp_rank_00_optim_states.pt... 25: [2023-04-29 17:23:31,890] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_207_mp_rank_00_optim_states.pt... 25: [2023-04-29 17:23:31,890] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_202_mp_rank_00_optim_states.pt... 25: [2023-04-29 17:23:31,890] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_200_mp_rank_00_optim_states.pt... 25: [2023-04-29 17:23:31,890] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_203_mp_rank_00_optim_states.pt... 25: [2023-04-29 17:23:31,890] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_201_mp_rank_00_optim_states.pt... 25: [2023-04-29 17:23:31,890] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_205_mp_rank_00_optim_states.pt... 31: [2023-04-29 17:23:31,890] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 31: [2023-04-29 17:23:31,890] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 21: [2023-04-29 17:23:31,890] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 21: [2023-04-29 17:23:31,890] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 21: [2023-04-29 17:23:31,890] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 21: [2023-04-29 17:23:31,890] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 31: [2023-04-29 17:23:31,891] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 31: [2023-04-29 17:23:31,891] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 21: [2023-04-29 17:23:31,891] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 31: [2023-04-29 17:23:31,891] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 27: [2023-04-29 17:23:31,892] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 221 31: [2023-04-29 17:23:31,894] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 31: [2023-04-29 17:23:31,895] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 31: [2023-04-29 17:23:31,895] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 23: [2023-04-29 17:23:31,896] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 31: [2023-04-29 17:23:31,896] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 23: [2023-04-29 17:23:31,897] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 23: [2023-04-29 17:23:31,897] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 23: [2023-04-29 17:23:31,897] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 31: [2023-04-29 17:23:31,897] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 31: [2023-04-29 17:23:31,897] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 31: [2023-04-29 17:23:31,897] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 31: [2023-04-29 17:23:31,898] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 21: [2023-04-29 17:23:31,899] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 27: [2023-04-29 17:23:31,899] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_217_mp_rank_00_optim_states.pt. 21: [2023-04-29 17:23:31,900] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 27: [2023-04-29 17:23:31,900] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 217 21: [2023-04-29 17:23:31,900] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 20: [2023-04-29 17:23:31,900] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_160_mp_rank_00_optim_states.pt. 20: [2023-04-29 17:23:31,900] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 160 6: [2023-04-29 17:23:31,901] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_49_mp_rank_00_optim_states.pt. 6: [2023-04-29 17:23:31,902] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 49 9: [2023-04-29 17:23:31,861] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 9: [2023-04-29 17:23:31,861] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 9: [2023-04-29 17:23:31,861] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 9: [2023-04-29 17:23:31,862] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 9: [2023-04-29 17:23:31,862] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 9: [2023-04-29 17:23:31,862] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 9: [2023-04-29 17:23:31,862] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 9: [2023-04-29 17:23:31,862] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 9: [2023-04-29 17:23:31,862] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 9: [2023-04-29 17:23:31,862] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 9: [2023-04-29 17:23:31,862] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 27: [2023-04-29 17:23:31,905] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 217 20: [2023-04-29 17:23:31,906] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 160 5: [2023-04-29 17:23:31,906] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 5: [2023-04-29 17:23:31,907] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 5: [2023-04-29 17:23:31,907] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 5: [2023-04-29 17:23:31,907] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 6: [2023-04-29 17:23:31,907] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_50_mp_rank_00_optim_states.pt. 27: [2023-04-29 17:23:31,907] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_220_mp_rank_00_optim_states.pt. 5: [2023-04-29 17:23:31,907] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 5: [2023-04-29 17:23:31,907] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 5: [2023-04-29 17:23:31,907] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 5: [2023-04-29 17:23:31,907] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 27: [2023-04-29 17:23:31,907] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 220 6: [2023-04-29 17:23:31,908] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 49 6: [2023-04-29 17:23:31,908] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 50 5: [2023-04-29 17:23:31,908] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 5: [2023-04-29 17:23:31,908] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 5: [2023-04-29 17:23:31,908] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 5: [2023-04-29 17:23:31,908] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 20: [2023-04-29 17:23:31,911] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_162_mp_rank_00_optim_states.pt. 21: [2023-04-29 17:23:31,910] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 21: [2023-04-29 17:23:31,910] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 20: [2023-04-29 17:23:31,911] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 162 21: [2023-04-29 17:23:31,911] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 21: [2023-04-29 17:23:31,911] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 21: [2023-04-29 17:23:31,911] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 21: [2023-04-29 17:23:31,911] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 21: [2023-04-29 17:23:31,911] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 23: [2023-04-29 17:23:31,911] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 21: [2023-04-29 17:23:31,912] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 21: [2023-04-29 17:23:31,912] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 23: [2023-04-29 17:23:31,912] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 6: [2023-04-29 17:23:31,912] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 50 23: [2023-04-29 17:23:31,912] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 23: [2023-04-29 17:23:31,912] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 23: [2023-04-29 17:23:31,912] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 23: [2023-04-29 17:23:31,912] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 23: [2023-04-29 17:23:31,912] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 23: [2023-04-29 17:23:31,912] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 23: [2023-04-29 17:23:31,913] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 27: [2023-04-29 17:23:31,913] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 220 23: [2023-04-29 17:23:31,913] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 23: [2023-04-29 17:23:31,913] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 23: [2023-04-29 17:23:31,913] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 20: [2023-04-29 17:23:31,916] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 162 23: [2023-04-29 17:23:31,916] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 23: [2023-04-29 17:23:31,916] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 23: [2023-04-29 17:23:31,916] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 23: [2023-04-29 17:23:31,917] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 21: [2023-04-29 17:23:31,918] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 21: [2023-04-29 17:23:31,919] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 21: [2023-04-29 17:23:31,919] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 21: [2023-04-29 17:23:31,920] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 7: [2023-04-29 17:23:31,920] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_59_mp_rank_00_optim_states.pt. 20: [2023-04-29 17:23:31,920] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_167_mp_rank_00_optim_states.pt. 21: [2023-04-29 17:23:31,920] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 20: [2023-04-29 17:23:31,920] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 167 7: [2023-04-29 17:23:31,920] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 59 21: [2023-04-29 17:23:31,920] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 21: [2023-04-29 17:23:31,921] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 21: [2023-04-29 17:23:31,921] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 21: [2023-04-29 17:23:31,921] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 21: [2023-04-29 17:23:31,921] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 21: [2023-04-29 17:23:31,921] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 21: [2023-04-29 17:23:31,922] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 21: [2023-04-29 17:23:31,922] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 21: [2023-04-29 17:23:31,922] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 21: [2023-04-29 17:23:31,923] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 21: [2023-04-29 17:23:31,923] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 21: [2023-04-29 17:23:31,923] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 21: [2023-04-29 17:23:31,923] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 21: [2023-04-29 17:23:31,923] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 21: [2023-04-29 17:23:31,923] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 20: [2023-04-29 17:23:31,925] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 167 7: [2023-04-29 17:23:31,925] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 59 20: [2023-04-29 17:23:31,926] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_165_mp_rank_00_optim_states.pt. 7: [2023-04-29 17:23:31,926] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_58_mp_rank_00_optim_states.pt. 20: [2023-04-29 17:23:31,926] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 165 7: [2023-04-29 17:23:31,927] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 58 27: [2023-04-29 17:23:31,927] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_219_mp_rank_00_optim_states.pt. 27: [2023-04-29 17:23:31,927] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 219 7: [2023-04-29 17:23:31,931] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 58 20: [2023-04-29 17:23:31,931] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 165 27: [2023-04-29 17:23:31,931] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 219 3: [2023-04-29 17:23:31,931] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 3: [2023-04-29 17:23:31,931] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 3: [2023-04-29 17:23:31,931] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 3: [2023-04-29 17:23:31,932] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 3: [2023-04-29 17:23:31,932] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 3: [2023-04-29 17:23:31,932] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 3: [2023-04-29 17:23:31,932] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 3: [2023-04-29 17:23:31,932] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 6: [2023-04-29 17:23:31,934] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_55_mp_rank_00_optim_states.pt. 6: [2023-04-29 17:23:31,935] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 55 3: [2023-04-29 17:23:31,936] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 3: [2023-04-29 17:23:31,936] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 12: [2023-04-29 17:23:31,938] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_96_mp_rank_00_optim_states.pt... 12: [2023-04-29 17:23:31,938] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_101_mp_rank_00_optim_states.pt... 12: [2023-04-29 17:23:31,938] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_98_mp_rank_00_optim_states.pt... 12: [2023-04-29 17:23:31,938] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_97_mp_rank_00_optim_states.pt... 12: [2023-04-29 17:23:31,938] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_100_mp_rank_00_optim_states.pt... 12: [2023-04-29 17:23:31,938] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_103_mp_rank_00_optim_states.pt... 12: [2023-04-29 17:23:31,938] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_102_mp_rank_00_optim_states.pt... 12: [2023-04-29 17:23:31,938] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_99_mp_rank_00_optim_states.pt... 6: [2023-04-29 17:23:31,940] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 55 3: [2023-04-29 17:23:31,941] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 3: [2023-04-29 17:23:31,941] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 31: [2023-04-29 17:23:31,941] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 3: [2023-04-29 17:23:31,942] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 6: [2023-04-29 17:23:31,942] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_53_mp_rank_00_optim_states.pt. 3: [2023-04-29 17:23:31,942] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 3: [2023-04-29 17:23:31,942] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 6: [2023-04-29 17:23:31,943] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 53 3: [2023-04-29 17:23:31,943] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 19: [2023-04-29 17:23:31,946] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 19: [2023-04-29 17:23:31,946] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 30: [2023-04-29 17:23:31,946] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 30: [2023-04-29 17:23:31,946] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 30: [2023-04-29 17:23:31,946] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 30: [2023-04-29 17:23:31,946] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 30: [2023-04-29 17:23:31,946] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 30: [2023-04-29 17:23:31,946] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 30: [2023-04-29 17:23:31,947] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 19: [2023-04-29 17:23:31,947] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 30: [2023-04-29 17:23:31,947] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 19: [2023-04-29 17:23:31,947] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 19: [2023-04-29 17:23:31,947] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 19: [2023-04-29 17:23:31,947] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 19: [2023-04-29 17:23:31,947] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 6: [2023-04-29 17:23:31,947] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 53 19: [2023-04-29 17:23:31,947] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 6: [2023-04-29 17:23:31,948] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_54_mp_rank_00_optim_states.pt. 6: [2023-04-29 17:23:31,948] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 54 16: [2023-04-29 17:23:31,949] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 16: [2023-04-29 17:23:31,949] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 16: [2023-04-29 17:23:31,949] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 16: [2023-04-29 17:23:31,949] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 16: [2023-04-29 17:23:31,949] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 16: [2023-04-29 17:23:31,949] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 16: [2023-04-29 17:23:31,949] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 16: [2023-04-29 17:23:31,950] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 19: [2023-04-29 17:23:31,950] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 19: [2023-04-29 17:23:31,951] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 31: [2023-04-29 17:23:31,951] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 11: [2023-04-29 17:23:31,951] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_93_mp_rank_00_optim_states.pt. 11: [2023-04-29 17:23:31,951] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 93 19: [2023-04-29 17:23:31,952] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 9: [2023-04-29 17:23:31,953] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_72_mp_rank_00_optim_states.pt... 9: [2023-04-29 17:23:31,953] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_77_mp_rank_00_optim_states.pt... 9: [2023-04-29 17:23:31,953] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_74_mp_rank_00_optim_states.pt... 9: [2023-04-29 17:23:31,953] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_79_mp_rank_00_optim_states.pt... 9: [2023-04-29 17:23:31,953] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_75_mp_rank_00_optim_states.pt... 9: [2023-04-29 17:23:31,953] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_73_mp_rank_00_optim_states.pt... 9: [2023-04-29 17:23:31,953] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_78_mp_rank_00_optim_states.pt... 9: [2023-04-29 17:23:31,953] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_76_mp_rank_00_optim_states.pt... 6: [2023-04-29 17:23:31,954] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 54 5: [2023-04-29 17:23:31,954] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_45_mp_rank_00_optim_states.pt... 5: [2023-04-29 17:23:31,954] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_47_mp_rank_00_optim_states.pt... 5: [2023-04-29 17:23:31,954] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_40_mp_rank_00_optim_states.pt... 5: [2023-04-29 17:23:31,954] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_43_mp_rank_00_optim_states.pt... 5: [2023-04-29 17:23:31,954] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_42_mp_rank_00_optim_states.pt... 5: [2023-04-29 17:23:31,954] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_44_mp_rank_00_optim_states.pt... 5: [2023-04-29 17:23:31,954] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_46_mp_rank_00_optim_states.pt... 5: [2023-04-29 17:23:31,954] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_41_mp_rank_00_optim_states.pt... 16: [2023-04-29 17:23:31,955] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 16: [2023-04-29 17:23:31,955] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 16: [2023-04-29 17:23:31,955] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 19: [2023-04-29 17:23:31,956] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 19: [2023-04-29 17:23:31,956] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 19: [2023-04-29 17:23:31,956] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 16: [2023-04-29 17:23:31,956] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 16: [2023-04-29 17:23:31,956] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 31: [2023-04-29 17:23:31,956] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 16: [2023-04-29 17:23:31,956] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 18: [2023-04-29 17:23:31,956] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 18: [2023-04-29 17:23:31,956] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 18: [2023-04-29 17:23:31,956] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 30: [2023-04-29 17:23:31,957] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 16: [2023-04-29 17:23:31,957] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 18: [2023-04-29 17:23:31,957] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 18: [2023-04-29 17:23:31,957] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 18: [2023-04-29 17:23:31,957] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 18: [2023-04-29 17:23:31,957] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 8: [2023-04-29 17:23:31,957] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 8: [2023-04-29 17:23:31,957] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 8: [2023-04-29 17:23:31,957] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 30: [2023-04-29 17:23:31,957] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 19: [2023-04-29 17:23:31,957] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 18: [2023-04-29 17:23:31,957] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 8: [2023-04-29 17:23:31,957] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 8: [2023-04-29 17:23:31,957] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 8: [2023-04-29 17:23:31,957] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 8: [2023-04-29 17:23:31,957] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 16: [2023-04-29 17:23:31,957] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 8: [2023-04-29 17:23:31,957] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 19: [2023-04-29 17:23:31,957] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 31: [2023-04-29 17:23:31,957] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 30: [2023-04-29 17:23:31,957] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 11: [2023-04-29 17:23:31,957] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 93 0: [2023-04-29 17:23:31,957] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 0: [2023-04-29 17:23:31,957] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 30: [2023-04-29 17:23:31,957] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 30: [2023-04-29 17:23:31,957] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 0: [2023-04-29 17:23:31,957] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 0: [2023-04-29 17:23:31,958] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 0: [2023-04-29 17:23:31,958] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 0: [2023-04-29 17:23:31,958] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 0: [2023-04-29 17:23:31,958] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 0: [2023-04-29 17:23:31,958] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 30: [2023-04-29 17:23:31,958] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 20: [2023-04-29 17:23:31,959] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_163_mp_rank_00_optim_states.pt. 30: [2023-04-29 17:23:31,959] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 20: [2023-04-29 17:23:31,960] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 163 30: [2023-04-29 17:23:31,960] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 31: [2023-04-29 17:23:31,962] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 8: [2023-04-29 17:23:31,962] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 11: [2023-04-29 17:23:31,963] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_94_mp_rank_00_optim_states.pt. 11: [2023-04-29 17:23:31,964] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 94 20: [2023-04-29 17:23:31,964] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 163 8: [2023-04-29 17:23:31,964] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 8: [2023-04-29 17:23:31,965] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 0: [2023-04-29 17:23:31,965] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 8: [2023-04-29 17:23:31,966] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 0: [2023-04-29 17:23:31,966] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 8: [2023-04-29 17:23:31,967] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 31: [2023-04-29 17:23:31,967] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 31: [2023-04-29 17:23:31,968] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 8: [2023-04-29 17:23:31,968] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 8: [2023-04-29 17:23:31,968] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 31: [2023-04-29 17:23:31,968] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 8: [2023-04-29 17:23:31,968] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 11: [2023-04-29 17:23:31,968] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 94 18: [2023-04-29 17:23:31,968] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 0: [2023-04-29 17:23:31,969] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 18: [2023-04-29 17:23:31,969] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 18: [2023-04-29 17:23:31,970] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 31: [2023-04-29 17:23:31,970] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 31: [2023-04-29 17:23:31,970] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 31: [2023-04-29 17:23:31,970] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 31: [2023-04-29 17:23:31,970] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 18: [2023-04-29 17:23:31,970] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 18: [2023-04-29 17:23:31,971] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 0: [2023-04-29 17:23:31,971] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 0: [2023-04-29 17:23:31,971] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 18: [2023-04-29 17:23:31,971] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 0: [2023-04-29 17:23:31,972] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 18: [2023-04-29 17:23:31,972] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 0: [2023-04-29 17:23:31,972] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 6: [2023-04-29 17:23:31,972] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_48_mp_rank_00_optim_states.pt. 18: [2023-04-29 17:23:31,973] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 6: [2023-04-29 17:23:31,973] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 48 27: [2023-04-29 17:23:31,973] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_223_mp_rank_00_optim_states.pt. 27: [2023-04-29 17:23:31,974] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 223 0: [2023-04-29 17:23:31,974] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 31: [2023-04-29 17:23:31,974] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 31: [2023-04-29 17:23:31,975] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 31: [2023-04-29 17:23:31,975] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 11: [2023-04-29 17:23:31,975] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_88_mp_rank_00_optim_states.pt. 31: [2023-04-29 17:23:31,975] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 11: [2023-04-29 17:23:31,976] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 88 6: [2023-04-29 17:23:31,979] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 48 23: [2023-04-29 17:23:31,979] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_188_mp_rank_00_optim_states.pt... 23: [2023-04-29 17:23:31,979] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_191_mp_rank_00_optim_states.pt... 27: [2023-04-29 17:23:31,979] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 223 23: [2023-04-29 17:23:31,979] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_185_mp_rank_00_optim_states.pt... 23: [2023-04-29 17:23:31,979] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_186_mp_rank_00_optim_states.pt... 23: [2023-04-29 17:23:31,979] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_190_mp_rank_00_optim_states.pt... 23: [2023-04-29 17:23:31,979] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_189_mp_rank_00_optim_states.pt... 31: [2023-04-29 17:23:31,979] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 23: [2023-04-29 17:23:31,980] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_184_mp_rank_00_optim_states.pt... 23: [2023-04-29 17:23:31,980] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_187_mp_rank_00_optim_states.pt... 31: [2023-04-29 17:23:31,980] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 31: [2023-04-29 17:23:31,980] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 31: [2023-04-29 17:23:31,981] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 27: [2023-04-29 17:23:31,982] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_216_mp_rank_00_optim_states.pt. 27: [2023-04-29 17:23:31,982] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 216 31: [2023-04-29 17:23:31,982] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 28: [2023-04-29 17:23:31,982] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 28: [2023-04-29 17:23:31,982] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 28: [2023-04-29 17:23:31,982] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 28: [2023-04-29 17:23:31,983] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 28: [2023-04-29 17:23:31,983] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 28: [2023-04-29 17:23:31,983] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 28: [2023-04-29 17:23:31,983] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 11: [2023-04-29 17:23:31,983] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 88 31: [2023-04-29 17:23:31,983] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 28: [2023-04-29 17:23:31,983] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 31: [2023-04-29 17:23:31,983] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 31: [2023-04-29 17:23:31,984] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 27: [2023-04-29 17:23:31,987] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 216 3: [2023-04-29 17:23:31,987] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 3: [2023-04-29 17:23:31,987] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 7: [2023-04-29 17:23:31,988] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_61_mp_rank_00_optim_states.pt. 7: [2023-04-29 17:23:31,988] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_62_mp_rank_00_optim_states.pt. 7: [2023-04-29 17:23:31,988] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 61 7: [2023-04-29 17:23:31,988] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 62 28: [2023-04-29 17:23:31,991] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 7: [2023-04-29 17:23:31,994] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 61 7: [2023-04-29 17:23:31,994] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 62 15: [2023-04-29 17:23:31,994] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 15: [2023-04-29 17:23:31,994] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 15: [2023-04-29 17:23:31,994] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 15: [2023-04-29 17:23:31,994] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 15: [2023-04-29 17:23:31,994] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 15: [2023-04-29 17:23:31,994] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 15: [2023-04-29 17:23:31,994] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 15: [2023-04-29 17:23:31,995] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 28: [2023-04-29 17:23:31,995] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 28: [2023-04-29 17:23:31,995] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 28: [2023-04-29 17:23:31,996] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 28: [2023-04-29 17:23:31,996] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 28: [2023-04-29 17:23:31,997] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 28: [2023-04-29 17:23:31,997] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 28: [2023-04-29 17:23:31,998] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 31: [2023-04-29 17:23:31,999] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 31: [2023-04-29 17:23:31,999] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 31: [2023-04-29 17:23:31,999] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 31: [2023-04-29 17:23:31,999] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 31: [2023-04-29 17:23:31,999] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 31: [2023-04-29 17:23:32,000] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 31: [2023-04-29 17:23:32,000] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 31: [2023-04-29 17:23:32,000] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 31: [2023-04-29 17:23:32,000] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 31: [2023-04-29 17:23:32,000] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 31: [2023-04-29 17:23:32,000] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 31: [2023-04-29 17:23:32,000] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 31: [2023-04-29 17:23:32,000] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 31: [2023-04-29 17:23:32,000] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 31: [2023-04-29 17:23:32,000] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 31: [2023-04-29 17:23:32,000] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 21: [2023-04-29 17:23:32,004] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_169_mp_rank_00_optim_states.pt... 21: [2023-04-29 17:23:32,004] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_170_mp_rank_00_optim_states.pt... 21: [2023-04-29 17:23:32,004] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_175_mp_rank_00_optim_states.pt... 21: [2023-04-29 17:23:32,004] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_172_mp_rank_00_optim_states.pt... 21: [2023-04-29 17:23:32,004] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_173_mp_rank_00_optim_states.pt... 21: [2023-04-29 17:23:32,004] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_168_mp_rank_00_optim_states.pt... 21: [2023-04-29 17:23:32,004] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_171_mp_rank_00_optim_states.pt... 21: [2023-04-29 17:23:32,004] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_174_mp_rank_00_optim_states.pt... 14: [2023-04-29 17:23:32,005] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_112_mp_rank_00_optim_states.pt. 14: [2023-04-29 17:23:32,005] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 112 19: [2023-04-29 17:23:32,006] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 19: [2023-04-29 17:23:32,006] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 19: [2023-04-29 17:23:32,006] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 3: [2023-04-29 17:23:32,007] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 15: [2023-04-29 17:23:32,008] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 15: [2023-04-29 17:23:32,008] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 15: [2023-04-29 17:23:32,008] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 4: [2023-04-29 17:23:32,008] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_34_mp_rank_00_optim_states.pt. 3: [2023-04-29 17:23:32,008] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 4: [2023-04-29 17:23:32,009] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 34 15: [2023-04-29 17:23:32,009] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 15: [2023-04-29 17:23:32,009] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 3: [2023-04-29 17:23:32,010] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 15: [2023-04-29 17:23:32,010] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 15: [2023-04-29 17:23:32,010] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 15: [2023-04-29 17:23:32,010] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 8: [2023-04-29 17:23:32,010] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 14: [2023-04-29 17:23:32,011] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 112 3: [2023-04-29 17:23:32,011] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 16: [2023-04-29 17:23:32,011] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 16: [2023-04-29 17:23:32,011] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 4: [2023-04-29 17:23:32,014] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 34 19: [2023-04-29 17:23:32,013] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 3: [2023-04-29 17:23:32,014] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 3: [2023-04-29 17:23:32,014] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 3: [2023-04-29 17:23:32,014] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 3: [2023-04-29 17:23:32,014] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 3: [2023-04-29 17:23:32,015] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 3: [2023-04-29 17:23:32,015] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 16: [2023-04-29 17:23:32,015] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 16: [2023-04-29 17:23:32,017] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 3: [2023-04-29 17:23:32,018] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 3: [2023-04-29 17:23:32,018] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 3: [2023-04-29 17:23:32,018] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 3: [2023-04-29 17:23:32,018] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 8: [2023-04-29 17:23:32,022] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 8: [2023-04-29 17:23:32,025] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 16: [2023-04-29 17:23:32,027] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 16: [2023-04-29 17:23:32,027] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 16: [2023-04-29 17:23:32,027] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 16: [2023-04-29 17:23:32,027] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 8: [2023-04-29 17:23:32,027] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 19: [2023-04-29 17:23:32,028] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 19: [2023-04-29 17:23:32,028] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 19: [2023-04-29 17:23:32,028] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 19: [2023-04-29 17:23:32,028] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 11: [2023-04-29 17:23:32,028] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_91_mp_rank_00_optim_states.pt. 11: [2023-04-29 17:23:32,029] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 91 19: [2023-04-29 17:23:32,030] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 19: [2023-04-29 17:23:32,030] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 30: [2023-04-29 17:23:32,031] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 19: [2023-04-29 17:23:32,032] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 8: [2023-04-29 17:23:32,032] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 8: [2023-04-29 17:23:32,033] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 8: [2023-04-29 17:23:32,033] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 0: [2023-04-29 17:23:32,033] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 11: [2023-04-29 17:23:32,034] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 91 8: [2023-04-29 17:23:32,036] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 8: [2023-04-29 17:23:32,036] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 3: [2023-04-29 17:23:32,037] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 3: [2023-04-29 17:23:32,037] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 3: [2023-04-29 17:23:32,037] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 3: [2023-04-29 17:23:32,038] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 19: [2023-04-29 17:23:32,038] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 30: [2023-04-29 17:23:32,038] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 16: [2023-04-29 17:23:32,038] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 16: [2023-04-29 17:23:32,040] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 3: [2023-04-29 17:23:32,041] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 3: [2023-04-29 17:23:32,041] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 3: [2023-04-29 17:23:32,041] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 3: [2023-04-29 17:23:32,042] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 16: [2023-04-29 17:23:32,044] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 8: [2023-04-29 17:23:32,044] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 24: [2023-04-29 17:23:32,044] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_192_mp_rank_00_optim_states.pt. 24: [2023-04-29 17:23:32,044] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 192 8: [2023-04-29 17:23:32,044] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 19: [2023-04-29 17:23:32,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 19: [2023-04-29 17:23:32,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 19: [2023-04-29 17:23:32,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 19: [2023-04-29 17:23:32,045] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 16: [2023-04-29 17:23:32,045] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 19: [2023-04-29 17:23:32,045] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 19: [2023-04-29 17:23:32,045] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 8: [2023-04-29 17:23:32,045] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 18: [2023-04-29 17:23:32,046] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 19: [2023-04-29 17:23:32,047] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 19: [2023-04-29 17:23:32,047] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 30: [2023-04-29 17:23:32,046] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 19: [2023-04-29 17:23:32,047] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 19: [2023-04-29 17:23:32,047] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 19: [2023-04-29 17:23:32,047] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 19: [2023-04-29 17:23:32,047] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 18: [2023-04-29 17:23:32,047] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 18: [2023-04-29 17:23:32,048] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 18: [2023-04-29 17:23:32,048] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 24: [2023-04-29 17:23:32,050] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 192 16: [2023-04-29 17:23:32,051] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 8: [2023-04-29 17:23:32,051] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 16: [2023-04-29 17:23:32,051] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 8: [2023-04-29 17:23:32,051] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 16: [2023-04-29 17:23:32,051] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 16: [2023-04-29 17:23:32,051] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 16: [2023-04-29 17:23:32,051] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 16: [2023-04-29 17:23:32,051] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 16: [2023-04-29 17:23:32,051] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 16: [2023-04-29 17:23:32,051] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 16: [2023-04-29 17:23:32,051] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 8: [2023-04-29 17:23:32,051] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 8: [2023-04-29 17:23:32,051] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 16: [2023-04-29 17:23:32,051] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 16: [2023-04-29 17:23:32,051] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 8: [2023-04-29 17:23:32,051] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 8: [2023-04-29 17:23:32,052] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 16: [2023-04-29 17:23:32,052] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 8: [2023-04-29 17:23:32,052] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 8: [2023-04-29 17:23:32,052] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 16: [2023-04-29 17:23:32,053] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 3: [2023-04-29 17:23:32,053] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 16: [2023-04-29 17:23:32,054] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 3: [2023-04-29 17:23:32,054] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 3: [2023-04-29 17:23:32,054] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 3: [2023-04-29 17:23:32,055] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 16: [2023-04-29 17:23:32,055] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 16: [2023-04-29 17:23:32,055] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 16: [2023-04-29 17:23:32,055] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 0: [2023-04-29 17:23:32,055] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 16: [2023-04-29 17:23:32,055] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 16: [2023-04-29 17:23:32,055] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 16: [2023-04-29 17:23:32,055] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 0: [2023-04-29 17:23:32,055] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 19: [2023-04-29 17:23:32,055] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 3: [2023-04-29 17:23:32,056] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 3: [2023-04-29 17:23:32,056] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 16: [2023-04-29 17:23:32,056] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 16: [2023-04-29 17:23:32,056] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 3: [2023-04-29 17:23:32,056] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 19: [2023-04-29 17:23:32,056] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 3: [2023-04-29 17:23:32,056] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 3: [2023-04-29 17:23:32,056] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 19: [2023-04-29 17:23:32,056] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 3: [2023-04-29 17:23:32,056] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 30: [2023-04-29 17:23:32,055] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 30: [2023-04-29 17:23:32,055] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 30: [2023-04-29 17:23:32,055] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 30: [2023-04-29 17:23:32,055] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 30: [2023-04-29 17:23:32,055] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 19: [2023-04-29 17:23:32,056] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 19: [2023-04-29 17:23:32,056] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 19: [2023-04-29 17:23:32,056] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 3: [2023-04-29 17:23:32,056] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 16: [2023-04-29 17:23:32,056] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 3: [2023-04-29 17:23:32,056] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 16: [2023-04-29 17:23:32,057] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 3: [2023-04-29 17:23:32,057] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 16: [2023-04-29 17:23:32,057] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 16: [2023-04-29 17:23:32,057] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 19: [2023-04-29 17:23:32,057] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 16: [2023-04-29 17:23:32,057] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 19: [2023-04-29 17:23:32,057] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 3: [2023-04-29 17:23:32,057] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 19: [2023-04-29 17:23:32,057] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 16: [2023-04-29 17:23:32,057] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 3: [2023-04-29 17:23:32,057] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 1: [2023-04-29 17:23:32,057] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_15_mp_rank_00_optim_states.pt. 19: [2023-04-29 17:23:32,057] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 19: [2023-04-29 17:23:32,057] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 3: [2023-04-29 17:23:32,057] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 19: [2023-04-29 17:23:32,057] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 19: [2023-04-29 17:23:32,057] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 1: [2023-04-29 17:23:32,058] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 15 19: [2023-04-29 17:23:32,058] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 19: [2023-04-29 17:23:32,058] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 19: [2023-04-29 17:23:32,058] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 28: [2023-04-29 17:23:32,059] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 17: [2023-04-29 17:23:32,059] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 17: [2023-04-29 17:23:32,059] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 8: [2023-04-29 17:23:32,060] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 2: [2023-04-29 17:23:32,060] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_20_mp_rank_00_optim_states.pt. 30: [2023-04-29 17:23:32,060] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 8: [2023-04-29 17:23:32,060] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 14: [2023-04-29 17:23:32,060] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_113_mp_rank_00_optim_states.pt. 8: [2023-04-29 17:23:32,060] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 2: [2023-04-29 17:23:32,060] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 20 14: [2023-04-29 17:23:32,060] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 113 8: [2023-04-29 17:23:32,060] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 0: [2023-04-29 17:23:32,061] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 0: [2023-04-29 17:23:32,061] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 1: [2023-04-29 17:23:32,063] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 15 17: [2023-04-29 17:23:32,063] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 17: [2023-04-29 17:23:32,064] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 17: [2023-04-29 17:23:32,064] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 17: [2023-04-29 17:23:32,064] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 17: [2023-04-29 17:23:32,064] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 17: [2023-04-29 17:23:32,064] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 17: [2023-04-29 17:23:32,064] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 2: [2023-04-29 17:23:32,064] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_17_mp_rank_00_optim_states.pt. 2: [2023-04-29 17:23:32,065] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 17 24: [2023-04-29 17:23:32,065] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_199_mp_rank_00_optim_states.pt. 2: [2023-04-29 17:23:32,065] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 20 24: [2023-04-29 17:23:32,066] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 199 14: [2023-04-29 17:23:32,066] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 113 8: [2023-04-29 17:23:32,066] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 8: [2023-04-29 17:23:32,066] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 14: [2023-04-29 17:23:32,066] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_114_mp_rank_00_optim_states.pt. 8: [2023-04-29 17:23:32,066] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 8: [2023-04-29 17:23:32,067] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 8: [2023-04-29 17:23:32,067] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 8: [2023-04-29 17:23:32,067] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 17: [2023-04-29 17:23:32,067] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 14: [2023-04-29 17:23:32,067] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 114 8: [2023-04-29 17:23:32,067] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 17: [2023-04-29 17:23:32,067] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 30: [2023-04-29 17:23:32,067] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 8: [2023-04-29 17:23:32,067] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 0: [2023-04-29 17:23:32,067] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 0: [2023-04-29 17:23:32,068] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 18: [2023-04-29 17:23:32,068] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 18: [2023-04-29 17:23:32,068] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 18: [2023-04-29 17:23:32,068] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 18: [2023-04-29 17:23:32,068] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 0: [2023-04-29 17:23:32,068] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 11: [2023-04-29 17:23:32,068] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_89_mp_rank_00_optim_states.pt. 8: [2023-04-29 17:23:32,069] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 11: [2023-04-29 17:23:32,069] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 89 8: [2023-04-29 17:23:32,069] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 8: [2023-04-29 17:23:32,069] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 8: [2023-04-29 17:23:32,070] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 14: [2023-04-29 17:23:32,070] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_116_mp_rank_00_optim_states.pt. 2: [2023-04-29 17:23:32,070] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 17 14: [2023-04-29 17:23:32,070] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 116 8: [2023-04-29 17:23:32,070] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 30: [2023-04-29 17:23:32,070] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 30: [2023-04-29 17:23:32,071] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 8: [2023-04-29 17:23:32,071] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 8: [2023-04-29 17:23:32,071] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 14: [2023-04-29 17:23:32,071] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 114 30: [2023-04-29 17:23:32,071] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 30: [2023-04-29 17:23:32,071] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 24: [2023-04-29 17:23:32,071] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 199 30: [2023-04-29 17:23:32,071] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 8: [2023-04-29 17:23:32,071] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 30: [2023-04-29 17:23:32,071] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 22: [2023-04-29 17:23:32,072] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_178_mp_rank_00_optim_states.pt. 22: [2023-04-29 17:23:32,072] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 178 0: [2023-04-29 17:23:32,073] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 0: [2023-04-29 17:23:32,073] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 0: [2023-04-29 17:23:32,073] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 0: [2023-04-29 17:23:32,073] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 17: [2023-04-29 17:23:32,073] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 26: [2023-04-29 17:23:32,074] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_212_mp_rank_00_optim_states.pt. 17: [2023-04-29 17:23:32,074] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 26: [2023-04-29 17:23:32,074] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 212 11: [2023-04-29 17:23:32,074] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 89 17: [2023-04-29 17:23:32,075] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 28: [2023-04-29 17:23:32,074] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 28: [2023-04-29 17:23:32,075] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 17: [2023-04-29 17:23:32,075] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 17: [2023-04-29 17:23:32,075] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt... 18: [2023-04-29 17:23:32,076] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 14: [2023-04-29 17:23:32,076] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 116 18: [2023-04-29 17:23:32,077] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 22: [2023-04-29 17:23:32,078] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 178 30: [2023-04-29 17:23:32,079] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 26: [2023-04-29 17:23:32,079] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 212 24: [2023-04-29 17:23:32,079] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_195_mp_rank_00_optim_states.pt. 24: [2023-04-29 17:23:32,079] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 195 30: [2023-04-29 17:23:32,080] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 30: [2023-04-29 17:23:32,081] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 18: [2023-04-29 17:23:32,081] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 30: [2023-04-29 17:23:32,081] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 18: [2023-04-29 17:23:32,081] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 24: [2023-04-29 17:23:32,081] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_193_mp_rank_00_optim_states.pt. 24: [2023-04-29 17:23:32,082] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 193 15: [2023-04-29 17:23:32,083] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 18: [2023-04-29 17:23:32,083] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 18: [2023-04-29 17:23:32,083] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 18: [2023-04-29 17:23:32,083] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 18: [2023-04-29 17:23:32,083] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 18: [2023-04-29 17:23:32,083] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 18: [2023-04-29 17:23:32,083] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 18: [2023-04-29 17:23:32,084] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 18: [2023-04-29 17:23:32,084] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 18: [2023-04-29 17:23:32,084] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 18: [2023-04-29 17:23:32,084] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 18: [2023-04-29 17:23:32,084] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 18: [2023-04-29 17:23:32,084] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 28: [2023-04-29 17:23:32,084] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 24: [2023-04-29 17:23:32,085] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 195 0: [2023-04-29 17:23:32,085] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 0: [2023-04-29 17:23:32,086] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 0: [2023-04-29 17:23:32,086] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 1: [2023-04-29 17:23:32,087] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_13_mp_rank_00_optim_states.pt. 1: [2023-04-29 17:23:32,087] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 13 24: [2023-04-29 17:23:32,087] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 193 31: [2023-04-29 17:23:32,088] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_252_mp_rank_00_optim_states.pt... 31: [2023-04-29 17:23:32,088] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_250_mp_rank_00_optim_states.pt... 31: [2023-04-29 17:23:32,088] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_248_mp_rank_00_optim_states.pt... 31: [2023-04-29 17:23:32,088] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_249_mp_rank_00_optim_states.pt... 31: [2023-04-29 17:23:32,089] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_251_mp_rank_00_optim_states.pt... 31: [2023-04-29 17:23:32,089] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_255_mp_rank_00_optim_states.pt... 31: [2023-04-29 17:23:32,089] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_254_mp_rank_00_optim_states.pt... 26: [2023-04-29 17:23:32,089] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_211_mp_rank_00_optim_states.pt. 26: [2023-04-29 17:23:32,089] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 211 1: [2023-04-29 17:23:32,089] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_11_mp_rank_00_optim_states.pt. 31: [2023-04-29 17:23:32,089] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_253_mp_rank_00_optim_states.pt... 28: [2023-04-29 17:23:32,089] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 28: [2023-04-29 17:23:32,090] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 1: [2023-04-29 17:23:32,090] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 11 28: [2023-04-29 17:23:32,090] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 15: [2023-04-29 17:23:32,090] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 15: [2023-04-29 17:23:32,090] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 28: [2023-04-29 17:23:32,090] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 28: [2023-04-29 17:23:32,090] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 28: [2023-04-29 17:23:32,090] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 28: [2023-04-29 17:23:32,090] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 28: [2023-04-29 17:23:32,090] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 15: [2023-04-29 17:23:32,090] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 15: [2023-04-29 17:23:32,090] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 0: [2023-04-29 17:23:32,091] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 1: [2023-04-29 17:23:32,092] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 13 30: [2023-04-29 17:23:32,093] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 30: [2023-04-29 17:23:32,093] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 30: [2023-04-29 17:23:32,093] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 26: [2023-04-29 17:23:32,093] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_214_mp_rank_00_optim_states.pt. 26: [2023-04-29 17:23:32,093] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_213_mp_rank_00_optim_states.pt. 30: [2023-04-29 17:23:32,093] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 30: [2023-04-29 17:23:32,093] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 30: [2023-04-29 17:23:32,094] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 30: [2023-04-29 17:23:32,094] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 26: [2023-04-29 17:23:32,094] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 214 26: [2023-04-29 17:23:32,094] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 213 30: [2023-04-29 17:23:32,094] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 26: [2023-04-29 17:23:32,094] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 211 30: [2023-04-29 17:23:32,094] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 11: [2023-04-29 17:23:32,094] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_92_mp_rank_00_optim_states.pt. 30: [2023-04-29 17:23:32,094] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 30: [2023-04-29 17:23:32,094] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 30: [2023-04-29 17:23:32,094] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 11: [2023-04-29 17:23:32,094] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 92 15: [2023-04-29 17:23:32,094] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 15: [2023-04-29 17:23:32,094] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 15: [2023-04-29 17:23:32,095] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 1: [2023-04-29 17:23:32,095] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 11 30: [2023-04-29 17:23:32,096] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 30: [2023-04-29 17:23:32,096] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 30: [2023-04-29 17:23:32,096] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 30: [2023-04-29 17:23:32,096] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 30: [2023-04-29 17:23:32,096] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 30: [2023-04-29 17:23:32,096] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 0: [2023-04-29 17:23:32,096] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 0: [2023-04-29 17:23:32,096] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 30: [2023-04-29 17:23:32,097] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 30: [2023-04-29 17:23:32,097] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 0: [2023-04-29 17:23:32,097] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 0: [2023-04-29 17:23:32,097] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 0: [2023-04-29 17:23:32,097] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 0: [2023-04-29 17:23:32,097] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 0: [2023-04-29 17:23:32,098] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 0: [2023-04-29 17:23:32,098] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 11: [2023-04-29 17:23:32,099] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 92 26: [2023-04-29 17:23:32,099] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 213 7: [2023-04-29 17:23:32,099] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_56_mp_rank_00_optim_states.pt. 26: [2023-04-29 17:23:32,099] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 214 7: [2023-04-29 17:23:32,100] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 56 24: [2023-04-29 17:23:32,100] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_194_mp_rank_00_optim_states.pt. 2: [2023-04-29 17:23:32,100] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_18_mp_rank_00_optim_states.pt. 24: [2023-04-29 17:23:32,100] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 194 7: [2023-04-29 17:23:32,100] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_63_mp_rank_00_optim_states.pt. 1: [2023-04-29 17:23:32,101] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_8_mp_rank_00_optim_states.pt. 2: [2023-04-29 17:23:32,101] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_16_mp_rank_00_optim_states.pt. 2: [2023-04-29 17:23:32,101] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 18 7: [2023-04-29 17:23:32,101] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 63 26: [2023-04-29 17:23:32,101] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_208_mp_rank_00_optim_states.pt. 1: [2023-04-29 17:23:32,101] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 8 26: [2023-04-29 17:23:32,101] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 208 18: [2023-04-29 17:23:32,101] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 2: [2023-04-29 17:23:32,102] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 16 18: [2023-04-29 17:23:32,102] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 18: [2023-04-29 17:23:32,102] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 18: [2023-04-29 17:23:32,102] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 18: [2023-04-29 17:23:32,103] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 18: [2023-04-29 17:23:32,103] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 18: [2023-04-29 17:23:32,103] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 11: [2023-04-29 17:23:32,103] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_95_mp_rank_00_optim_states.pt. 18: [2023-04-29 17:23:32,103] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 18: [2023-04-29 17:23:32,103] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 11: [2023-04-29 17:23:32,103] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 95 18: [2023-04-29 17:23:32,103] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 18: [2023-04-29 17:23:32,103] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 18: [2023-04-29 17:23:32,103] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 18: [2023-04-29 17:23:32,104] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 4: [2023-04-29 17:23:32,104] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_32_mp_rank_00_optim_states.pt. 18: [2023-04-29 17:23:32,104] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 18: [2023-04-29 17:23:32,104] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 18: [2023-04-29 17:23:32,104] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 4: [2023-04-29 17:23:32,104] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 32 4: [2023-04-29 17:23:32,105] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_36_mp_rank_00_optim_states.pt. 24: [2023-04-29 17:23:32,105] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 194 7: [2023-04-29 17:23:32,105] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 56 4: [2023-04-29 17:23:32,105] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_33_mp_rank_00_optim_states.pt. 4: [2023-04-29 17:23:32,105] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 36 26: [2023-04-29 17:23:32,106] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 208 4: [2023-04-29 17:23:32,106] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 33 1: [2023-04-29 17:23:32,106] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 8 7: [2023-04-29 17:23:32,106] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 63 2: [2023-04-29 17:23:32,107] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 18 2: [2023-04-29 17:23:32,107] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 16 14: [2023-04-29 17:23:32,108] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_117_mp_rank_00_optim_states.pt. 0: [2023-04-29 17:23:32,108] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 14: [2023-04-29 17:23:32,108] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 117 0: [2023-04-29 17:23:32,109] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 0: [2023-04-29 17:23:32,109] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 0: > overriding learning rate value to 0.0002 0: > overriding minimum learning rate value to 2e-05 0: [2023-04-29 17:23:32,109] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 0: > overriding warmup iterations value to 0 0: > overriding total number of iterations value to 1 0: > overriding decay style value to cosine 11: [2023-04-29 17:23:32,109] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 95 0: [2023-04-29 17:23:32,110] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 4: [2023-04-29 17:23:32,110] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 32 0: [2023-04-29 17:23:32,110] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 0: [2023-04-29 17:23:32,111] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 0: [2023-04-29 17:23:32,111] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 0: [2023-04-29 17:23:32,111] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 0: [2023-04-29 17:23:32,111] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 15: [2023-04-29 17:23:32,111] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 0: [2023-04-29 17:23:32,111] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 0: [2023-04-29 17:23:32,111] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 2: [2023-04-29 17:23:32,111] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_22_mp_rank_00_optim_states.pt. 17: [2023-04-29 17:23:32,111] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 4: [2023-04-29 17:23:32,112] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 36 2: [2023-04-29 17:23:32,112] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 22 4: [2023-04-29 17:23:32,112] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 33 0: [2023-04-29 17:23:32,113] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 0: [2023-04-29 17:23:32,113] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 0: [2023-04-29 17:23:32,113] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 0: [2023-04-29 17:23:32,114] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 14: [2023-04-29 17:23:32,114] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 117 14: [2023-04-29 17:23:32,114] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_118_mp_rank_00_optim_states.pt. 14: [2023-04-29 17:23:32,115] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 118 2: [2023-04-29 17:23:32,117] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 22 2: [2023-04-29 17:23:32,118] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_23_mp_rank_00_optim_states.pt. 2: [2023-04-29 17:23:32,118] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 23 14: [2023-04-29 17:23:32,119] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_119_mp_rank_00_optim_states.pt. 14: [2023-04-29 17:23:32,119] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 119 17: [2023-04-29 17:23:32,119] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 14: [2023-04-29 17:23:32,120] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 118 15: [2023-04-29 17:23:32,122] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 7: [2023-04-29 17:23:32,123] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_57_mp_rank_00_optim_states.pt. 2: [2023-04-29 17:23:32,124] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 23 7: [2023-04-29 17:23:32,124] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 57 14: [2023-04-29 17:23:32,125] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 119 4: [2023-04-29 17:23:32,127] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_37_mp_rank_00_optim_states.pt. 4: [2023-04-29 17:23:32,127] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 37 15: [2023-04-29 17:23:32,127] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 26: [2023-04-29 17:23:32,128] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_210_mp_rank_00_optim_states.pt. 26: [2023-04-29 17:23:32,128] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 210 22: [2023-04-29 17:23:32,128] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_179_mp_rank_00_optim_states.pt. 22: [2023-04-29 17:23:32,128] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_182_mp_rank_00_optim_states.pt. 22: [2023-04-29 17:23:32,129] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 179 22: [2023-04-29 17:23:32,129] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 182 7: [2023-04-29 17:23:32,129] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 57 26: [2023-04-29 17:23:32,129] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_215_mp_rank_00_optim_states.pt. 26: [2023-04-29 17:23:32,130] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 215 28: [2023-04-29 17:23:32,104] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 28: [2023-04-29 17:23:32,104] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 28: [2023-04-29 17:23:32,105] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 28: [2023-04-29 17:23:32,105] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 28: [2023-04-29 17:23:32,105] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 28: [2023-04-29 17:23:32,105] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 28: [2023-04-29 17:23:32,105] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 28: [2023-04-29 17:23:32,105] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 28: [2023-04-29 17:23:32,124] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 28: [2023-04-29 17:23:32,125] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 28: [2023-04-29 17:23:32,125] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 28: [2023-04-29 17:23:32,126] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 28: [2023-04-29 17:23:32,127] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 28: [2023-04-29 17:23:32,127] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 28: [2023-04-29 17:23:32,127] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 28: [2023-04-29 17:23:32,128] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 28: [2023-04-29 17:23:32,130] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 28: [2023-04-29 17:23:32,131] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 28: [2023-04-29 17:23:32,131] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 15: [2023-04-29 17:23:32,132] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 17: [2023-04-29 17:23:32,132] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 15: [2023-04-29 17:23:32,132] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 15: [2023-04-29 17:23:32,132] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 4: [2023-04-29 17:23:32,133] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 37 4: [2023-04-29 17:23:32,133] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_39_mp_rank_00_optim_states.pt. 22: [2023-04-29 17:23:32,133] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 182 4: [2023-04-29 17:23:32,133] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 39 22: [2023-04-29 17:23:32,134] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 179 26: [2023-04-29 17:23:32,134] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 210 15: [2023-04-29 17:23:32,135] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 26: [2023-04-29 17:23:32,136] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 215 15: [2023-04-29 17:23:32,137] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 4: [2023-04-29 17:23:32,138] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 39 10: [2023-04-29 17:23:32,138] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_83_mp_rank_00_optim_states.pt. 3: [2023-04-29 17:23:32,138] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_25_mp_rank_00_optim_states.pt... 3: [2023-04-29 17:23:32,138] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_31_mp_rank_00_optim_states.pt... 3: [2023-04-29 17:23:32,138] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_29_mp_rank_00_optim_states.pt... 3: [2023-04-29 17:23:32,138] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_28_mp_rank_00_optim_states.pt... 3: [2023-04-29 17:23:32,138] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_26_mp_rank_00_optim_states.pt... 3: [2023-04-29 17:23:32,138] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_27_mp_rank_00_optim_states.pt... 3: [2023-04-29 17:23:32,138] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_30_mp_rank_00_optim_states.pt... 3: [2023-04-29 17:23:32,138] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_24_mp_rank_00_optim_states.pt... 24: [2023-04-29 17:23:32,139] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_198_mp_rank_00_optim_states.pt. 24: [2023-04-29 17:23:32,139] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 198 17: [2023-04-29 17:23:32,141] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 16: [2023-04-29 17:23:32,143] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_128_mp_rank_00_optim_states.pt... 16: [2023-04-29 17:23:32,143] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_130_mp_rank_00_optim_states.pt... 16: [2023-04-29 17:23:32,143] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_134_mp_rank_00_optim_states.pt... 16: [2023-04-29 17:23:32,143] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_131_mp_rank_00_optim_states.pt... 16: [2023-04-29 17:23:32,143] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_133_mp_rank_00_optim_states.pt... 16: [2023-04-29 17:23:32,143] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_132_mp_rank_00_optim_states.pt... 15: [2023-04-29 17:23:32,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 15: [2023-04-29 17:23:32,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 15: [2023-04-29 17:23:32,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 16: [2023-04-29 17:23:32,143] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_135_mp_rank_00_optim_states.pt... 16: [2023-04-29 17:23:32,143] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_129_mp_rank_00_optim_states.pt... 15: [2023-04-29 17:23:32,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 15: [2023-04-29 17:23:32,143] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 15: [2023-04-29 17:23:32,143] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 15: [2023-04-29 17:23:32,143] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 15: [2023-04-29 17:23:32,143] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 17: [2023-04-29 17:23:32,143] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 15: [2023-04-29 17:23:32,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 15: [2023-04-29 17:23:32,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 15: [2023-04-29 17:23:32,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 15: [2023-04-29 17:23:32,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 15: [2023-04-29 17:23:32,143] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 15: [2023-04-29 17:23:32,143] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 15: [2023-04-29 17:23:32,143] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 15: [2023-04-29 17:23:32,143] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 15: [2023-04-29 17:23:32,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 15: [2023-04-29 17:23:32,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 15: [2023-04-29 17:23:32,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 15: [2023-04-29 17:23:32,143] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 15: [2023-04-29 17:23:32,144] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 15: [2023-04-29 17:23:32,144] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 15: [2023-04-29 17:23:32,144] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 17: [2023-04-29 17:23:32,144] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 17: [2023-04-29 17:23:32,144] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 15: [2023-04-29 17:23:32,144] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 17: [2023-04-29 17:23:32,144] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 17: [2023-04-29 17:23:32,144] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 22: [2023-04-29 17:23:32,144] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_183_mp_rank_00_optim_states.pt. 22: [2023-04-29 17:23:32,144] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_177_mp_rank_00_optim_states.pt. 17: [2023-04-29 17:23:32,144] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 22: [2023-04-29 17:23:32,144] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 183 17: [2023-04-29 17:23:32,144] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 22: [2023-04-29 17:23:32,145] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 177 17: [2023-04-29 17:23:32,145] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 24: [2023-04-29 17:23:32,145] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 198 19: [2023-04-29 17:23:32,146] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_153_mp_rank_00_optim_states.pt... 19: [2023-04-29 17:23:32,146] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_159_mp_rank_00_optim_states.pt... 19: [2023-04-29 17:23:32,146] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_155_mp_rank_00_optim_states.pt... 19: [2023-04-29 17:23:32,146] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_156_mp_rank_00_optim_states.pt... 19: [2023-04-29 17:23:32,146] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_152_mp_rank_00_optim_states.pt... 19: [2023-04-29 17:23:32,146] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_158_mp_rank_00_optim_states.pt... 19: [2023-04-29 17:23:32,146] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_157_mp_rank_00_optim_states.pt... 19: [2023-04-29 17:23:32,146] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_154_mp_rank_00_optim_states.pt... 17: [2023-04-29 17:23:32,147] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 17: [2023-04-29 17:23:32,147] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 17: [2023-04-29 17:23:32,147] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 1: [2023-04-29 17:23:32,148] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_14_mp_rank_00_optim_states.pt. 17: [2023-04-29 17:23:32,148] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_36-model_00-model_states.pt. 1: [2023-04-29 17:23:32,149] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 14 22: [2023-04-29 17:23:32,149] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 177 10: [2023-04-29 17:23:32,139] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 83 10: [2023-04-29 17:23:32,143] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 83 11: [2023-04-29 17:23:32,149] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_90_mp_rank_00_optim_states.pt. 11: [2023-04-29 17:23:32,150] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 90 22: [2023-04-29 17:23:32,150] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 183 4: [2023-04-29 17:23:32,150] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_38_mp_rank_00_optim_states.pt. 8: [2023-04-29 17:23:32,150] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_65_mp_rank_00_optim_states.pt... 8: [2023-04-29 17:23:32,150] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_68_mp_rank_00_optim_states.pt... 8: [2023-04-29 17:23:32,150] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_70_mp_rank_00_optim_states.pt... 8: [2023-04-29 17:23:32,151] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_69_mp_rank_00_optim_states.pt... 8: [2023-04-29 17:23:32,151] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_66_mp_rank_00_optim_states.pt... 8: [2023-04-29 17:23:32,151] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_71_mp_rank_00_optim_states.pt... 8: [2023-04-29 17:23:32,151] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_64_mp_rank_00_optim_states.pt... 8: [2023-04-29 17:23:32,151] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_67_mp_rank_00_optim_states.pt... 4: [2023-04-29 17:23:32,151] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 38 4: [2023-04-29 17:23:32,152] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_35_mp_rank_00_optim_states.pt. 4: [2023-04-29 17:23:32,152] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 35 22: [2023-04-29 17:23:32,153] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_180_mp_rank_00_optim_states.pt. 22: [2023-04-29 17:23:32,153] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 180 1: [2023-04-29 17:23:32,154] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 14 11: [2023-04-29 17:23:32,155] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 90 4: [2023-04-29 17:23:32,156] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 38 1: [2023-04-29 17:23:32,157] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_9_mp_rank_00_optim_states.pt. 1: [2023-04-29 17:23:32,158] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 9 4: [2023-04-29 17:23:32,158] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 35 22: [2023-04-29 17:23:32,159] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 180 1: [2023-04-29 17:23:32,163] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 9 13: [2023-04-29 17:23:32,166] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_104_mp_rank_00_optim_states.pt. 13: [2023-04-29 17:23:32,167] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 104 6: [2023-04-29 17:23:32,170] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_51_mp_rank_00_optim_states.pt. 6: [2023-04-29 17:23:32,171] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 51 17: [2023-04-29 17:23:32,171] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 17: [2023-04-29 17:23:32,172] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 17: [2023-04-29 17:23:32,172] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 17: [2023-04-29 17:23:32,172] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 13: [2023-04-29 17:23:32,172] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 104 28: [2023-04-29 17:23:32,131] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 28: [2023-04-29 17:23:32,133] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 28: [2023-04-29 17:23:32,133] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 28: [2023-04-29 17:23:32,134] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 28: [2023-04-29 17:23:32,134] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 28: [2023-04-29 17:23:32,134] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 28: [2023-04-29 17:23:32,134] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 28: [2023-04-29 17:23:32,134] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 28: [2023-04-29 17:23:32,134] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 30: [2023-04-29 17:23:32,175] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_242_mp_rank_00_optim_states.pt... 30: [2023-04-29 17:23:32,175] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_243_mp_rank_00_optim_states.pt... 30: [2023-04-29 17:23:32,175] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_246_mp_rank_00_optim_states.pt... 30: [2023-04-29 17:23:32,175] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_240_mp_rank_00_optim_states.pt... 30: [2023-04-29 17:23:32,175] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_241_mp_rank_00_optim_states.pt... 30: [2023-04-29 17:23:32,175] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_244_mp_rank_00_optim_states.pt... 30: [2023-04-29 17:23:32,175] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_247_mp_rank_00_optim_states.pt... 30: [2023-04-29 17:23:32,175] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_245_mp_rank_00_optim_states.pt... 6: [2023-04-29 17:23:32,176] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 51 17: [2023-04-29 17:23:32,176] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 17: [2023-04-29 17:23:32,177] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 17: [2023-04-29 17:23:32,177] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 17: [2023-04-29 17:23:32,177] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 17: [2023-04-29 17:23:32,179] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 17: [2023-04-29 17:23:32,179] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 17: [2023-04-29 17:23:32,179] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 17: [2023-04-29 17:23:32,180] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 17: [2023-04-29 17:23:32,180] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 17: [2023-04-29 17:23:32,180] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 17: [2023-04-29 17:23:32,180] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 17: [2023-04-29 17:23:32,181] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 0: [2023-04-29 17:23:32,182] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_5_mp_rank_00_optim_states.pt... 0: [2023-04-29 17:23:32,182] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_6_mp_rank_00_optim_states.pt... 0: [2023-04-29 17:23:32,182] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_4_mp_rank_00_optim_states.pt... 0: [2023-04-29 17:23:32,182] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_1_mp_rank_00_optim_states.pt... 0: [2023-04-29 17:23:32,182] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_3_mp_rank_00_optim_states.pt... 17: [2023-04-29 17:23:32,182] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 17: [2023-04-29 17:23:32,182] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 17: [2023-04-29 17:23:32,182] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 17: [2023-04-29 17:23:32,182] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 0: [2023-04-29 17:23:32,182] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_0_mp_rank_00_optim_states.pt... 0: [2023-04-29 17:23:32,182] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_2_mp_rank_00_optim_states.pt... 0: [2023-04-29 17:23:32,183] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_7_mp_rank_00_optim_states.pt... 17: [2023-04-29 17:23:32,183] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 17: [2023-04-29 17:23:32,183] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt... 17: [2023-04-29 17:23:32,183] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 17: [2023-04-29 17:23:32,183] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/layer_38-model_00-model_states.pt. 18: [2023-04-29 17:23:32,183] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_144_mp_rank_00_optim_states.pt... 18: [2023-04-29 17:23:32,183] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_145_mp_rank_00_optim_states.pt... 18: [2023-04-29 17:23:32,183] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_147_mp_rank_00_optim_states.pt... 18: [2023-04-29 17:23:32,183] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_150_mp_rank_00_optim_states.pt... 18: [2023-04-29 17:23:32,183] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_151_mp_rank_00_optim_states.pt... 18: [2023-04-29 17:23:32,183] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_149_mp_rank_00_optim_states.pt... 18: [2023-04-29 17:23:32,183] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_146_mp_rank_00_optim_states.pt... 18: [2023-04-29 17:23:32,183] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_148_mp_rank_00_optim_states.pt... 10: [2023-04-29 17:23:32,185] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_86_mp_rank_00_optim_states.pt. 2: [2023-04-29 17:23:32,187] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_19_mp_rank_00_optim_states.pt. 2: [2023-04-29 17:23:32,188] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 19 2: [2023-04-29 17:23:32,193] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 19 10: [2023-04-29 17:23:32,186] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 86 10: [2023-04-29 17:23:32,190] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 86 28: [2023-04-29 17:23:32,200] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_230_mp_rank_00_optim_states.pt... 28: [2023-04-29 17:23:32,201] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_224_mp_rank_00_optim_states.pt... 28: [2023-04-29 17:23:32,201] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_227_mp_rank_00_optim_states.pt... 28: [2023-04-29 17:23:32,201] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_228_mp_rank_00_optim_states.pt... 28: [2023-04-29 17:23:32,201] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_231_mp_rank_00_optim_states.pt... 28: [2023-04-29 17:23:32,201] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_229_mp_rank_00_optim_states.pt... 28: [2023-04-29 17:23:32,201] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_225_mp_rank_00_optim_states.pt... 28: [2023-04-29 17:23:32,201] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_226_mp_rank_00_optim_states.pt... 13: [2023-04-29 17:23:32,202] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_108_mp_rank_00_optim_states.pt. 24: [2023-04-29 17:23:32,203] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_196_mp_rank_00_optim_states.pt. 13: [2023-04-29 17:23:32,203] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 108 24: [2023-04-29 17:23:32,203] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 196 29: [2023-04-29 17:23:32,206] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_236_mp_rank_00_optim_states.pt. 29: [2023-04-29 17:23:32,206] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 236 22: [2023-04-29 17:23:32,206] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_176_mp_rank_00_optim_states.pt. 22: [2023-04-29 17:23:32,207] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 176 10: [2023-04-29 17:23:32,207] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_80_mp_rank_00_optim_states.pt. 13: [2023-04-29 17:23:32,208] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 108 10: [2023-04-29 17:23:32,208] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 80 24: [2023-04-29 17:23:32,209] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 196 10: [2023-04-29 17:23:32,213] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 80 29: [2023-04-29 17:23:32,212] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 236 22: [2023-04-29 17:23:32,213] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 176 13: [2023-04-29 17:23:32,220] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_105_mp_rank_00_optim_states.pt. 13: [2023-04-29 17:23:32,221] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 105 13: [2023-04-29 17:23:32,221] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_110_mp_rank_00_optim_states.pt. 13: [2023-04-29 17:23:32,222] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 110 13: [2023-04-29 17:23:32,225] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 105 13: [2023-04-29 17:23:32,227] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 110 15: [2023-04-29 17:23:32,232] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_123_mp_rank_00_optim_states.pt... 15: [2023-04-29 17:23:32,232] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_126_mp_rank_00_optim_states.pt... 13: [2023-04-29 17:23:32,232] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_107_mp_rank_00_optim_states.pt. 13: [2023-04-29 17:23:32,233] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 107 15: [2023-04-29 17:23:32,232] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_120_mp_rank_00_optim_states.pt... 15: [2023-04-29 17:23:32,232] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_122_mp_rank_00_optim_states.pt... 15: [2023-04-29 17:23:32,232] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_121_mp_rank_00_optim_states.pt... 15: [2023-04-29 17:23:32,232] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_125_mp_rank_00_optim_states.pt... 15: [2023-04-29 17:23:32,232] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_127_mp_rank_00_optim_states.pt... 15: [2023-04-29 17:23:32,232] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_124_mp_rank_00_optim_states.pt... 27: [2023-04-29 17:23:32,237] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_218_mp_rank_00_optim_states.pt. 27: [2023-04-29 17:23:32,238] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 218 13: [2023-04-29 17:23:32,238] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 107 24: [2023-04-29 17:23:32,240] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_197_mp_rank_00_optim_states.pt. 24: [2023-04-29 17:23:32,240] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 197 17: [2023-04-29 17:23:32,240] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_142_mp_rank_00_optim_states.pt... 17: [2023-04-29 17:23:32,241] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_143_mp_rank_00_optim_states.pt... 17: [2023-04-29 17:23:32,241] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_137_mp_rank_00_optim_states.pt... 17: [2023-04-29 17:23:32,241] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_140_mp_rank_00_optim_states.pt... 17: [2023-04-29 17:23:32,241] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_139_mp_rank_00_optim_states.pt... 17: [2023-04-29 17:23:32,241] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_136_mp_rank_00_optim_states.pt... 17: [2023-04-29 17:23:32,241] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_141_mp_rank_00_optim_states.pt... 17: [2023-04-29 17:23:32,241] [INFO] [torch_checkpoint_engine.py:21:load] [Torch] Loading checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_138_mp_rank_00_optim_states.pt... 27: [2023-04-29 17:23:32,243] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 218 25: [2023-04-29 17:23:32,246] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_206_mp_rank_00_optim_states.pt. 20: [2023-04-29 17:23:32,247] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_164_mp_rank_00_optim_states.pt. 13: [2023-04-29 17:23:32,247] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_106_mp_rank_00_optim_states.pt. 25: [2023-04-29 17:23:32,247] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 206 24: [2023-04-29 17:23:32,247] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 197 20: [2023-04-29 17:23:32,247] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 164 13: [2023-04-29 17:23:32,247] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 106 25: [2023-04-29 17:23:32,247] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_204_mp_rank_00_optim_states.pt. 25: [2023-04-29 17:23:32,248] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_201_mp_rank_00_optim_states.pt. 25: [2023-04-29 17:23:32,248] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 204 25: [2023-04-29 17:23:32,248] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 201 29: [2023-04-29 17:23:32,250] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_232_mp_rank_00_optim_states.pt. 29: [2023-04-29 17:23:32,250] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 232 7: [2023-04-29 17:23:32,251] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_60_mp_rank_00_optim_states.pt. 25: [2023-04-29 17:23:32,251] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 206 7: [2023-04-29 17:23:32,252] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 60 13: [2023-04-29 17:23:32,251] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_109_mp_rank_00_optim_states.pt. 20: [2023-04-29 17:23:32,252] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 164 13: [2023-04-29 17:23:32,252] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 109 13: [2023-04-29 17:23:32,252] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 106 29: [2023-04-29 17:23:32,256] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 232 25: [2023-04-29 17:23:32,254] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 201 25: [2023-04-29 17:23:32,254] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 204 7: [2023-04-29 17:23:32,257] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 60 13: [2023-04-29 17:23:32,258] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 109 29: [2023-04-29 17:23:32,267] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_239_mp_rank_00_optim_states.pt. 29: [2023-04-29 17:23:32,267] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 239 10: [2023-04-29 17:23:32,267] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_84_mp_rank_00_optim_states.pt. 10: [2023-04-29 17:23:32,267] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 84 10: [2023-04-29 17:23:32,268] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_87_mp_rank_00_optim_states.pt. 10: [2023-04-29 17:23:32,269] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 87 10: [2023-04-29 17:23:32,269] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_85_mp_rank_00_optim_states.pt. 10: [2023-04-29 17:23:32,269] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 85 6: [2023-04-29 17:23:32,271] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_52_mp_rank_00_optim_states.pt. 6: [2023-04-29 17:23:32,271] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 52 29: [2023-04-29 17:23:32,271] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 239 10: [2023-04-29 17:23:32,273] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 84 25: [2023-04-29 17:23:32,275] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_202_mp_rank_00_optim_states.pt. 25: [2023-04-29 17:23:32,276] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 202 10: [2023-04-29 17:23:32,276] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 87 10: [2023-04-29 17:23:32,276] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 85 6: [2023-04-29 17:23:32,277] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 52 10: [2023-04-29 17:23:32,278] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_81_mp_rank_00_optim_states.pt. 10: [2023-04-29 17:23:32,279] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 81 25: [2023-04-29 17:23:32,281] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 202 10: [2023-04-29 17:23:32,283] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 81 26: [2023-04-29 17:23:32,294] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_209_mp_rank_00_optim_states.pt. 29: [2023-04-29 17:23:32,294] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_235_mp_rank_00_optim_states.pt. 29: [2023-04-29 17:23:32,294] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_233_mp_rank_00_optim_states.pt. 26: [2023-04-29 17:23:32,294] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 209 29: [2023-04-29 17:23:32,294] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 235 29: [2023-04-29 17:23:32,294] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 233 2: [2023-04-29 17:23:32,296] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_21_mp_rank_00_optim_states.pt. 2: [2023-04-29 17:23:32,297] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 21 26: [2023-04-29 17:23:32,299] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 209 29: [2023-04-29 17:23:32,299] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 235 29: [2023-04-29 17:23:32,300] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 233 25: [2023-04-29 17:23:32,302] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_205_mp_rank_00_optim_states.pt. 25: [2023-04-29 17:23:32,302] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 205 2: [2023-04-29 17:23:32,304] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 21 10: [2023-04-29 17:23:32,304] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_82_mp_rank_00_optim_states.pt. 25: [2023-04-29 17:23:32,304] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_203_mp_rank_00_optim_states.pt. 10: [2023-04-29 17:23:32,304] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 82 25: [2023-04-29 17:23:32,305] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 203 23: [2023-04-29 17:23:32,307] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_191_mp_rank_00_optim_states.pt. 23: [2023-04-29 17:23:32,307] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 191 25: [2023-04-29 17:23:32,308] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 205 10: [2023-04-29 17:23:32,309] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 82 25: [2023-04-29 17:23:32,311] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 203 12: [2023-04-29 17:23:32,311] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_97_mp_rank_00_optim_states.pt. 12: [2023-04-29 17:23:32,311] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_100_mp_rank_00_optim_states.pt. 12: [2023-04-29 17:23:32,312] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 97 12: [2023-04-29 17:23:32,312] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 100 23: [2023-04-29 17:23:32,312] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 191 12: [2023-04-29 17:23:32,317] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 97 12: [2023-04-29 17:23:32,318] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 100 12: [2023-04-29 17:23:32,320] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_102_mp_rank_00_optim_states.pt. 12: [2023-04-29 17:23:32,321] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 102 12: [2023-04-29 17:23:32,325] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 102 9: [2023-04-29 17:23:32,326] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_75_mp_rank_00_optim_states.pt. 9: [2023-04-29 17:23:32,327] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 75 9: [2023-04-29 17:23:32,332] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 75 12: [2023-04-29 17:23:32,334] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_103_mp_rank_00_optim_states.pt. 12: [2023-04-29 17:23:32,334] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 103 25: [2023-04-29 17:23:32,335] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_200_mp_rank_00_optim_states.pt. 25: [2023-04-29 17:23:32,336] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 200 12: [2023-04-29 17:23:32,340] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 103 14: [2023-04-29 17:23:32,342] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_115_mp_rank_00_optim_states.pt. 25: [2023-04-29 17:23:32,342] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 200 14: [2023-04-29 17:23:32,342] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 115 29: [2023-04-29 17:23:32,344] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_234_mp_rank_00_optim_states.pt. 29: [2023-04-29 17:23:32,344] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 234 14: [2023-04-29 17:23:32,346] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 115 9: [2023-04-29 17:23:32,347] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_74_mp_rank_00_optim_states.pt. 9: [2023-04-29 17:23:32,348] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 74 29: [2023-04-29 17:23:32,352] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 234 9: [2023-04-29 17:23:32,353] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 74 12: [2023-04-29 17:23:32,354] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_99_mp_rank_00_optim_states.pt. 12: [2023-04-29 17:23:32,355] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 99 9: [2023-04-29 17:23:32,357] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_76_mp_rank_00_optim_states.pt. 9: [2023-04-29 17:23:32,357] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 76 12: [2023-04-29 17:23:32,360] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 99 23: [2023-04-29 17:23:32,361] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_185_mp_rank_00_optim_states.pt. 23: [2023-04-29 17:23:32,361] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 185 9: [2023-04-29 17:23:32,362] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 76 12: [2023-04-29 17:23:32,366] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_101_mp_rank_00_optim_states.pt. 12: [2023-04-29 17:23:32,366] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 101 23: [2023-04-29 17:23:32,366] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 185 29: [2023-04-29 17:23:32,368] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_237_mp_rank_00_optim_states.pt. 29: [2023-04-29 17:23:32,368] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 237 23: [2023-04-29 17:23:32,368] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_189_mp_rank_00_optim_states.pt. 23: [2023-04-29 17:23:32,368] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 189 9: [2023-04-29 17:23:32,370] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_78_mp_rank_00_optim_states.pt. 9: [2023-04-29 17:23:32,371] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 78 12: [2023-04-29 17:23:32,371] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 101 13: [2023-04-29 17:23:32,372] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_111_mp_rank_00_optim_states.pt. 13: [2023-04-29 17:23:32,372] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 111 1: [2023-04-29 17:23:32,372] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_10_mp_rank_00_optim_states.pt. 1: [2023-04-29 17:23:32,373] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 10 23: [2023-04-29 17:23:32,373] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 189 29: [2023-04-29 17:23:32,374] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 237 5: [2023-04-29 17:23:32,374] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_47_mp_rank_00_optim_states.pt. 5: [2023-04-29 17:23:32,375] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 47 9: [2023-04-29 17:23:32,376] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 78 13: [2023-04-29 17:23:32,378] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 111 1: [2023-04-29 17:23:32,378] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 10 9: [2023-04-29 17:23:32,380] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_73_mp_rank_00_optim_states.pt. 5: [2023-04-29 17:23:32,380] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 47 9: [2023-04-29 17:23:32,380] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 73 23: [2023-04-29 17:23:32,383] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_184_mp_rank_00_optim_states.pt. 23: [2023-04-29 17:23:32,383] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 184 9: [2023-04-29 17:23:32,385] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 73 12: [2023-04-29 17:23:32,386] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_98_mp_rank_00_optim_states.pt. 12: [2023-04-29 17:23:32,386] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 98 9: [2023-04-29 17:23:32,387] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_72_mp_rank_00_optim_states.pt. 9: [2023-04-29 17:23:32,388] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 72 23: [2023-04-29 17:23:32,389] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 184 23: [2023-04-29 17:23:32,391] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_187_mp_rank_00_optim_states.pt. 23: [2023-04-29 17:23:32,392] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 187 9: [2023-04-29 17:23:32,393] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 72 12: [2023-04-29 17:23:32,392] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 98 21: [2023-04-29 17:23:32,393] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_175_mp_rank_00_optim_states.pt. 21: [2023-04-29 17:23:32,394] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 175 23: [2023-04-29 17:23:32,397] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 187 5: [2023-04-29 17:23:32,404] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_40_mp_rank_00_optim_states.pt. 5: [2023-04-29 17:23:32,404] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_41_mp_rank_00_optim_states.pt. 5: [2023-04-29 17:23:32,404] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 41 5: [2023-04-29 17:23:32,404] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 40 21: [2023-04-29 17:23:32,398] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 175 21: [2023-04-29 17:23:32,399] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_171_mp_rank_00_optim_states.pt. 21: [2023-04-29 17:23:32,399] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 171 21: [2023-04-29 17:23:32,403] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_172_mp_rank_00_optim_states.pt. 21: [2023-04-29 17:23:32,404] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 172 21: [2023-04-29 17:23:32,404] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 171 29: [2023-04-29 17:23:32,405] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_238_mp_rank_00_optim_states.pt. 29: [2023-04-29 17:23:32,406] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 238 23: [2023-04-29 17:23:32,408] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_188_mp_rank_00_optim_states.pt. 23: [2023-04-29 17:23:32,408] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 188 5: [2023-04-29 17:23:32,409] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 40 21: [2023-04-29 17:23:32,409] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 172 9: [2023-04-29 17:23:32,409] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_77_mp_rank_00_optim_states.pt. 21: [2023-04-29 17:23:32,410] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_168_mp_rank_00_optim_states.pt. 9: [2023-04-29 17:23:32,410] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 77 5: [2023-04-29 17:23:32,410] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 41 21: [2023-04-29 17:23:32,410] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 168 29: [2023-04-29 17:23:32,411] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 238 23: [2023-04-29 17:23:32,413] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 188 21: [2023-04-29 17:23:32,415] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 168 9: [2023-04-29 17:23:32,416] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 77 23: [2023-04-29 17:23:32,418] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_186_mp_rank_00_optim_states.pt. 23: [2023-04-29 17:23:32,418] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 186 21: [2023-04-29 17:23:32,420] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_173_mp_rank_00_optim_states.pt. 21: [2023-04-29 17:23:32,420] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 173 23: [2023-04-29 17:23:32,424] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 186 21: [2023-04-29 17:23:32,425] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 173 25: [2023-04-29 17:23:32,439] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_207_mp_rank_00_optim_states.pt. 25: [2023-04-29 17:23:32,439] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 207 5: [2023-04-29 17:23:32,442] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_44_mp_rank_00_optim_states.pt. 5: [2023-04-29 17:23:32,442] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 44 5: [2023-04-29 17:23:32,443] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_45_mp_rank_00_optim_states.pt. 25: [2023-04-29 17:23:32,443] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 207 5: [2023-04-29 17:23:32,444] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 45 5: [2023-04-29 17:23:32,447] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_42_mp_rank_00_optim_states.pt. 5: [2023-04-29 17:23:32,447] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 42 5: [2023-04-29 17:23:32,449] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 45 5: [2023-04-29 17:23:32,450] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 44 5: [2023-04-29 17:23:32,450] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_43_mp_rank_00_optim_states.pt. 5: [2023-04-29 17:23:32,451] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 43 21: [2023-04-29 17:23:32,452] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_169_mp_rank_00_optim_states.pt. 21: [2023-04-29 17:23:32,453] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 169 5: [2023-04-29 17:23:32,453] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 42 5: [2023-04-29 17:23:32,457] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 43 21: [2023-04-29 17:23:32,458] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 169 31: [2023-04-29 17:23:32,461] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_249_mp_rank_00_optim_states.pt. 31: [2023-04-29 17:23:32,461] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 249 31: [2023-04-29 17:23:32,466] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 249 31: [2023-04-29 17:23:32,466] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_252_mp_rank_00_optim_states.pt. 31: [2023-04-29 17:23:32,466] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 252 31: [2023-04-29 17:23:32,470] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 252 9: [2023-04-29 17:23:32,485] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_79_mp_rank_00_optim_states.pt. 9: [2023-04-29 17:23:32,486] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 79 28: [2023-04-29 17:23:32,488] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_226_mp_rank_00_optim_states.pt. 28: [2023-04-29 17:23:32,488] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 226 9: [2023-04-29 17:23:32,491] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 79 21: [2023-04-29 17:23:32,491] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_170_mp_rank_00_optim_states.pt. 21: [2023-04-29 17:23:32,491] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 170 28: [2023-04-29 17:23:32,494] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 226 21: [2023-04-29 17:23:32,496] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 170 31: [2023-04-29 17:23:32,496] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_255_mp_rank_00_optim_states.pt. 31: [2023-04-29 17:23:32,497] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 255 31: [2023-04-29 17:23:32,501] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 255 12: [2023-04-29 17:23:32,503] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_96_mp_rank_00_optim_states.pt. 12: [2023-04-29 17:23:32,504] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 96 12: [2023-04-29 17:23:32,508] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 96 31: [2023-04-29 17:23:32,513] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_248_mp_rank_00_optim_states.pt. 31: [2023-04-29 17:23:32,514] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 248 31: [2023-04-29 17:23:32,515] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_251_mp_rank_00_optim_states.pt. 31: [2023-04-29 17:23:32,515] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 251 31: [2023-04-29 17:23:32,519] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 248 31: [2023-04-29 17:23:32,520] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 251 8: [2023-04-29 17:23:32,523] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_70_mp_rank_00_optim_states.pt. 8: [2023-04-29 17:23:32,524] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 70 8: [2023-04-29 17:23:32,529] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 70 19: [2023-04-29 17:23:32,530] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_159_mp_rank_00_optim_states.pt. 19: [2023-04-29 17:23:32,531] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 159 5: [2023-04-29 17:23:32,536] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_46_mp_rank_00_optim_states.pt. 19: [2023-04-29 17:23:32,536] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 159 3: [2023-04-29 17:23:32,528] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_30_mp_rank_00_optim_states.pt. 3: [2023-04-29 17:23:32,529] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 30 3: [2023-04-29 17:23:32,534] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 30 5: [2023-04-29 17:23:32,536] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 46 18: [2023-04-29 17:23:32,538] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_147_mp_rank_00_optim_states.pt. 19: [2023-04-29 17:23:32,538] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_154_mp_rank_00_optim_states.pt. 18: [2023-04-29 17:23:32,538] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 147 19: [2023-04-29 17:23:32,539] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 154 30: [2023-04-29 17:23:32,540] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_247_mp_rank_00_optim_states.pt. 30: [2023-04-29 17:23:32,540] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 247 31: [2023-04-29 17:23:32,542] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_250_mp_rank_00_optim_states.pt. 5: [2023-04-29 17:23:32,542] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 46 8: [2023-04-29 17:23:32,542] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_67_mp_rank_00_optim_states.pt. 31: [2023-04-29 17:23:32,542] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 250 8: [2023-04-29 17:23:32,543] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 67 19: [2023-04-29 17:23:32,544] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 154 18: [2023-04-29 17:23:32,544] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 147 30: [2023-04-29 17:23:32,545] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 247 18: [2023-04-29 17:23:32,546] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_149_mp_rank_00_optim_states.pt. 18: [2023-04-29 17:23:32,547] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 149 31: [2023-04-29 17:23:32,548] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 250 8: [2023-04-29 17:23:32,548] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 67 8: [2023-04-29 17:23:32,548] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_71_mp_rank_00_optim_states.pt. 8: [2023-04-29 17:23:32,549] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 71 21: [2023-04-29 17:23:32,541] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_174_mp_rank_00_optim_states.pt. 21: [2023-04-29 17:23:32,541] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 174 21: [2023-04-29 17:23:32,547] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 174 31: [2023-04-29 17:23:32,552] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_254_mp_rank_00_optim_states.pt. 18: [2023-04-29 17:23:32,552] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 149 31: [2023-04-29 17:23:32,552] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 254 8: [2023-04-29 17:23:32,554] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 71 16: [2023-04-29 17:23:32,555] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_132_mp_rank_00_optim_states.pt. 16: [2023-04-29 17:23:32,556] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 132 31: [2023-04-29 17:23:32,558] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 254 18: [2023-04-29 17:23:32,559] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_146_mp_rank_00_optim_states.pt. 18: [2023-04-29 17:23:32,559] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 146 0: [2023-04-29 17:23:32,560] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_2_mp_rank_00_optim_states.pt. 30: [2023-04-29 17:23:32,560] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_241_mp_rank_00_optim_states.pt. 30: [2023-04-29 17:23:32,560] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 241 0: [2023-04-29 17:23:32,560] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 2 16: [2023-04-29 17:23:32,560] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 132 30: [2023-04-29 17:23:32,561] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_245_mp_rank_00_optim_states.pt. 30: [2023-04-29 17:23:32,561] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_246_mp_rank_00_optim_states.pt. 30: [2023-04-29 17:23:32,561] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 245 30: [2023-04-29 17:23:32,561] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 246 0: [2023-04-29 17:23:32,564] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_4_mp_rank_00_optim_states.pt. 18: [2023-04-29 17:23:32,564] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 146 0: [2023-04-29 17:23:32,564] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 4 30: [2023-04-29 17:23:32,566] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 241 0: [2023-04-29 17:23:32,566] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 2 0: [2023-04-29 17:23:32,566] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_6_mp_rank_00_optim_states.pt. 0: [2023-04-29 17:23:32,567] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 6 30: [2023-04-29 17:23:32,567] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 245 30: [2023-04-29 17:23:32,568] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 246 28: [2023-04-29 17:23:32,570] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_230_mp_rank_00_optim_states.pt. 28: [2023-04-29 17:23:32,570] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 230 19: [2023-04-29 17:23:32,572] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_152_mp_rank_00_optim_states.pt. 19: [2023-04-29 17:23:32,572] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 152 0: [2023-04-29 17:23:32,573] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 4 0: [2023-04-29 17:23:32,573] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 6 16: [2023-04-29 17:23:32,574] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_134_mp_rank_00_optim_states.pt. 16: [2023-04-29 17:23:32,574] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 134 16: [2023-04-29 17:23:32,576] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_129_mp_rank_00_optim_states.pt. 28: [2023-04-29 17:23:32,576] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 230 16: [2023-04-29 17:23:32,577] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 129 19: [2023-04-29 17:23:32,578] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 152 0: [2023-04-29 17:23:32,579] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_7_mp_rank_00_optim_states.pt. 16: [2023-04-29 17:23:32,579] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 134 0: [2023-04-29 17:23:32,579] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 7 8: [2023-04-29 17:23:32,579] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_65_mp_rank_00_optim_states.pt. 0: [2023-04-29 17:23:32,580] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_1_mp_rank_00_optim_states.pt. 0: [2023-04-29 17:23:32,580] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 1 19: [2023-04-29 17:23:32,581] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_158_mp_rank_00_optim_states.pt. 19: [2023-04-29 17:23:32,581] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 158 16: [2023-04-29 17:23:32,581] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 129 8: [2023-04-29 17:23:32,580] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 65 18: [2023-04-29 17:23:32,582] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_151_mp_rank_00_optim_states.pt. 18: [2023-04-29 17:23:32,582] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 151 18: [2023-04-29 17:23:32,582] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_148_mp_rank_00_optim_states.pt. 18: [2023-04-29 17:23:32,583] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 148 3: [2023-04-29 17:23:32,583] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_31_mp_rank_00_optim_states.pt. 3: [2023-04-29 17:23:32,584] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 31 0: [2023-04-29 17:23:32,585] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 7 3: [2023-04-29 17:23:32,585] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_25_mp_rank_00_optim_states.pt. 8: [2023-04-29 17:23:32,585] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 65 3: [2023-04-29 17:23:32,586] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_28_mp_rank_00_optim_states.pt. 0: [2023-04-29 17:23:32,586] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 1 3: [2023-04-29 17:23:32,586] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 25 17: [2023-04-29 17:23:32,586] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_136_mp_rank_00_optim_states.pt. 19: [2023-04-29 17:23:32,586] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 158 3: [2023-04-29 17:23:32,586] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 28 17: [2023-04-29 17:23:32,586] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 136 18: [2023-04-29 17:23:32,588] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 151 3: [2023-04-29 17:23:32,589] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 31 18: [2023-04-29 17:23:32,589] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 148 16: [2023-04-29 17:23:32,589] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_130_mp_rank_00_optim_states.pt. 3: [2023-04-29 17:23:32,590] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_24_mp_rank_00_optim_states.pt. 16: [2023-04-29 17:23:32,590] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 130 16: [2023-04-29 17:23:32,590] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_133_mp_rank_00_optim_states.pt. 3: [2023-04-29 17:23:32,590] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 24 16: [2023-04-29 17:23:32,591] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 133 3: [2023-04-29 17:23:32,591] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 28 19: [2023-04-29 17:23:32,591] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_155_mp_rank_00_optim_states.pt. 19: [2023-04-29 17:23:32,592] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 155 3: [2023-04-29 17:23:32,592] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 25 17: [2023-04-29 17:23:32,592] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 136 28: [2023-04-29 17:23:32,593] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_231_mp_rank_00_optim_states.pt. 28: [2023-04-29 17:23:32,593] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 231 8: [2023-04-29 17:23:32,594] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_68_mp_rank_00_optim_states.pt. 8: [2023-04-29 17:23:32,594] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_66_mp_rank_00_optim_states.pt. 8: [2023-04-29 17:23:32,594] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 68 8: [2023-04-29 17:23:32,594] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 66 15: [2023-04-29 17:23:32,595] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_122_mp_rank_00_optim_states.pt. 16: [2023-04-29 17:23:32,595] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_131_mp_rank_00_optim_states.pt. 3: [2023-04-29 17:23:32,595] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_26_mp_rank_00_optim_states.pt. 15: [2023-04-29 17:23:32,595] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 122 8: [2023-04-29 17:23:32,595] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_69_mp_rank_00_optim_states.pt. 16: [2023-04-29 17:23:32,595] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 131 16: [2023-04-29 17:23:32,595] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 130 16: [2023-04-29 17:23:32,596] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 133 8: [2023-04-29 17:23:32,596] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 69 3: [2023-04-29 17:23:32,596] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 24 3: [2023-04-29 17:23:32,596] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 26 19: [2023-04-29 17:23:32,597] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 155 30: [2023-04-29 17:23:32,599] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_240_mp_rank_00_optim_states.pt. 30: [2023-04-29 17:23:32,599] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 240 8: [2023-04-29 17:23:32,600] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 68 15: [2023-04-29 17:23:32,600] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 122 8: [2023-04-29 17:23:32,600] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 66 16: [2023-04-29 17:23:32,600] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 131 28: [2023-04-29 17:23:32,601] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 231 3: [2023-04-29 17:23:32,601] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 26 8: [2023-04-29 17:23:32,601] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 69 8: [2023-04-29 17:23:32,602] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_64_mp_rank_00_optim_states.pt. 8: [2023-04-29 17:23:32,603] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 64 18: [2023-04-29 17:23:32,604] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_150_mp_rank_00_optim_states.pt. 18: [2023-04-29 17:23:32,605] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 150 30: [2023-04-29 17:23:32,605] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 240 16: [2023-04-29 17:23:32,606] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_135_mp_rank_00_optim_states.pt. 16: [2023-04-29 17:23:32,607] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 135 8: [2023-04-29 17:23:32,608] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 64 30: [2023-04-29 17:23:32,608] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_243_mp_rank_00_optim_states.pt. 30: [2023-04-29 17:23:32,608] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 243 30: [2023-04-29 17:23:32,610] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_242_mp_rank_00_optim_states.pt. 30: [2023-04-29 17:23:32,610] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 242 18: [2023-04-29 17:23:32,610] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 150 16: [2023-04-29 17:23:32,612] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 135 30: [2023-04-29 17:23:32,613] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 243 30: [2023-04-29 17:23:32,616] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 242 19: [2023-04-29 17:23:32,616] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_157_mp_rank_00_optim_states.pt. 19: [2023-04-29 17:23:32,616] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 157 19: [2023-04-29 17:23:32,621] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 157 15: [2023-04-29 17:23:32,626] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_123_mp_rank_00_optim_states.pt. 16: [2023-04-29 17:23:32,634] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_128_mp_rank_00_optim_states.pt. 16: [2023-04-29 17:23:32,634] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 128 15: [2023-04-29 17:23:32,627] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 123 15: [2023-04-29 17:23:32,634] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 123 0: [2023-04-29 17:23:32,639] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_0_mp_rank_00_optim_states.pt. 0: [2023-04-29 17:23:32,640] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 0 16: [2023-04-29 17:23:32,640] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 128 17: [2023-04-29 17:23:32,641] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_140_mp_rank_00_optim_states.pt. 3: [2023-04-29 17:23:32,641] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_29_mp_rank_00_optim_states.pt. 17: [2023-04-29 17:23:32,641] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 140 3: [2023-04-29 17:23:32,641] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 29 0: [2023-04-29 17:23:32,643] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_5_mp_rank_00_optim_states.pt. 0: [2023-04-29 17:23:32,644] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 5 15: [2023-04-29 17:23:32,645] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_124_mp_rank_00_optim_states.pt. 15: [2023-04-29 17:23:32,645] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 124 0: [2023-04-29 17:23:32,645] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 0 17: [2023-04-29 17:23:32,645] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_143_mp_rank_00_optim_states.pt. 17: [2023-04-29 17:23:32,646] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 143 17: [2023-04-29 17:23:32,647] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 140 3: [2023-04-29 17:23:32,648] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 29 0: could not find arguments in the checkpoint ... 0: checkpoint version 3.0 17: [2023-04-29 17:23:32,649] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_142_mp_rank_00_optim_states.pt. 17: [2023-04-29 17:23:32,649] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 142 0: [2023-04-29 17:23:32,650] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 5 15: [2023-04-29 17:23:32,650] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 124 17: [2023-04-29 17:23:32,650] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 143 15: [2023-04-29 17:23:32,653] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_127_mp_rank_00_optim_states.pt. 15: [2023-04-29 17:23:32,653] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 127 17: [2023-04-29 17:23:32,654] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 142 17: [2023-04-29 17:23:32,657] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_141_mp_rank_00_optim_states.pt. 17: [2023-04-29 17:23:32,657] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_139_mp_rank_00_optim_states.pt. 17: [2023-04-29 17:23:32,657] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 141 17: [2023-04-29 17:23:32,657] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 139 17: [2023-04-29 17:23:32,658] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_137_mp_rank_00_optim_states.pt. 15: [2023-04-29 17:23:32,658] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 127 17: [2023-04-29 17:23:32,658] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 137 19: [2023-04-29 17:23:32,659] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_156_mp_rank_00_optim_states.pt. 19: [2023-04-29 17:23:32,659] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 156 28: [2023-04-29 17:23:32,660] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_227_mp_rank_00_optim_states.pt. 28: [2023-04-29 17:23:32,660] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 227 17: [2023-04-29 17:23:32,663] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 139 17: [2023-04-29 17:23:32,663] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 141 18: [2023-04-29 17:23:32,664] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_144_mp_rank_00_optim_states.pt. 17: [2023-04-29 17:23:32,664] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 137 18: [2023-04-29 17:23:32,664] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 144 19: [2023-04-29 17:23:32,665] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 156 28: [2023-04-29 17:23:32,666] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 227 28: [2023-04-29 17:23:32,666] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_224_mp_rank_00_optim_states.pt. 28: [2023-04-29 17:23:32,666] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 224 18: [2023-04-29 17:23:32,670] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 144 28: [2023-04-29 17:23:32,672] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 224 28: [2023-04-29 17:23:32,672] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_228_mp_rank_00_optim_states.pt. 28: [2023-04-29 17:23:32,673] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 228 30: [2023-04-29 17:23:32,674] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_244_mp_rank_00_optim_states.pt. 30: [2023-04-29 17:23:32,675] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 244 28: [2023-04-29 17:23:32,678] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 228 30: [2023-04-29 17:23:32,680] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 244 15: [2023-04-29 17:23:32,691] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_125_mp_rank_00_optim_states.pt. 15: [2023-04-29 17:23:32,692] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 125 17: [2023-04-29 17:23:32,696] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_138_mp_rank_00_optim_states.pt. 17: [2023-04-29 17:23:32,696] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 138 15: [2023-04-29 17:23:32,697] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_126_mp_rank_00_optim_states.pt. 15: [2023-04-29 17:23:32,697] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 125 15: [2023-04-29 17:23:32,697] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 126 15: [2023-04-29 17:23:32,699] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_121_mp_rank_00_optim_states.pt. 15: [2023-04-29 17:23:32,699] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_120_mp_rank_00_optim_states.pt. 15: [2023-04-29 17:23:32,699] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 121 15: [2023-04-29 17:23:32,699] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 120 17: [2023-04-29 17:23:32,701] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 138 15: [2023-04-29 17:23:32,702] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 126 15: [2023-04-29 17:23:32,706] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 120 15: [2023-04-29 17:23:32,707] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 121 28: [2023-04-29 17:23:32,708] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_225_mp_rank_00_optim_states.pt. 28: [2023-04-29 17:23:32,708] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_229_mp_rank_00_optim_states.pt. 28: [2023-04-29 17:23:32,708] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 225 28: [2023-04-29 17:23:32,708] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 229 28: [2023-04-29 17:23:32,713] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 229 28: [2023-04-29 17:23:32,713] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 225 19: [2023-04-29 17:23:32,719] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_153_mp_rank_00_optim_states.pt. 19: [2023-04-29 17:23:32,720] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 153 19: [2023-04-29 17:23:32,725] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 153 22: [2023-04-29 17:23:32,743] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_181_mp_rank_00_optim_states.pt. 22: [2023-04-29 17:23:32,744] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 181 22: [2023-04-29 17:23:32,749] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 181 1: [2023-04-29 17:23:32,783] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_12_mp_rank_00_optim_states.pt. 1: [2023-04-29 17:23:32,784] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 12 1: [2023-04-29 17:23:32,788] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 12 3: [2023-04-29 17:23:32,823] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_27_mp_rank_00_optim_states.pt. 3: [2023-04-29 17:23:32,824] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 27 3: [2023-04-29 17:23:32,831] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 27 18: [2023-04-29 17:23:32,832] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_145_mp_rank_00_optim_states.pt. 18: [2023-04-29 17:23:32,833] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 145 18: [2023-04-29 17:23:32,839] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 145 0: [2023-04-29 17:23:32,930] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_3_mp_rank_00_optim_states.pt. 0: [2023-04-29 17:23:32,931] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 3 0: [2023-04-29 17:23:32,937] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 3 23: [2023-04-29 17:23:32,968] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_190_mp_rank_00_optim_states.pt. 23: [2023-04-29 17:23:32,969] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 190 31: [2023-04-29 17:23:32,974] [INFO] [torch_checkpoint_engine.py:23:load] [Torch] Loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4/global_step52452/bf16_zero_pp_rank_253_mp_rank_00_optim_states.pt. 31: [2023-04-29 17:23:32,974] [INFO] [engine.py:2844:_get_all_zero_checkpoint_state_dicts] successfully read 256 ZeRO state_dicts for rank 253 23: [2023-04-29 17:23:32,975] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 190 31: [2023-04-29 17:23:32,979] [INFO] [engine.py:2784:_load_zero_checkpoint] loading 256 zero partition checkpoints for rank 253 0: successfully loaded checkpoint from lm1-2b8-55b-c4-repetitions/2b855b18bc4 at iteration 0 31: time (ms) | load-checkpoint: 16411.08 0: estimated model parameters: 2.80902656 0: estimated model parameters without embeddings: 2.67500544 0: [after model, optimizer, and learning rate scheduler are built] datetime: 2023-04-29 17:23:34 0: > building train, validation, and test datasets ... 0: > datasets target sizes (minimum size): 0: train: 1 0: validation: 51200 0: test: 51200 0: > building train, validation, and test datasets for GPT ... 0: > building dataset index ... 0: reading sizes... 0: reading pointers... 0: reading document index... 0: creating numpy buffer of mmap... 0: creating memory view of numpy buffer... 0: > finished creating indexed dataset in 0.027222 seconds 0: number of documents: 3133972 0: > dataset split: 0: train: 0: document indices in [0, 3133972) total of 3133972 documents 0: > loading doc-idx mapping from /scratch/project_462000119/data/c4_subsampled/gpt2tok_c4_en_1B5_text_document_train_indexmap_1ns_2048sl_1234s_doc_idx.npy 0: > loading sample-idx mapping from /scratch/project_462000119/data/c4_subsampled/gpt2tok_c4_en_1B5_text_document_train_indexmap_1ns_2048sl_1234s_sample_idx.npy 0: > loading shuffle-idx mapping from /scratch/project_462000119/data/c4_subsampled/gpt2tok_c4_en_1B5_text_document_train_indexmap_1ns_2048sl_1234s_shuffle_idx.npy 0: loaded indexed file in 0.123 seconds 0: total number of samples: 731002 0: total number of epochs: 1 0: > building dataset index ... 0: reading sizes... 0: reading pointers... 0: reading document index... 0: creating numpy buffer of mmap... 0: creating memory view of numpy buffer... 0: > finished creating indexed dataset in 0.073250 seconds 0: number of documents: 364608 0: > dataset split: 0: validation: 0: document indices in [0, 364608) total of 364608 documents 0: > loading doc-idx mapping from /scratch/project_462000119/data/c4_validation/gpt2tok_c4validation_rerun_text_document_validation_indexmap_51200ns_2048sl_1234s_doc_idx.npy 0: > loading sample-idx mapping from /scratch/project_462000119/data/c4_validation/gpt2tok_c4validation_rerun_text_document_validation_indexmap_51200ns_2048sl_1234s_sample_idx.npy 0: > loading shuffle-idx mapping from /scratch/project_462000119/data/c4_validation/gpt2tok_c4validation_rerun_text_document_validation_indexmap_51200ns_2048sl_1234s_shuffle_idx.npy 0: loaded indexed file in 0.069 seconds 0: total number of samples: 84978 0: total number of epochs: 1 0: > finished creating GPT datasets ... 0: [after dataloaders are built] datetime: 2023-04-29 17:23:55 0: done with setup ... 0: training ... 31: time (ms) | model-and-optimizer-setup: 51982.04 | train/valid/test-data-iterators-setup: 20859.38 0: [after training is done] datetime: 2023-04-29 17:23:55 31: ----------------------------------------------------------------------------------------------------------------- 31: validation loss at the end of training for val data | lm loss value: 2.584592E+00 | lm loss PPL: 1.325787E+01 | 31: ----------------------------------------------------------------------------------------------------------------- END 3432081: Sat 29 Apr 2023 05:24:46 PM EEST