hf-test commited on
Commit
1e1fcfb
1 Parent(s): 707e9e2

Training in progress, step 17000

Browse files
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:eb6ffc6610e3337793bfcb479db1b8c872bf6ebe7f20c22aad7767ef92735811
3
  size 1262075377
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ec8c90280b3a257ebdb9c9d8d14265c5177be03de7f67d6e57461e80cc4d0bbd
3
  size 1262075377
runs/Jan27_12-08-15_brutasse/events.out.tfevents.1643285566.brutasse.15970.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c117043c65ff1c2ccf6d2f0e38add2c6c7b6a08e4ba90a642cde851a50b90d72
3
- size 41089
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c00e2f302773c59ba8f03e54979353d378b1756131755b2656be3f4779bbcaf7
3
+ size 42213
wandb/run-20220127_121247-o8za41vn/files/output.log CHANGED
@@ -12522,3 +12522,381 @@ Configuration saved in ./checkpoint-16000/preprocessor_config.json
12522
  Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12523
  Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12524
  Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
12522
  Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12523
  Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12524
  Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12525
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12526
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12527
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12528
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12529
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12530
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12531
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12532
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12533
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12534
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12535
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12536
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12537
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12538
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12539
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12540
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12541
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12542
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12543
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12544
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12545
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12546
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12547
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12548
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12549
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12550
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12551
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12552
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12553
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12554
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12555
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12556
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12557
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12558
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12559
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12560
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12561
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12562
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12563
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12564
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12565
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12566
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12567
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12568
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12569
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12570
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12571
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12572
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12573
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12574
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12575
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12576
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12577
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12578
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12579
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12580
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12581
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12582
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12583
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12584
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12585
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12586
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12587
+ {'loss': 1.0544, 'learning_rate': 7.656923076923076e-06, 'epoch': 45.48}
12588
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12589
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12590
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12591
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12592
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12593
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12594
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12595
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12596
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12597
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12598
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12599
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12600
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12601
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12602
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12603
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12604
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12605
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12606
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12607
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12608
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12609
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12610
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12611
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12612
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12613
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12614
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12615
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12616
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12617
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12618
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12619
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12620
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12621
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12622
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12623
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12624
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12625
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12626
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12627
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12628
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12629
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12630
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12631
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12632
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12633
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12634
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12635
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12636
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12637
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12638
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12639
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12640
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12641
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12642
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12643
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12644
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12645
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12646
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12647
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12648
+ {'loss': 1.0702, 'learning_rate': 7.195384615384615e-06, 'epoch': 45.75}
12649
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12650
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12651
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12652
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12653
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12654
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12655
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12656
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12657
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12658
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12659
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12660
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12661
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12662
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12663
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12664
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12665
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12666
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12667
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12668
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12669
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12670
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12671
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12672
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12673
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12674
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12675
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12676
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12677
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12678
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12679
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12680
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12681
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12682
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12683
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12684
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12685
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12686
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12687
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12688
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12689
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12690
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12691
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12692
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12693
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12694
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12695
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12696
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12697
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12698
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12699
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12700
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12701
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12702
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12703
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12704
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12705
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12706
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12707
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12708
+ {'loss': 1.035, 'learning_rate': 6.733846153846153e-06, 'epoch': 46.03}
12709
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12710
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12711
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12712
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12713
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12714
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12715
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12716
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12717
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12718
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12719
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12720
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12721
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12722
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12723
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12724
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12725
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12726
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12727
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12728
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12729
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12730
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12731
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12732
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12733
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12734
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12735
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12736
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12737
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12738
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12739
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12740
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12741
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12742
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12743
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12744
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12745
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12746
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12747
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12748
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12749
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12750
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12751
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12752
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12753
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12754
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12755
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12756
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12757
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12758
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12759
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12760
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12761
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12762
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12763
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12764
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12765
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12766
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12767
+ {'loss': 1.0465, 'learning_rate': 6.272307692307692e-06, 'epoch': 46.3}
12768
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12769
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12770
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12771
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12772
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12773
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12774
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12775
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12776
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12777
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12778
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12779
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12780
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12781
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12782
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12783
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12784
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12785
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12786
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12787
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12788
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12789
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12790
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12791
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12792
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12793
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12794
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12795
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12796
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12797
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12798
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12799
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12800
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12801
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12802
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12803
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12804
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12805
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12806
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12807
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12808
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12809
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12810
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12811
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12812
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12813
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12814
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12815
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12816
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12817
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12818
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12819
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12820
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12821
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12822
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12823
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12824
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12825
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12826
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12827
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12828
+ {'loss': 1.0546, 'learning_rate': 5.81076923076923e-06, 'epoch': 46.57}
12829
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12830
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12831
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12832
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12833
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12834
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12835
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12836
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12837
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12838
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12839
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12840
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12841
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12842
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12843
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12844
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12845
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12846
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12847
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12848
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12849
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12850
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12851
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12852
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12853
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12854
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12855
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12856
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12857
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12858
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12859
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12860
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12861
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12862
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12863
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12864
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12865
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12866
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12867
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12868
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12869
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12870
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12871
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12872
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12873
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12874
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12875
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12876
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12877
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12878
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12879
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12880
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12881
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12882
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12883
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12884
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12885
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12886
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12887
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12888
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12889
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12890
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12891
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12892
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12893
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12894
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12895
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12896
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12897
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12898
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12899
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12900
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12901
+ {'eval_loss': 0.31021571159362793, 'eval_wer': 0.267726369571388, 'eval_runtime': 145.9532, 'eval_samples_per_second': 33.182, 'eval_steps_per_second': 4.152, 'epoch': 46.57}
12902
+ Batch size = 8ved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
wandb/run-20220127_121247-o8za41vn/files/wandb-summary.json CHANGED
The diff for this file is too large to render. See raw diff
 
wandb/run-20220127_121247-o8za41vn/logs/debug-internal.log CHANGED
@@ -18860,3 +18860,536 @@
18860
  2022-01-27 19:41:39,847 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
18861
  2022-01-27 19:41:53,130 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18862
  2022-01-27 19:41:53,130 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
18860
  2022-01-27 19:41:39,847 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
18861
  2022-01-27 19:41:53,130 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18862
  2022-01-27 19:41:53,130 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18863
+ 2022-01-27 19:42:00,762 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18864
+ 2022-01-27 19:42:02,762 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18865
+ 2022-01-27 19:42:04,763 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18866
+ 2022-01-27 19:42:06,763 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18867
+ 2022-01-27 19:42:08,204 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18868
+ 2022-01-27 19:42:08,204 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18869
+ 2022-01-27 19:42:08,763 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18870
+ 2022-01-27 19:42:10,135 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
18871
+ 2022-01-27 19:42:10,764 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18872
+ 2022-01-27 19:42:12,764 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18873
+ 2022-01-27 19:42:14,764 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18874
+ 2022-01-27 19:42:16,765 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18875
+ 2022-01-27 19:42:18,765 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18876
+ 2022-01-27 19:42:20,765 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18877
+ 2022-01-27 19:42:22,766 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18878
+ 2022-01-27 19:42:23,316 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18879
+ 2022-01-27 19:42:23,316 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18880
+ 2022-01-27 19:42:24,766 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18881
+ 2022-01-27 19:42:26,767 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18882
+ 2022-01-27 19:42:28,767 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18883
+ 2022-01-27 19:42:30,767 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18884
+ 2022-01-27 19:42:32,768 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18885
+ 2022-01-27 19:42:34,768 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18886
+ 2022-01-27 19:42:36,768 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18887
+ 2022-01-27 19:42:38,445 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18888
+ 2022-01-27 19:42:38,445 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18889
+ 2022-01-27 19:42:38,769 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18890
+ 2022-01-27 19:42:40,378 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
18891
+ 2022-01-27 19:42:40,769 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18892
+ 2022-01-27 19:42:42,769 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18893
+ 2022-01-27 19:42:44,770 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18894
+ 2022-01-27 19:42:46,770 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18895
+ 2022-01-27 19:42:48,770 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18896
+ 2022-01-27 19:42:50,771 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18897
+ 2022-01-27 19:42:52,771 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18898
+ 2022-01-27 19:42:53,561 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18899
+ 2022-01-27 19:42:53,561 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18900
+ 2022-01-27 19:42:54,771 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18901
+ 2022-01-27 19:42:56,772 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18902
+ 2022-01-27 19:42:58,772 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18903
+ 2022-01-27 19:43:00,772 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18904
+ 2022-01-27 19:43:02,773 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18905
+ 2022-01-27 19:43:04,773 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18906
+ 2022-01-27 19:43:06,773 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18907
+ 2022-01-27 19:43:08,662 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18908
+ 2022-01-27 19:43:08,662 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18909
+ 2022-01-27 19:43:08,774 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18910
+ 2022-01-27 19:43:10,642 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
18911
+ 2022-01-27 19:43:10,774 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18912
+ 2022-01-27 19:43:12,774 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18913
+ 2022-01-27 19:43:14,775 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18914
+ 2022-01-27 19:43:16,775 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18915
+ 2022-01-27 19:43:18,775 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18916
+ 2022-01-27 19:43:20,776 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18917
+ 2022-01-27 19:43:22,776 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18918
+ 2022-01-27 19:43:23,810 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18919
+ 2022-01-27 19:43:23,810 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18920
+ 2022-01-27 19:43:24,776 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18921
+ 2022-01-27 19:43:26,777 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18922
+ 2022-01-27 19:43:28,777 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18923
+ 2022-01-27 19:43:30,777 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18924
+ 2022-01-27 19:43:32,778 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18925
+ 2022-01-27 19:43:34,778 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18926
+ 2022-01-27 19:43:36,778 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18927
+ 2022-01-27 19:43:38,779 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18928
+ 2022-01-27 19:43:38,950 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18929
+ 2022-01-27 19:43:38,951 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18930
+ 2022-01-27 19:43:40,779 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18931
+ 2022-01-27 19:43:40,900 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
18932
+ 2022-01-27 19:43:42,779 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18933
+ 2022-01-27 19:43:45,780 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18934
+ 2022-01-27 19:43:47,780 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18935
+ 2022-01-27 19:43:49,781 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18936
+ 2022-01-27 19:43:51,781 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18937
+ 2022-01-27 19:43:53,781 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18938
+ 2022-01-27 19:43:54,018 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18939
+ 2022-01-27 19:43:54,019 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18940
+ 2022-01-27 19:43:55,782 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18941
+ 2022-01-27 19:43:57,782 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18942
+ 2022-01-27 19:43:59,782 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18943
+ 2022-01-27 19:44:00,189 DEBUG SenderThread:16113 [sender.py:send():182] send: history
18944
+ 2022-01-27 19:44:00,233 DEBUG SenderThread:16113 [sender.py:send():182] send: summary
18945
+ 2022-01-27 19:44:00,257 INFO SenderThread:16113 [sender.py:_save_file():873] saving file wandb-summary.json with policy end
18946
+ 2022-01-27 19:44:00,783 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/wandb-summary.json
18947
+ 2022-01-27 19:44:01,783 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18948
+ 2022-01-27 19:44:03,783 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18949
+ 2022-01-27 19:44:05,783 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18950
+ 2022-01-27 19:44:07,784 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18951
+ 2022-01-27 19:44:09,123 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18952
+ 2022-01-27 19:44:09,123 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18953
+ 2022-01-27 19:44:09,784 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18954
+ 2022-01-27 19:44:11,153 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
18955
+ 2022-01-27 19:44:11,784 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18956
+ 2022-01-27 19:44:13,785 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18957
+ 2022-01-27 19:44:15,785 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18958
+ 2022-01-27 19:44:17,785 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18959
+ 2022-01-27 19:44:19,785 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18960
+ 2022-01-27 19:44:21,786 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18961
+ 2022-01-27 19:44:23,786 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18962
+ 2022-01-27 19:44:24,329 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18963
+ 2022-01-27 19:44:24,329 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18964
+ 2022-01-27 19:44:25,787 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18965
+ 2022-01-27 19:44:27,787 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18966
+ 2022-01-27 19:44:29,787 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18967
+ 2022-01-27 19:44:31,788 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18968
+ 2022-01-27 19:44:33,788 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18969
+ 2022-01-27 19:44:35,788 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18970
+ 2022-01-27 19:44:37,789 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18971
+ 2022-01-27 19:44:39,464 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18972
+ 2022-01-27 19:44:39,464 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18973
+ 2022-01-27 19:44:39,789 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18974
+ 2022-01-27 19:44:41,401 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
18975
+ 2022-01-27 19:44:41,789 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18976
+ 2022-01-27 19:44:43,790 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18977
+ 2022-01-27 19:44:45,790 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18978
+ 2022-01-27 19:44:47,791 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18979
+ 2022-01-27 19:44:49,791 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18980
+ 2022-01-27 19:44:51,791 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18981
+ 2022-01-27 19:44:53,792 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18982
+ 2022-01-27 19:44:54,605 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18983
+ 2022-01-27 19:44:54,605 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18984
+ 2022-01-27 19:44:55,792 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18985
+ 2022-01-27 19:44:57,792 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18986
+ 2022-01-27 19:44:59,793 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18987
+ 2022-01-27 19:45:01,793 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18988
+ 2022-01-27 19:45:03,793 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18989
+ 2022-01-27 19:45:05,794 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18990
+ 2022-01-27 19:45:07,794 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18991
+ 2022-01-27 19:45:09,737 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18992
+ 2022-01-27 19:45:09,737 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18993
+ 2022-01-27 19:45:09,794 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18994
+ 2022-01-27 19:45:11,639 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
18995
+ 2022-01-27 19:45:11,795 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18996
+ 2022-01-27 19:45:13,795 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18997
+ 2022-01-27 19:45:15,795 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18998
+ 2022-01-27 19:45:17,796 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18999
+ 2022-01-27 19:45:19,796 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19000
+ 2022-01-27 19:45:21,796 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19001
+ 2022-01-27 19:45:23,796 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19002
+ 2022-01-27 19:45:24,831 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
19003
+ 2022-01-27 19:45:24,831 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
19004
+ 2022-01-27 19:45:25,797 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19005
+ 2022-01-27 19:45:27,797 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19006
+ 2022-01-27 19:45:29,798 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19007
+ 2022-01-27 19:45:31,798 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19008
+ 2022-01-27 19:45:33,798 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19009
+ 2022-01-27 19:45:35,799 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19010
+ 2022-01-27 19:45:37,799 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19011
+ 2022-01-27 19:45:39,800 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19012
+ 2022-01-27 19:45:39,900 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
19013
+ 2022-01-27 19:45:39,900 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
19014
+ 2022-01-27 19:45:41,800 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19015
+ 2022-01-27 19:45:41,881 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
19016
+ 2022-01-27 19:45:43,800 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19017
+ 2022-01-27 19:45:45,801 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19018
+ 2022-01-27 19:45:47,801 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19019
+ 2022-01-27 19:45:49,801 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19020
+ 2022-01-27 19:45:51,802 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19021
+ 2022-01-27 19:45:53,802 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19022
+ 2022-01-27 19:45:55,123 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
19023
+ 2022-01-27 19:45:55,123 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
19024
+ 2022-01-27 19:45:55,802 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19025
+ 2022-01-27 19:45:57,803 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19026
+ 2022-01-27 19:45:59,803 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19027
+ 2022-01-27 19:46:00,756 DEBUG SenderThread:16113 [sender.py:send():182] send: history
19028
+ 2022-01-27 19:46:00,810 DEBUG SenderThread:16113 [sender.py:send():182] send: summary
19029
+ 2022-01-27 19:46:00,837 INFO SenderThread:16113 [sender.py:_save_file():873] saving file wandb-summary.json with policy end
19030
+ 2022-01-27 19:46:01,810 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/wandb-summary.json
19031
+ 2022-01-27 19:46:01,810 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19032
+ 2022-01-27 19:46:02,810 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19033
+ 2022-01-27 19:46:03,810 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19034
+ 2022-01-27 19:46:05,811 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19035
+ 2022-01-27 19:46:07,811 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19036
+ 2022-01-27 19:46:09,811 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19037
+ 2022-01-27 19:46:10,217 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
19038
+ 2022-01-27 19:46:10,217 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
19039
+ 2022-01-27 19:46:11,812 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19040
+ 2022-01-27 19:46:12,139 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
19041
+ 2022-01-27 19:46:13,812 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19042
+ 2022-01-27 19:46:15,812 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19043
+ 2022-01-27 19:46:17,813 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19044
+ 2022-01-27 19:46:19,813 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19045
+ 2022-01-27 19:46:21,813 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19046
+ 2022-01-27 19:46:23,814 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19047
+ 2022-01-27 19:46:25,295 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
19048
+ 2022-01-27 19:46:25,295 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
19049
+ 2022-01-27 19:46:25,814 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19050
+ 2022-01-27 19:46:27,814 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19051
+ 2022-01-27 19:46:29,815 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19052
+ 2022-01-27 19:46:31,815 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19053
+ 2022-01-27 19:46:34,816 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19054
+ 2022-01-27 19:46:36,816 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19055
+ 2022-01-27 19:46:38,816 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19056
+ 2022-01-27 19:46:40,365 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
19057
+ 2022-01-27 19:46:40,365 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
19058
+ 2022-01-27 19:46:40,816 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19059
+ 2022-01-27 19:46:42,390 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
19060
+ 2022-01-27 19:46:42,817 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19061
+ 2022-01-27 19:46:44,817 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19062
+ 2022-01-27 19:46:46,817 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19063
+ 2022-01-27 19:46:48,818 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19064
+ 2022-01-27 19:46:50,818 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19065
+ 2022-01-27 19:46:52,818 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19066
+ 2022-01-27 19:46:54,819 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19067
+ 2022-01-27 19:46:55,481 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
19068
+ 2022-01-27 19:46:55,481 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
19069
+ 2022-01-27 19:46:56,819 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19070
+ 2022-01-27 19:46:58,819 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19071
+ 2022-01-27 19:47:00,819 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19072
+ 2022-01-27 19:47:02,820 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19073
+ 2022-01-27 19:47:04,820 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19074
+ 2022-01-27 19:47:06,820 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19075
+ 2022-01-27 19:47:08,821 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19076
+ 2022-01-27 19:47:10,557 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
19077
+ 2022-01-27 19:47:10,557 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
19078
+ 2022-01-27 19:47:10,821 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19079
+ 2022-01-27 19:47:12,630 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
19080
+ 2022-01-27 19:47:12,821 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19081
+ 2022-01-27 19:47:14,822 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19082
+ 2022-01-27 19:47:16,822 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19083
+ 2022-01-27 19:47:18,822 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19084
+ 2022-01-27 19:47:20,823 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19085
+ 2022-01-27 19:47:22,823 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19086
+ 2022-01-27 19:47:24,823 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19087
+ 2022-01-27 19:47:25,667 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
19088
+ 2022-01-27 19:47:25,667 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
19089
+ 2022-01-27 19:47:26,824 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19090
+ 2022-01-27 19:47:28,824 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19091
+ 2022-01-27 19:47:30,824 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19092
+ 2022-01-27 19:47:32,824 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19093
+ 2022-01-27 19:47:34,825 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19094
+ 2022-01-27 19:47:36,825 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19095
+ 2022-01-27 19:47:38,826 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19096
+ 2022-01-27 19:47:40,763 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
19097
+ 2022-01-27 19:47:40,763 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
19098
+ 2022-01-27 19:47:40,826 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19099
+ 2022-01-27 19:47:42,826 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19100
+ 2022-01-27 19:47:42,878 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
19101
+ 2022-01-27 19:47:44,826 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19102
+ 2022-01-27 19:47:46,827 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19103
+ 2022-01-27 19:47:48,827 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19104
+ 2022-01-27 19:47:50,827 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19105
+ 2022-01-27 19:47:52,828 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19106
+ 2022-01-27 19:47:54,828 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19107
+ 2022-01-27 19:47:55,908 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
19108
+ 2022-01-27 19:47:55,908 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
19109
+ 2022-01-27 19:47:56,828 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19110
+ 2022-01-27 19:47:58,829 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19111
+ 2022-01-27 19:48:00,829 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19112
+ 2022-01-27 19:48:00,862 DEBUG SenderThread:16113 [sender.py:send():182] send: history
19113
+ 2022-01-27 19:48:00,912 DEBUG SenderThread:16113 [sender.py:send():182] send: summary
19114
+ 2022-01-27 19:48:00,936 INFO SenderThread:16113 [sender.py:_save_file():873] saving file wandb-summary.json with policy end
19115
+ 2022-01-27 19:48:01,829 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/wandb-summary.json
19116
+ 2022-01-27 19:48:02,829 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19117
+ 2022-01-27 19:48:04,830 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19118
+ 2022-01-27 19:48:06,830 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19119
+ 2022-01-27 19:48:08,830 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19120
+ 2022-01-27 19:48:10,831 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19121
+ 2022-01-27 19:48:11,024 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
19122
+ 2022-01-27 19:48:11,024 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
19123
+ 2022-01-27 19:48:12,831 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19124
+ 2022-01-27 19:48:13,124 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
19125
+ 2022-01-27 19:48:14,831 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19126
+ 2022-01-27 19:48:16,832 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19127
+ 2022-01-27 19:48:18,832 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19128
+ 2022-01-27 19:48:20,832 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19129
+ 2022-01-27 19:48:22,833 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19130
+ 2022-01-27 19:48:24,833 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19131
+ 2022-01-27 19:48:26,106 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
19132
+ 2022-01-27 19:48:26,107 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
19133
+ 2022-01-27 19:48:26,833 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19134
+ 2022-01-27 19:48:28,834 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19135
+ 2022-01-27 19:48:30,834 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19136
+ 2022-01-27 19:48:32,834 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19137
+ 2022-01-27 19:48:34,835 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19138
+ 2022-01-27 19:48:36,835 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19139
+ 2022-01-27 19:48:38,835 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19140
+ 2022-01-27 19:48:40,836 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19141
+ 2022-01-27 19:48:41,189 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
19142
+ 2022-01-27 19:48:41,189 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
19143
+ 2022-01-27 19:48:42,836 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19144
+ 2022-01-27 19:48:43,368 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
19145
+ 2022-01-27 19:48:45,836 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19146
+ 2022-01-27 19:48:49,837 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19147
+ 2022-01-27 19:48:51,837 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19148
+ 2022-01-27 19:48:53,838 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19149
+ 2022-01-27 19:48:55,838 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19150
+ 2022-01-27 19:48:56,279 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
19151
+ 2022-01-27 19:48:56,279 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
19152
+ 2022-01-27 19:48:57,838 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19153
+ 2022-01-27 19:48:59,839 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19154
+ 2022-01-27 19:49:01,839 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19155
+ 2022-01-27 19:49:03,839 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19156
+ 2022-01-27 19:49:05,839 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19157
+ 2022-01-27 19:49:07,840 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19158
+ 2022-01-27 19:49:09,840 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19159
+ 2022-01-27 19:49:11,395 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
19160
+ 2022-01-27 19:49:11,395 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
19161
+ 2022-01-27 19:49:11,840 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19162
+ 2022-01-27 19:49:13,610 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
19163
+ 2022-01-27 19:49:13,841 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19164
+ 2022-01-27 19:49:15,841 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19165
+ 2022-01-27 19:49:17,841 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19166
+ 2022-01-27 19:49:19,842 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19167
+ 2022-01-27 19:49:21,842 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19168
+ 2022-01-27 19:49:23,842 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19169
+ 2022-01-27 19:49:25,843 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19170
+ 2022-01-27 19:49:26,478 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
19171
+ 2022-01-27 19:49:26,479 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
19172
+ 2022-01-27 19:49:27,843 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19173
+ 2022-01-27 19:49:29,843 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19174
+ 2022-01-27 19:49:31,844 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19175
+ 2022-01-27 19:49:33,844 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19176
+ 2022-01-27 19:49:35,845 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19177
+ 2022-01-27 19:49:37,845 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19178
+ 2022-01-27 19:49:39,845 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19179
+ 2022-01-27 19:49:41,559 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
19180
+ 2022-01-27 19:49:41,559 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
19181
+ 2022-01-27 19:49:41,846 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19182
+ 2022-01-27 19:49:43,846 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19183
+ 2022-01-27 19:49:43,859 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
19184
+ 2022-01-27 19:49:45,846 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19185
+ 2022-01-27 19:49:49,847 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19186
+ 2022-01-27 19:49:51,847 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19187
+ 2022-01-27 19:49:53,848 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19188
+ 2022-01-27 19:49:55,848 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19189
+ 2022-01-27 19:49:56,656 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
19190
+ 2022-01-27 19:49:56,657 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
19191
+ 2022-01-27 19:49:57,848 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19192
+ 2022-01-27 19:49:59,849 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19193
+ 2022-01-27 19:50:01,849 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19194
+ 2022-01-27 19:50:01,900 DEBUG SenderThread:16113 [sender.py:send():182] send: history
19195
+ 2022-01-27 19:50:01,942 DEBUG SenderThread:16113 [sender.py:send():182] send: summary
19196
+ 2022-01-27 19:50:01,964 INFO SenderThread:16113 [sender.py:_save_file():873] saving file wandb-summary.json with policy end
19197
+ 2022-01-27 19:50:02,849 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/wandb-summary.json
19198
+ 2022-01-27 19:50:03,849 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19199
+ 2022-01-27 19:50:05,850 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19200
+ 2022-01-27 19:50:07,850 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19201
+ 2022-01-27 19:50:09,850 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19202
+ 2022-01-27 19:50:11,796 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
19203
+ 2022-01-27 19:50:11,797 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
19204
+ 2022-01-27 19:50:11,851 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19205
+ 2022-01-27 19:50:13,851 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19206
+ 2022-01-27 19:50:14,107 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
19207
+ 2022-01-27 19:50:15,851 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19208
+ 2022-01-27 19:50:17,852 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19209
+ 2022-01-27 19:50:19,852 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19210
+ 2022-01-27 19:50:21,852 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19211
+ 2022-01-27 19:50:23,853 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19212
+ 2022-01-27 19:50:25,853 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19213
+ 2022-01-27 19:50:26,912 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
19214
+ 2022-01-27 19:50:26,912 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
19215
+ 2022-01-27 19:50:27,853 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19216
+ 2022-01-27 19:50:29,854 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19217
+ 2022-01-27 19:50:31,854 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19218
+ 2022-01-27 19:50:33,854 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19219
+ 2022-01-27 19:50:35,855 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19220
+ 2022-01-27 19:50:37,855 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19221
+ 2022-01-27 19:50:39,855 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19222
+ 2022-01-27 19:50:41,855 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19223
+ 2022-01-27 19:50:42,017 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
19224
+ 2022-01-27 19:50:42,017 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
19225
+ 2022-01-27 19:50:43,856 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19226
+ 2022-01-27 19:50:44,352 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
19227
+ 2022-01-27 19:50:45,856 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19228
+ 2022-01-27 19:50:47,856 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19229
+ 2022-01-27 19:50:49,857 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19230
+ 2022-01-27 19:50:51,857 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19231
+ 2022-01-27 19:50:54,858 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19232
+ 2022-01-27 19:50:56,858 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19233
+ 2022-01-27 19:50:57,112 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
19234
+ 2022-01-27 19:50:57,112 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
19235
+ 2022-01-27 19:50:58,858 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19236
+ 2022-01-27 19:51:00,859 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19237
+ 2022-01-27 19:51:02,859 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19238
+ 2022-01-27 19:51:04,859 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19239
+ 2022-01-27 19:51:06,860 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19240
+ 2022-01-27 19:51:08,860 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19241
+ 2022-01-27 19:51:10,860 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19242
+ 2022-01-27 19:51:12,210 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
19243
+ 2022-01-27 19:51:12,210 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
19244
+ 2022-01-27 19:51:12,861 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19245
+ 2022-01-27 19:51:14,591 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
19246
+ 2022-01-27 19:51:14,861 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19247
+ 2022-01-27 19:51:16,861 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19248
+ 2022-01-27 19:51:18,861 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19249
+ 2022-01-27 19:51:20,862 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19250
+ 2022-01-27 19:51:22,862 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19251
+ 2022-01-27 19:51:24,863 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19252
+ 2022-01-27 19:51:26,863 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19253
+ 2022-01-27 19:51:27,313 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
19254
+ 2022-01-27 19:51:27,313 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
19255
+ 2022-01-27 19:51:28,863 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19256
+ 2022-01-27 19:51:30,864 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19257
+ 2022-01-27 19:51:32,864 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19258
+ 2022-01-27 19:51:34,864 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19259
+ 2022-01-27 19:51:36,865 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19260
+ 2022-01-27 19:51:38,865 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19261
+ 2022-01-27 19:51:40,865 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19262
+ 2022-01-27 19:51:42,403 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
19263
+ 2022-01-27 19:51:42,403 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
19264
+ 2022-01-27 19:51:42,866 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19265
+ 2022-01-27 19:51:44,835 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
19266
+ 2022-01-27 19:51:44,866 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19267
+ 2022-01-27 19:51:46,866 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19268
+ 2022-01-27 19:51:48,866 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19269
+ 2022-01-27 19:51:50,867 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19270
+ 2022-01-27 19:51:52,867 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19271
+ 2022-01-27 19:51:54,867 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19272
+ 2022-01-27 19:51:56,868 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19273
+ 2022-01-27 19:51:57,506 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
19274
+ 2022-01-27 19:51:57,506 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
19275
+ 2022-01-27 19:51:58,868 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19276
+ 2022-01-27 19:52:00,868 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19277
+ 2022-01-27 19:52:01,719 DEBUG SenderThread:16113 [sender.py:send():182] send: history
19278
+ 2022-01-27 19:52:01,764 DEBUG SenderThread:16113 [sender.py:send():182] send: summary
19279
+ 2022-01-27 19:52:01,788 INFO SenderThread:16113 [sender.py:_save_file():873] saving file wandb-summary.json with policy end
19280
+ 2022-01-27 19:52:01,869 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/wandb-summary.json
19281
+ 2022-01-27 19:52:02,869 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19282
+ 2022-01-27 19:52:03,869 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19283
+ 2022-01-27 19:52:04,869 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19284
+ 2022-01-27 19:52:06,869 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19285
+ 2022-01-27 19:52:08,870 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19286
+ 2022-01-27 19:52:10,870 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19287
+ 2022-01-27 19:52:12,657 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
19288
+ 2022-01-27 19:52:12,657 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
19289
+ 2022-01-27 19:52:12,870 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19290
+ 2022-01-27 19:52:14,871 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19291
+ 2022-01-27 19:52:15,089 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
19292
+ 2022-01-27 19:52:16,871 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19293
+ 2022-01-27 19:52:18,871 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19294
+ 2022-01-27 19:52:20,872 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19295
+ 2022-01-27 19:52:22,872 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19296
+ 2022-01-27 19:52:24,872 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19297
+ 2022-01-27 19:52:26,873 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19298
+ 2022-01-27 19:52:27,799 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
19299
+ 2022-01-27 19:52:27,799 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
19300
+ 2022-01-27 19:52:28,873 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19301
+ 2022-01-27 19:52:30,874 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19302
+ 2022-01-27 19:52:33,874 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19303
+ 2022-01-27 19:52:35,874 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19304
+ 2022-01-27 19:52:37,875 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19305
+ 2022-01-27 19:52:39,875 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19306
+ 2022-01-27 19:52:41,875 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19307
+ 2022-01-27 19:52:42,891 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
19308
+ 2022-01-27 19:52:42,891 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
19309
+ 2022-01-27 19:52:43,876 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19310
+ 2022-01-27 19:52:45,337 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
19311
+ 2022-01-27 19:52:45,876 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19312
+ 2022-01-27 19:52:47,876 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19313
+ 2022-01-27 19:52:49,877 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19314
+ 2022-01-27 19:52:51,877 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19315
+ 2022-01-27 19:52:53,877 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19316
+ 2022-01-27 19:52:55,878 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19317
+ 2022-01-27 19:52:57,878 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19318
+ 2022-01-27 19:52:58,001 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
19319
+ 2022-01-27 19:52:58,001 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
19320
+ 2022-01-27 19:52:59,878 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19321
+ 2022-01-27 19:53:01,879 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19322
+ 2022-01-27 19:53:03,879 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19323
+ 2022-01-27 19:53:05,879 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19324
+ 2022-01-27 19:53:07,880 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19325
+ 2022-01-27 19:53:09,880 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19326
+ 2022-01-27 19:53:11,880 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19327
+ 2022-01-27 19:53:13,139 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
19328
+ 2022-01-27 19:53:13,139 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
19329
+ 2022-01-27 19:53:13,881 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19330
+ 2022-01-27 19:53:15,582 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
19331
+ 2022-01-27 19:53:15,881 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19332
+ 2022-01-27 19:53:17,881 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19333
+ 2022-01-27 19:53:19,882 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19334
+ 2022-01-27 19:53:21,882 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19335
+ 2022-01-27 19:53:23,882 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19336
+ 2022-01-27 19:53:25,883 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19337
+ 2022-01-27 19:53:27,883 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19338
+ 2022-01-27 19:53:28,255 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
19339
+ 2022-01-27 19:53:28,255 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
19340
+ 2022-01-27 19:53:29,883 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19341
+ 2022-01-27 19:53:31,884 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19342
+ 2022-01-27 19:53:33,884 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19343
+ 2022-01-27 19:53:35,884 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19344
+ 2022-01-27 19:53:37,885 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19345
+ 2022-01-27 19:53:39,885 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19346
+ 2022-01-27 19:53:41,885 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19347
+ 2022-01-27 19:53:43,380 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
19348
+ 2022-01-27 19:53:43,380 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
19349
+ 2022-01-27 19:53:43,886 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19350
+ 2022-01-27 19:53:45,835 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
19351
+ 2022-01-27 19:53:45,886 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19352
+ 2022-01-27 19:53:47,886 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19353
+ 2022-01-27 19:53:49,887 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19354
+ 2022-01-27 19:53:51,887 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19355
+ 2022-01-27 19:53:53,888 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19356
+ 2022-01-27 19:53:55,888 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19357
+ 2022-01-27 19:53:57,888 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19358
+ 2022-01-27 19:53:58,489 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
19359
+ 2022-01-27 19:53:58,489 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
19360
+ 2022-01-27 19:53:59,889 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19361
+ 2022-01-27 19:54:02,889 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19362
+ 2022-01-27 19:54:04,889 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19363
+ 2022-01-27 19:54:06,890 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19364
+ 2022-01-27 19:54:08,890 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19365
+ 2022-01-27 19:54:10,891 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19366
+ 2022-01-27 19:54:12,891 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19367
+ 2022-01-27 19:54:13,584 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
19368
+ 2022-01-27 19:54:13,584 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
19369
+ 2022-01-27 19:54:14,891 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19370
+ 2022-01-27 19:54:16,093 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
19371
+ 2022-01-27 19:54:16,892 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19372
+ 2022-01-27 19:54:18,892 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19373
+ 2022-01-27 19:54:20,892 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19374
+ 2022-01-27 19:54:22,893 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19375
+ 2022-01-27 19:54:24,893 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19376
+ 2022-01-27 19:54:26,893 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19377
+ 2022-01-27 19:54:27,669 DEBUG SenderThread:16113 [sender.py:send():182] send: history
19378
+ 2022-01-27 19:54:27,679 DEBUG SenderThread:16113 [sender.py:send():182] send: summary
19379
+ 2022-01-27 19:54:27,775 INFO SenderThread:16113 [sender.py:_save_file():873] saving file wandb-summary.json with policy end
19380
+ 2022-01-27 19:54:27,894 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/wandb-summary.json
19381
+ 2022-01-27 19:54:28,688 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
19382
+ 2022-01-27 19:54:28,688 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
19383
+ 2022-01-27 19:54:28,894 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19384
+ 2022-01-27 19:54:30,895 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19385
+ 2022-01-27 19:54:43,794 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
19386
+ 2022-01-27 19:54:43,794 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
19387
+ 2022-01-27 19:54:46,390 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
19388
+ 2022-01-27 19:54:58,867 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
19389
+ 2022-01-27 19:54:58,868 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
19390
+ 2022-01-27 19:55:06,909 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
19391
+ 2022-01-27 19:55:13,947 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
19392
+ 2022-01-27 19:55:13,947 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
19393
+ 2022-01-27 19:55:16,720 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
19394
+ 2022-01-27 19:55:29,051 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
19395
+ 2022-01-27 19:55:29,051 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
wandb/run-20220127_121247-o8za41vn/run-o8za41vn.wandb CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:b1325f4f981fdb166ae08bcecbf0894cfe7a4093b3efe3a8a7509ae21be9b3b0
3
- size 111436117
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0d49bea57d27c2a1a71ce4dfe9db0eff35fdb7be77c158d4cebbbb9bf26d9ead
3
+ size 114851944