hf-test commited on
Commit
707e9e2
1 Parent(s): d4c6be7

Training in progress, step 16500

Browse files
pytorch_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5b1f52f444c6e109a4d9b2620c4d4465c835c2518aafed1995ee56046acfda89
3
  size 1262075377
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eb6ffc6610e3337793bfcb479db1b8c872bf6ebe7f20c22aad7767ef92735811
3
  size 1262075377
runs/Jan27_12-08-15_brutasse/events.out.tfevents.1643285566.brutasse.15970.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:dbff193221e02cc3e39d48ef3392c7df202790320fcb4b42e5d23c47c77ec553
3
- size 39974
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c117043c65ff1c2ccf6d2f0e38add2c6c7b6a08e4ba90a642cde851a50b90d72
3
+ size 41089
wandb/run-20220127_121247-o8za41vn/files/output.log CHANGED
@@ -12143,3 +12143,382 @@ Configuration saved in ./checkpoint-15500/preprocessor_config.json
12143
  Batch size = 8ved in ./checkpoint-15500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12144
  Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12145
  Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
12143
  Batch size = 8ved in ./checkpoint-15500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12144
  Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12145
  Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12146
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12147
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12148
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12149
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12150
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12151
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12152
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12153
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12154
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12155
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12156
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12157
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12158
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12159
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12160
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12161
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12162
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12163
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12164
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12165
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12166
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12167
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12168
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12169
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12170
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12171
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12172
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12173
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12174
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12175
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12176
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12177
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12178
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12179
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12180
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12181
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12182
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12183
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12184
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12185
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12186
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12187
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12188
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12189
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12190
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12191
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12192
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12193
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12194
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12195
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12196
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12197
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12198
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12199
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12200
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12201
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12202
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12203
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12204
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12205
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12206
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12207
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12208
+ {'loss': 1.0537, 'learning_rate': 9.964615384615385e-06, 'epoch': 44.11}
12209
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12210
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12211
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12212
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12213
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12214
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12215
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12216
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12217
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12218
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12219
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12220
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12221
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12222
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12223
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12224
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12225
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12226
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12227
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12228
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12229
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12230
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12231
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12232
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12233
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12234
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12235
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12236
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12237
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12238
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12239
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12240
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12241
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12242
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12243
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12244
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12245
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12246
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12247
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12248
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12249
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12250
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12251
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12252
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12253
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12254
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12255
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12256
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12257
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12258
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12259
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12260
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12261
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12262
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12263
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12264
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12265
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12266
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12267
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12268
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12269
+ {'loss': 1.049, 'learning_rate': 9.503076923076922e-06, 'epoch': 44.38}
12270
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12271
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12272
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12273
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12274
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12275
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12276
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12277
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12278
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12279
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12280
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12281
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12282
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12283
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12284
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12285
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12286
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12287
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12288
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12289
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12290
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12291
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12292
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12293
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12294
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12295
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12296
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12297
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12298
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12299
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12300
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12301
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12302
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12303
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12304
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12305
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12306
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12307
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12308
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12309
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12310
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12311
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12312
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12313
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12314
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12315
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12316
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12317
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12318
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12319
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12320
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12321
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12322
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12323
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12324
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12325
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12326
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12327
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12328
+ {'loss': 1.0517, 'learning_rate': 9.04153846153846e-06, 'epoch': 44.66}
12329
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12330
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12331
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12332
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12333
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12334
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12335
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12336
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12337
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12338
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12339
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12340
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12341
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12342
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12343
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12344
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12345
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12346
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12347
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12348
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12349
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12350
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12351
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12352
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12353
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12354
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12355
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12356
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12357
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12358
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12359
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12360
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12361
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12362
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12363
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12364
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12365
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12366
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12367
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12368
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12369
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12370
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12371
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12372
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12373
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12374
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12375
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12376
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12377
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12378
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12379
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12380
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12381
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12382
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12383
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12384
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12385
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12386
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12387
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12388
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12389
+ {'loss': 1.036, 'learning_rate': 8.58e-06, 'epoch': 44.93}
12390
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12391
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12392
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12393
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12394
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12395
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12396
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12397
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12398
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12399
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12400
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12401
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12402
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12403
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12404
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12405
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12406
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12407
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12408
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12409
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12410
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12411
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12412
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12413
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12414
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12415
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12416
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12417
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12418
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12419
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12420
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12421
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12422
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12423
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12424
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12425
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12426
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12427
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12428
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12429
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12430
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12431
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12432
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12433
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12434
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12435
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12436
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12437
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12438
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12439
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12440
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12441
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12442
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12443
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12444
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12445
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12446
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12447
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12448
+ Configuration saved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12449
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12450
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12451
+ {'loss': 1.0786, 'learning_rate': 8.118461538461538e-06, 'epoch': 45.21}
12452
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12453
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12454
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12455
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12456
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12457
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12458
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12459
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12460
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12461
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12462
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12463
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12464
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12465
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12466
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12467
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12468
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12469
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12470
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12471
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12472
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12473
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12474
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12475
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12476
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12477
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12478
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12479
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12480
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12481
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12482
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12483
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12484
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12485
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12486
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12487
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12488
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12489
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12490
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12491
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12492
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12493
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12494
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12495
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12496
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12497
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12498
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12499
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12500
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12501
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12502
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12503
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12504
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12505
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12506
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12507
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12508
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12509
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12510
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12511
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12512
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12513
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12514
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12515
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12516
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12517
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12518
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12519
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12520
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12521
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12522
+ Batch size = 8ved in ./checkpoint-16000/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12523
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
12524
+ Configuration saved in ./checkpoint-16500/preprocessor_config.json | 197/606 [00:51<01:47, 3.79it/s]
wandb/run-20220127_121247-o8za41vn/files/wandb-summary.json CHANGED
The diff for this file is too large to render. See raw diff
 
wandb/run-20220127_121247-o8za41vn/logs/debug-internal.log CHANGED
@@ -18321,3 +18321,542 @@
18321
  2022-01-27 19:28:00,589 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18322
  2022-01-27 19:28:00,589 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18323
  2022-01-27 19:28:02,864 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
18321
  2022-01-27 19:28:00,589 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18322
  2022-01-27 19:28:00,589 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18323
  2022-01-27 19:28:02,864 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
18324
+ 2022-01-27 19:28:10,570 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18325
+ 2022-01-27 19:28:12,570 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18326
+ 2022-01-27 19:28:14,571 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18327
+ 2022-01-27 19:28:15,668 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18328
+ 2022-01-27 19:28:15,668 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18329
+ 2022-01-27 19:28:16,571 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18330
+ 2022-01-27 19:28:18,571 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18331
+ 2022-01-27 19:28:20,572 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18332
+ 2022-01-27 19:28:22,572 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18333
+ 2022-01-27 19:28:24,572 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18334
+ 2022-01-27 19:28:26,573 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18335
+ 2022-01-27 19:28:28,573 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18336
+ 2022-01-27 19:28:30,573 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18337
+ 2022-01-27 19:28:30,789 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18338
+ 2022-01-27 19:28:30,789 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18339
+ 2022-01-27 19:28:32,574 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18340
+ 2022-01-27 19:28:33,126 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
18341
+ 2022-01-27 19:28:34,574 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18342
+ 2022-01-27 19:28:36,574 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18343
+ 2022-01-27 19:28:38,575 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18344
+ 2022-01-27 19:28:40,575 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18345
+ 2022-01-27 19:28:42,576 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18346
+ 2022-01-27 19:28:44,576 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18347
+ 2022-01-27 19:28:45,911 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18348
+ 2022-01-27 19:28:45,911 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18349
+ 2022-01-27 19:28:46,576 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18350
+ 2022-01-27 19:28:48,577 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18351
+ 2022-01-27 19:28:50,577 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18352
+ 2022-01-27 19:28:52,577 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18353
+ 2022-01-27 19:28:54,578 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18354
+ 2022-01-27 19:28:56,578 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18355
+ 2022-01-27 19:28:58,578 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18356
+ 2022-01-27 19:29:00,579 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18357
+ 2022-01-27 19:29:00,999 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18358
+ 2022-01-27 19:29:00,999 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18359
+ 2022-01-27 19:29:02,579 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18360
+ 2022-01-27 19:29:03,383 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
18361
+ 2022-01-27 19:29:04,579 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18362
+ 2022-01-27 19:29:06,580 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18363
+ 2022-01-27 19:29:08,580 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18364
+ 2022-01-27 19:29:10,580 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18365
+ 2022-01-27 19:29:12,581 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18366
+ 2022-01-27 19:29:14,581 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18367
+ 2022-01-27 19:29:16,125 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18368
+ 2022-01-27 19:29:16,125 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18369
+ 2022-01-27 19:29:16,581 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18370
+ 2022-01-27 19:29:18,582 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18371
+ 2022-01-27 19:29:20,582 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18372
+ 2022-01-27 19:29:22,582 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18373
+ 2022-01-27 19:29:24,583 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18374
+ 2022-01-27 19:29:26,583 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18375
+ 2022-01-27 19:29:28,584 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18376
+ 2022-01-27 19:29:30,584 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18377
+ 2022-01-27 19:29:31,293 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18378
+ 2022-01-27 19:29:31,293 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18379
+ 2022-01-27 19:29:32,584 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18380
+ 2022-01-27 19:29:33,643 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
18381
+ 2022-01-27 19:29:34,585 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18382
+ 2022-01-27 19:29:36,585 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18383
+ 2022-01-27 19:29:38,585 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18384
+ 2022-01-27 19:29:40,586 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18385
+ 2022-01-27 19:29:43,586 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18386
+ 2022-01-27 19:29:45,587 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18387
+ 2022-01-27 19:29:46,403 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18388
+ 2022-01-27 19:29:46,403 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18389
+ 2022-01-27 19:29:47,587 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18390
+ 2022-01-27 19:29:49,587 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18391
+ 2022-01-27 19:29:51,588 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18392
+ 2022-01-27 19:29:53,588 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18393
+ 2022-01-27 19:29:55,589 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18394
+ 2022-01-27 19:29:57,589 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18395
+ 2022-01-27 19:29:59,589 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18396
+ 2022-01-27 19:30:01,489 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18397
+ 2022-01-27 19:30:01,490 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18398
+ 2022-01-27 19:30:01,590 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18399
+ 2022-01-27 19:30:03,590 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18400
+ 2022-01-27 19:30:03,903 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
18401
+ 2022-01-27 19:30:05,590 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18402
+ 2022-01-27 19:30:07,591 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18403
+ 2022-01-27 19:30:09,591 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18404
+ 2022-01-27 19:30:11,139 DEBUG SenderThread:16113 [sender.py:send():182] send: history
18405
+ 2022-01-27 19:30:11,188 DEBUG SenderThread:16113 [sender.py:send():182] send: summary
18406
+ 2022-01-27 19:30:11,211 INFO SenderThread:16113 [sender.py:_save_file():873] saving file wandb-summary.json with policy end
18407
+ 2022-01-27 19:30:11,592 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/wandb-summary.json
18408
+ 2022-01-27 19:30:11,592 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18409
+ 2022-01-27 19:30:12,592 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18410
+ 2022-01-27 19:30:13,592 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18411
+ 2022-01-27 19:30:15,592 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18412
+ 2022-01-27 19:30:16,572 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18413
+ 2022-01-27 19:30:16,573 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18414
+ 2022-01-27 19:30:17,593 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18415
+ 2022-01-27 19:30:19,593 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18416
+ 2022-01-27 19:30:21,594 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18417
+ 2022-01-27 19:30:23,594 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18418
+ 2022-01-27 19:30:25,594 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18419
+ 2022-01-27 19:30:27,595 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18420
+ 2022-01-27 19:30:29,595 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18421
+ 2022-01-27 19:30:31,595 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18422
+ 2022-01-27 19:30:31,711 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18423
+ 2022-01-27 19:30:31,711 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18424
+ 2022-01-27 19:30:33,596 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18425
+ 2022-01-27 19:30:34,172 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
18426
+ 2022-01-27 19:30:35,596 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18427
+ 2022-01-27 19:30:37,596 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18428
+ 2022-01-27 19:30:39,597 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18429
+ 2022-01-27 19:30:41,597 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18430
+ 2022-01-27 19:30:43,597 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18431
+ 2022-01-27 19:30:45,598 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18432
+ 2022-01-27 19:30:46,818 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18433
+ 2022-01-27 19:30:46,818 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18434
+ 2022-01-27 19:30:47,598 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18435
+ 2022-01-27 19:30:49,598 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18436
+ 2022-01-27 19:30:51,599 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18437
+ 2022-01-27 19:30:53,599 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18438
+ 2022-01-27 19:30:55,599 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18439
+ 2022-01-27 19:30:57,600 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18440
+ 2022-01-27 19:30:59,600 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18441
+ 2022-01-27 19:31:01,600 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18442
+ 2022-01-27 19:31:01,914 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18443
+ 2022-01-27 19:31:01,914 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18444
+ 2022-01-27 19:31:03,601 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18445
+ 2022-01-27 19:31:04,425 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
18446
+ 2022-01-27 19:31:05,601 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18447
+ 2022-01-27 19:31:07,601 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18448
+ 2022-01-27 19:31:09,602 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18449
+ 2022-01-27 19:31:11,602 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18450
+ 2022-01-27 19:31:13,602 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18451
+ 2022-01-27 19:31:15,602 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18452
+ 2022-01-27 19:31:17,015 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18453
+ 2022-01-27 19:31:17,015 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18454
+ 2022-01-27 19:31:17,603 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18455
+ 2022-01-27 19:31:19,603 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18456
+ 2022-01-27 19:31:21,603 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18457
+ 2022-01-27 19:31:25,604 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18458
+ 2022-01-27 19:31:27,605 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18459
+ 2022-01-27 19:31:29,605 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18460
+ 2022-01-27 19:31:31,605 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18461
+ 2022-01-27 19:31:32,169 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18462
+ 2022-01-27 19:31:32,169 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18463
+ 2022-01-27 19:31:33,606 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18464
+ 2022-01-27 19:31:34,692 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
18465
+ 2022-01-27 19:31:35,606 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18466
+ 2022-01-27 19:31:37,606 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18467
+ 2022-01-27 19:31:39,607 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18468
+ 2022-01-27 19:31:41,607 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18469
+ 2022-01-27 19:31:43,607 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18470
+ 2022-01-27 19:31:45,607 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18471
+ 2022-01-27 19:31:47,254 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18472
+ 2022-01-27 19:31:47,254 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18473
+ 2022-01-27 19:31:47,608 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18474
+ 2022-01-27 19:31:49,608 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18475
+ 2022-01-27 19:31:51,608 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18476
+ 2022-01-27 19:31:53,609 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18477
+ 2022-01-27 19:31:55,609 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18478
+ 2022-01-27 19:31:57,609 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18479
+ 2022-01-27 19:31:59,610 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18480
+ 2022-01-27 19:32:02,327 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18481
+ 2022-01-27 19:32:02,327 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18482
+ 2022-01-27 19:32:02,610 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18483
+ 2022-01-27 19:32:04,610 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18484
+ 2022-01-27 19:32:04,952 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
18485
+ 2022-01-27 19:32:06,611 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18486
+ 2022-01-27 19:32:08,611 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18487
+ 2022-01-27 19:32:10,611 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18488
+ 2022-01-27 19:32:12,612 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18489
+ 2022-01-27 19:32:12,900 DEBUG SenderThread:16113 [sender.py:send():182] send: history
18490
+ 2022-01-27 19:32:12,944 DEBUG SenderThread:16113 [sender.py:send():182] send: summary
18491
+ 2022-01-27 19:32:12,968 INFO SenderThread:16113 [sender.py:_save_file():873] saving file wandb-summary.json with policy end
18492
+ 2022-01-27 19:32:13,612 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/wandb-summary.json
18493
+ 2022-01-27 19:32:14,612 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18494
+ 2022-01-27 19:32:15,612 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18495
+ 2022-01-27 19:32:16,612 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18496
+ 2022-01-27 19:32:17,425 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18497
+ 2022-01-27 19:32:17,426 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18498
+ 2022-01-27 19:32:18,613 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18499
+ 2022-01-27 19:32:20,613 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18500
+ 2022-01-27 19:32:22,613 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18501
+ 2022-01-27 19:32:26,614 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18502
+ 2022-01-27 19:32:28,614 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18503
+ 2022-01-27 19:32:30,615 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18504
+ 2022-01-27 19:32:32,532 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18505
+ 2022-01-27 19:32:32,532 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18506
+ 2022-01-27 19:32:32,615 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18507
+ 2022-01-27 19:32:34,615 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18508
+ 2022-01-27 19:32:35,218 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
18509
+ 2022-01-27 19:32:36,616 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18510
+ 2022-01-27 19:32:38,616 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18511
+ 2022-01-27 19:32:40,616 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18512
+ 2022-01-27 19:32:42,617 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18513
+ 2022-01-27 19:32:44,617 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18514
+ 2022-01-27 19:32:46,617 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18515
+ 2022-01-27 19:32:48,618 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18516
+ 2022-01-27 19:32:49,217 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18517
+ 2022-01-27 19:32:49,217 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18518
+ 2022-01-27 19:32:50,618 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18519
+ 2022-01-27 19:32:52,618 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18520
+ 2022-01-27 19:32:54,619 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18521
+ 2022-01-27 19:32:56,619 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18522
+ 2022-01-27 19:32:58,619 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18523
+ 2022-01-27 19:33:00,620 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18524
+ 2022-01-27 19:33:02,620 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18525
+ 2022-01-27 19:33:04,310 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18526
+ 2022-01-27 19:33:04,310 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18527
+ 2022-01-27 19:33:04,620 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18528
+ 2022-01-27 19:33:05,470 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
18529
+ 2022-01-27 19:33:06,621 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18530
+ 2022-01-27 19:33:08,621 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18531
+ 2022-01-27 19:33:10,621 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18532
+ 2022-01-27 19:33:12,622 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18533
+ 2022-01-27 19:33:14,622 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18534
+ 2022-01-27 19:33:16,622 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18535
+ 2022-01-27 19:33:18,623 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18536
+ 2022-01-27 19:33:19,387 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18537
+ 2022-01-27 19:33:19,387 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18538
+ 2022-01-27 19:33:20,623 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18539
+ 2022-01-27 19:33:22,623 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18540
+ 2022-01-27 19:33:24,624 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18541
+ 2022-01-27 19:33:26,624 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18542
+ 2022-01-27 19:33:28,624 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18543
+ 2022-01-27 19:33:30,625 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18544
+ 2022-01-27 19:33:32,625 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18545
+ 2022-01-27 19:33:34,474 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18546
+ 2022-01-27 19:33:34,475 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18547
+ 2022-01-27 19:33:34,625 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18548
+ 2022-01-27 19:33:35,719 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
18549
+ 2022-01-27 19:33:36,625 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18550
+ 2022-01-27 19:33:38,626 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18551
+ 2022-01-27 19:33:40,626 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18552
+ 2022-01-27 19:33:42,627 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18553
+ 2022-01-27 19:33:44,627 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18554
+ 2022-01-27 19:33:46,627 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18555
+ 2022-01-27 19:33:48,627 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18556
+ 2022-01-27 19:33:49,595 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18557
+ 2022-01-27 19:33:49,595 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18558
+ 2022-01-27 19:33:50,628 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18559
+ 2022-01-27 19:33:52,628 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18560
+ 2022-01-27 19:33:54,628 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18561
+ 2022-01-27 19:33:56,629 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18562
+ 2022-01-27 19:33:58,629 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18563
+ 2022-01-27 19:34:00,630 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18564
+ 2022-01-27 19:34:02,630 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18565
+ 2022-01-27 19:34:04,630 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18566
+ 2022-01-27 19:34:04,680 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18567
+ 2022-01-27 19:34:04,680 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18568
+ 2022-01-27 19:34:05,972 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
18569
+ 2022-01-27 19:34:06,631 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18570
+ 2022-01-27 19:34:08,631 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18571
+ 2022-01-27 19:34:10,631 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18572
+ 2022-01-27 19:34:12,626 DEBUG SenderThread:16113 [sender.py:send():182] send: history
18573
+ 2022-01-27 19:34:12,670 DEBUG SenderThread:16113 [sender.py:send():182] send: summary
18574
+ 2022-01-27 19:34:12,693 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18575
+ 2022-01-27 19:34:12,694 INFO SenderThread:16113 [sender.py:_save_file():873] saving file wandb-summary.json with policy end
18576
+ 2022-01-27 19:34:13,671 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/wandb-summary.json
18577
+ 2022-01-27 19:34:13,671 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18578
+ 2022-01-27 19:34:14,671 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18579
+ 2022-01-27 19:34:16,671 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18580
+ 2022-01-27 19:34:18,671 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18581
+ 2022-01-27 19:34:19,786 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18582
+ 2022-01-27 19:34:19,786 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18583
+ 2022-01-27 19:34:20,672 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18584
+ 2022-01-27 19:34:22,672 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18585
+ 2022-01-27 19:34:24,672 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18586
+ 2022-01-27 19:34:26,673 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18587
+ 2022-01-27 19:34:28,673 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18588
+ 2022-01-27 19:34:30,674 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18589
+ 2022-01-27 19:34:32,674 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18590
+ 2022-01-27 19:34:34,674 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18591
+ 2022-01-27 19:34:34,915 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18592
+ 2022-01-27 19:34:34,916 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18593
+ 2022-01-27 19:34:36,227 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
18594
+ 2022-01-27 19:34:36,675 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18595
+ 2022-01-27 19:34:38,675 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18596
+ 2022-01-27 19:34:41,675 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18597
+ 2022-01-27 19:34:43,676 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18598
+ 2022-01-27 19:34:45,676 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18599
+ 2022-01-27 19:34:47,676 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18600
+ 2022-01-27 19:34:49,677 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18601
+ 2022-01-27 19:34:50,031 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18602
+ 2022-01-27 19:34:50,031 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18603
+ 2022-01-27 19:34:51,677 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18604
+ 2022-01-27 19:34:53,677 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18605
+ 2022-01-27 19:34:55,678 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18606
+ 2022-01-27 19:34:57,678 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18607
+ 2022-01-27 19:34:59,678 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18608
+ 2022-01-27 19:35:01,679 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18609
+ 2022-01-27 19:35:03,679 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18610
+ 2022-01-27 19:35:05,175 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18611
+ 2022-01-27 19:35:05,175 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18612
+ 2022-01-27 19:35:05,679 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18613
+ 2022-01-27 19:35:06,464 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
18614
+ 2022-01-27 19:35:07,680 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18615
+ 2022-01-27 19:35:09,680 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18616
+ 2022-01-27 19:35:11,680 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18617
+ 2022-01-27 19:35:13,680 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18618
+ 2022-01-27 19:35:15,681 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18619
+ 2022-01-27 19:35:17,681 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18620
+ 2022-01-27 19:35:19,681 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18621
+ 2022-01-27 19:35:20,252 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18622
+ 2022-01-27 19:35:20,252 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18623
+ 2022-01-27 19:35:21,682 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18624
+ 2022-01-27 19:35:23,682 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18625
+ 2022-01-27 19:35:27,683 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18626
+ 2022-01-27 19:35:29,683 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18627
+ 2022-01-27 19:35:31,684 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18628
+ 2022-01-27 19:35:33,684 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18629
+ 2022-01-27 19:35:35,365 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18630
+ 2022-01-27 19:35:35,365 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18631
+ 2022-01-27 19:35:35,684 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18632
+ 2022-01-27 19:35:36,707 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
18633
+ 2022-01-27 19:35:37,685 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18634
+ 2022-01-27 19:35:39,685 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18635
+ 2022-01-27 19:35:41,685 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18636
+ 2022-01-27 19:35:43,686 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18637
+ 2022-01-27 19:35:45,686 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18638
+ 2022-01-27 19:35:47,686 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18639
+ 2022-01-27 19:35:49,686 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18640
+ 2022-01-27 19:35:50,453 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18641
+ 2022-01-27 19:35:50,453 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18642
+ 2022-01-27 19:35:51,687 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18643
+ 2022-01-27 19:35:53,687 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18644
+ 2022-01-27 19:35:55,687 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18645
+ 2022-01-27 19:35:57,688 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18646
+ 2022-01-27 19:35:59,688 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18647
+ 2022-01-27 19:36:01,688 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18648
+ 2022-01-27 19:36:03,689 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18649
+ 2022-01-27 19:36:05,527 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18650
+ 2022-01-27 19:36:05,527 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18651
+ 2022-01-27 19:36:05,689 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18652
+ 2022-01-27 19:36:06,961 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
18653
+ 2022-01-27 19:36:07,689 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18654
+ 2022-01-27 19:36:09,690 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18655
+ 2022-01-27 19:36:11,690 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18656
+ 2022-01-27 19:36:13,690 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18657
+ 2022-01-27 19:36:13,780 DEBUG SenderThread:16113 [sender.py:send():182] send: history
18658
+ 2022-01-27 19:36:13,825 DEBUG SenderThread:16113 [sender.py:send():182] send: summary
18659
+ 2022-01-27 19:36:13,848 INFO SenderThread:16113 [sender.py:_save_file():873] saving file wandb-summary.json with policy end
18660
+ 2022-01-27 19:36:14,691 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/wandb-summary.json
18661
+ 2022-01-27 19:36:15,691 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18662
+ 2022-01-27 19:36:16,691 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18663
+ 2022-01-27 19:36:17,691 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18664
+ 2022-01-27 19:36:19,691 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18665
+ 2022-01-27 19:36:20,798 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18666
+ 2022-01-27 19:36:20,799 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18667
+ 2022-01-27 19:36:21,692 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18668
+ 2022-01-27 19:36:23,692 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18669
+ 2022-01-27 19:36:25,692 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18670
+ 2022-01-27 19:36:27,693 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18671
+ 2022-01-27 19:36:29,693 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18672
+ 2022-01-27 19:36:31,693 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18673
+ 2022-01-27 19:36:33,694 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18674
+ 2022-01-27 19:36:35,694 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18675
+ 2022-01-27 19:36:35,901 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18676
+ 2022-01-27 19:36:35,901 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18677
+ 2022-01-27 19:36:37,218 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
18678
+ 2022-01-27 19:36:37,694 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18679
+ 2022-01-27 19:36:39,695 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18680
+ 2022-01-27 19:36:41,695 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18681
+ 2022-01-27 19:36:43,695 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18682
+ 2022-01-27 19:36:45,696 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18683
+ 2022-01-27 19:36:47,696 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18684
+ 2022-01-27 19:36:49,696 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18685
+ 2022-01-27 19:36:50,979 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18686
+ 2022-01-27 19:36:50,979 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18687
+ 2022-01-27 19:36:51,697 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18688
+ 2022-01-27 19:36:53,697 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18689
+ 2022-01-27 19:36:55,697 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18690
+ 2022-01-27 19:36:57,698 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18691
+ 2022-01-27 19:36:59,698 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18692
+ 2022-01-27 19:37:01,698 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18693
+ 2022-01-27 19:37:03,699 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18694
+ 2022-01-27 19:37:05,699 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18695
+ 2022-01-27 19:37:06,067 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18696
+ 2022-01-27 19:37:06,067 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18697
+ 2022-01-27 19:37:07,448 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
18698
+ 2022-01-27 19:37:08,699 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18699
+ 2022-01-27 19:37:10,700 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18700
+ 2022-01-27 19:37:12,700 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18701
+ 2022-01-27 19:37:14,700 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18702
+ 2022-01-27 19:37:16,701 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18703
+ 2022-01-27 19:37:18,701 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18704
+ 2022-01-27 19:37:20,701 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18705
+ 2022-01-27 19:37:21,143 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18706
+ 2022-01-27 19:37:21,143 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18707
+ 2022-01-27 19:37:22,702 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18708
+ 2022-01-27 19:37:24,702 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18709
+ 2022-01-27 19:37:26,702 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18710
+ 2022-01-27 19:37:28,703 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18711
+ 2022-01-27 19:37:30,703 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18712
+ 2022-01-27 19:37:32,703 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18713
+ 2022-01-27 19:37:34,704 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18714
+ 2022-01-27 19:37:36,364 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18715
+ 2022-01-27 19:37:36,364 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18716
+ 2022-01-27 19:37:36,704 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18717
+ 2022-01-27 19:37:37,694 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
18718
+ 2022-01-27 19:37:38,704 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18719
+ 2022-01-27 19:37:40,705 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18720
+ 2022-01-27 19:37:42,705 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18721
+ 2022-01-27 19:37:44,705 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18722
+ 2022-01-27 19:37:46,706 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18723
+ 2022-01-27 19:37:48,706 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18724
+ 2022-01-27 19:37:50,706 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18725
+ 2022-01-27 19:37:51,441 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18726
+ 2022-01-27 19:37:51,441 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18727
+ 2022-01-27 19:37:52,707 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18728
+ 2022-01-27 19:37:54,707 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18729
+ 2022-01-27 19:37:56,707 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18730
+ 2022-01-27 19:37:58,708 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18731
+ 2022-01-27 19:38:00,708 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18732
+ 2022-01-27 19:38:02,708 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18733
+ 2022-01-27 19:38:04,708 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18734
+ 2022-01-27 19:38:06,519 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18735
+ 2022-01-27 19:38:06,519 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18736
+ 2022-01-27 19:38:06,709 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18737
+ 2022-01-27 19:38:07,932 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
18738
+ 2022-01-27 19:38:08,709 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18739
+ 2022-01-27 19:38:10,709 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18740
+ 2022-01-27 19:38:12,710 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18741
+ 2022-01-27 19:38:14,710 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18742
+ 2022-01-27 19:38:16,710 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18743
+ 2022-01-27 19:38:17,255 DEBUG SenderThread:16113 [sender.py:send():182] send: history
18744
+ 2022-01-27 19:38:17,299 DEBUG SenderThread:16113 [sender.py:send():182] send: summary
18745
+ 2022-01-27 19:38:17,322 INFO SenderThread:16113 [sender.py:_save_file():873] saving file wandb-summary.json with policy end
18746
+ 2022-01-27 19:38:17,711 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/wandb-summary.json
18747
+ 2022-01-27 19:38:18,711 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18748
+ 2022-01-27 19:38:20,711 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18749
+ 2022-01-27 19:38:21,642 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18750
+ 2022-01-27 19:38:21,643 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18751
+ 2022-01-27 19:38:22,711 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18752
+ 2022-01-27 19:38:24,712 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18753
+ 2022-01-27 19:38:26,712 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18754
+ 2022-01-27 19:38:28,712 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18755
+ 2022-01-27 19:38:30,713 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18756
+ 2022-01-27 19:38:32,713 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18757
+ 2022-01-27 19:38:34,713 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18758
+ 2022-01-27 19:38:36,714 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18759
+ 2022-01-27 19:38:36,742 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18760
+ 2022-01-27 19:38:36,743 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18761
+ 2022-01-27 19:38:38,183 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
18762
+ 2022-01-27 19:38:38,714 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18763
+ 2022-01-27 19:38:40,715 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18764
+ 2022-01-27 19:38:42,715 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18765
+ 2022-01-27 19:38:44,715 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18766
+ 2022-01-27 19:38:46,716 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18767
+ 2022-01-27 19:38:48,716 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18768
+ 2022-01-27 19:38:50,716 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18769
+ 2022-01-27 19:38:51,813 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18770
+ 2022-01-27 19:38:51,813 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18771
+ 2022-01-27 19:38:52,717 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18772
+ 2022-01-27 19:38:54,717 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18773
+ 2022-01-27 19:38:56,717 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18774
+ 2022-01-27 19:38:59,718 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18775
+ 2022-01-27 19:39:01,718 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18776
+ 2022-01-27 19:39:03,718 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18777
+ 2022-01-27 19:39:05,719 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18778
+ 2022-01-27 19:39:06,979 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18779
+ 2022-01-27 19:39:06,979 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18780
+ 2022-01-27 19:39:07,719 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18781
+ 2022-01-27 19:39:08,428 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
18782
+ 2022-01-27 19:39:09,719 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18783
+ 2022-01-27 19:39:11,720 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18784
+ 2022-01-27 19:39:13,720 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18785
+ 2022-01-27 19:39:15,720 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18786
+ 2022-01-27 19:39:17,721 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18787
+ 2022-01-27 19:39:19,721 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18788
+ 2022-01-27 19:39:21,721 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18789
+ 2022-01-27 19:39:22,102 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18790
+ 2022-01-27 19:39:22,103 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18791
+ 2022-01-27 19:39:23,722 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18792
+ 2022-01-27 19:39:25,722 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18793
+ 2022-01-27 19:39:27,722 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18794
+ 2022-01-27 19:39:29,723 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18795
+ 2022-01-27 19:39:31,723 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18796
+ 2022-01-27 19:39:33,723 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18797
+ 2022-01-27 19:39:35,724 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18798
+ 2022-01-27 19:39:37,175 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18799
+ 2022-01-27 19:39:37,175 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18800
+ 2022-01-27 19:39:37,724 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18801
+ 2022-01-27 19:39:38,681 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
18802
+ 2022-01-27 19:39:39,724 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18803
+ 2022-01-27 19:39:41,725 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18804
+ 2022-01-27 19:39:43,725 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18805
+ 2022-01-27 19:39:45,726 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18806
+ 2022-01-27 19:39:47,726 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18807
+ 2022-01-27 19:39:49,726 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18808
+ 2022-01-27 19:39:51,727 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18809
+ 2022-01-27 19:39:52,293 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18810
+ 2022-01-27 19:39:52,293 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18811
+ 2022-01-27 19:39:53,727 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18812
+ 2022-01-27 19:39:55,727 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18813
+ 2022-01-27 19:39:57,728 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18814
+ 2022-01-27 19:39:59,728 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18815
+ 2022-01-27 19:40:01,728 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18816
+ 2022-01-27 19:40:03,729 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18817
+ 2022-01-27 19:40:05,729 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18818
+ 2022-01-27 19:40:07,448 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18819
+ 2022-01-27 19:40:07,448 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18820
+ 2022-01-27 19:40:07,729 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18821
+ 2022-01-27 19:40:08,937 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
18822
+ 2022-01-27 19:40:09,730 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18823
+ 2022-01-27 19:40:11,730 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18824
+ 2022-01-27 19:40:13,730 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18825
+ 2022-01-27 19:40:15,731 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18826
+ 2022-01-27 19:40:17,731 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18827
+ 2022-01-27 19:40:19,731 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18828
+ 2022-01-27 19:40:21,732 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18829
+ 2022-01-27 19:40:22,619 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18830
+ 2022-01-27 19:40:22,619 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18831
+ 2022-01-27 19:40:23,732 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18832
+ 2022-01-27 19:40:25,732 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18833
+ 2022-01-27 19:40:27,733 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18834
+ 2022-01-27 19:40:29,733 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18835
+ 2022-01-27 19:40:31,733 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18836
+ 2022-01-27 19:40:34,734 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18837
+ 2022-01-27 19:40:36,734 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18838
+ 2022-01-27 19:40:37,743 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18839
+ 2022-01-27 19:40:37,743 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18840
+ 2022-01-27 19:40:38,734 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18841
+ 2022-01-27 19:40:39,199 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
18842
+ 2022-01-27 19:40:40,735 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18843
+ 2022-01-27 19:40:42,735 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18844
+ 2022-01-27 19:40:43,659 DEBUG SenderThread:16113 [sender.py:send():182] send: history
18845
+ 2022-01-27 19:40:43,675 DEBUG SenderThread:16113 [sender.py:send():182] send: summary
18846
+ 2022-01-27 19:40:43,705 INFO SenderThread:16113 [sender.py:_save_file():873] saving file wandb-summary.json with policy end
18847
+ 2022-01-27 19:40:43,735 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/wandb-summary.json
18848
+ 2022-01-27 19:40:45,736 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18849
+ 2022-01-27 19:40:46,736 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18850
+ 2022-01-27 19:40:52,820 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18851
+ 2022-01-27 19:40:52,821 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18852
+ 2022-01-27 19:41:07,904 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18853
+ 2022-01-27 19:41:07,904 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18854
+ 2022-01-27 19:41:09,521 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
18855
+ 2022-01-27 19:41:22,983 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18856
+ 2022-01-27 19:41:22,983 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18857
+ 2022-01-27 19:41:26,753 INFO Thread-8 :16113 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/patrick/experiments/xls-r-300m-sv-cv8/wandb/run-20220127_121247-o8za41vn/files/output.log
18858
+ 2022-01-27 19:41:38,056 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18859
+ 2022-01-27 19:41:38,057 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
18860
+ 2022-01-27 19:41:39,847 DEBUG SenderThread:16113 [sender.py:send():182] send: stats
18861
+ 2022-01-27 19:41:53,130 DEBUG HandlerThread:16113 [handler.py:handle_request():126] handle_request: stop_status
18862
+ 2022-01-27 19:41:53,130 DEBUG SenderThread:16113 [sender.py:send_request():196] send_request: stop_status
wandb/run-20220127_121247-o8za41vn/run-o8za41vn.wandb CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ce51920493abfdd6f8c20bb5dadf885dd174b330e45662d25309f02612bcce4a
3
- size 108003400
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b1325f4f981fdb166ae08bcecbf0894cfe7a4093b3efe3a8a7509ae21be9b3b0
3
+ size 111436117