Training in progress, step 1000

pytorch_model.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:c5eeb7897ad6cbe8e3e085ae4a0f42c6a084811bce3a504e25737455e164653a
+oid sha256:0d85ffcde3dc196127ff875ccdf30a5e4b75c15ff1b1e16da1e554e52e7a9791
 size 1262075377

runs/Feb02_22-30-13_brutasse/events.out.tfevents.1643841025.brutasse.21084.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:594838aadfc207129a42efdcea909d0eacd2e7a7e6880b7dd38b497707240650
-size 5781
+oid sha256:8e75f5271956fb42b97c6e862045d50b84b9f7f712b36b55ae92516756a06a0b
+size 6884

wandb/run-20220202_223026-1j0459xm/files/config.yaml

@@ -4782,6 +4782,26 @@ _wandb:
       5: 1
       6:
       - 1
+    - 1: eval/loss
+      5: 1
+      6:
+      - 1
+    - 1: eval/wer
+      5: 1
+      6:
+      - 1
+    - 1: eval/runtime
+      5: 1
+      6:
+      - 1
+    - 1: eval/samples_per_second
+      5: 1
+      6:
+      - 1
+    - 1: eval/steps_per_second
+      5: 1
+      6:
+      - 1
     python_version: 3.8.12
     start_time: 1643841026
     t:

wandb/run-20220202_223026-1j0459xm/files/output.log

@@ -403,3 +403,407 @@ Configuration saved in ./checkpoint-500/config.json
 {'eval_loss': 3.335383415222168, 'eval_wer': 1.0, 'eval_runtime': 191.0801, 'eval_samples_per_second': 25.345, 'eval_steps_per_second': 3.171, 'epoch': 1.37}
 Model weights saved in ./checkpoint-500/pytorch_model.bin
 Configuration saved in ./checkpoint-500/preprocessor_config.json
+Configuration saved in ./preprocessor_config.json
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+  3%|█▋                                                  | 598/18250 [15:32<5:14:11,  1.07s/it]
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+  4%|█▉                                                  | 699/18250 [17:33<5:09:45,  1.06s/it]
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+  4%|██▎                                                 | 799/18250 [19:36<6:38:28,  1.37s/it]
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+  5%|██▌                                                 | 899/18250 [21:37<6:30:30,  1.35s/it]
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+  5%|██▊                                                | 1000/18250 [23:38<6:23:33,  1.33s/it]The following columns in the evaluation set  don't have a corresponding argument in `Wav2Vec2ForCTC.forward` and have been ignored: input_length. If input_length are not expected by `Wav2Vec2ForCTC.forward`,  you can safely ignore this message.
+***** Running Evaluation *****
+  Num examples = 4843
+  Batch size = 8
+  0%|                                                                  | 0/606 [00:00<?, ?it/s]
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+Configuration saved in ./checkpoint-1000/config.json
+{'eval_loss': 2.93613600730896, 'eval_wer': 1.0000283848992335, 'eval_runtime': 191.7956, 'eval_samples_per_second': 25.251, 'eval_steps_per_second': 3.16, 'epoch': 2.74}
+Model weights saved in ./checkpoint-1000/pytorch_model.bin
+Configuration saved in ./checkpoint-1000/preprocessor_config.json