ahcene-ikram commited on
Commit
dddf763
1 Parent(s): 4c15efa

Training in progress, step 6200

Browse files
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5ab0a0d7c152d544fe60943ee5fbb3e4454079ce469e6d567daca14901d03ed2
3
  size 485755120
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fc2df4f0edbe4614e8fe8dd8bd43468121c1df39e9e41d9691aa7489561ec977
3
  size 485755120
runs/Jun02_18-00-16_a8697b0bf589/events.out.tfevents.1717351229.a8697b0bf589.34.0 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7092dab98759e5795b3a8dd649a3c66a7e828a149dda061b025d9ba377d1bb22
3
- size 268060
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eb2915f37fa70e38beb04bbda38a1ccaae02ce9f18b3a6640c8db9db02f94a9a
3
+ size 268904
wandb/debug-internal.log CHANGED
@@ -2778,3 +2778,88 @@ subprocess.TimeoutExpired: Command '['conda', 'env', 'export']' timed out after
2778
  2024-06-02 19:26:14,829 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: internal_messages
2779
  2024-06-02 19:26:14,829 DEBUG SenderThread:121 [sender.py:send_request():406] send_request: stop_status
2780
  2024-06-02 19:26:19,046 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
2778
  2024-06-02 19:26:14,829 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: internal_messages
2779
  2024-06-02 19:26:14,829 DEBUG SenderThread:121 [sender.py:send_request():406] send_request: stop_status
2780
  2024-06-02 19:26:19,046 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2781
+ 2024-06-02 19:26:24,047 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2782
+ 2024-06-02 19:26:27,998 DEBUG SenderThread:121 [sender.py:send():379] send: stats
2783
+ 2024-06-02 19:26:29,830 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: internal_messages
2784
+ 2024-06-02 19:26:29,831 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: stop_status
2785
+ 2024-06-02 19:26:29,832 DEBUG SenderThread:121 [sender.py:send_request():406] send_request: stop_status
2786
+ 2024-06-02 19:26:29,832 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2787
+ 2024-06-02 19:26:35,028 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2788
+ 2024-06-02 19:26:40,029 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2789
+ 2024-06-02 19:26:40,596 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: partial_history
2790
+ 2024-06-02 19:26:40,597 DEBUG SenderThread:121 [sender.py:send():379] send: history
2791
+ 2024-06-02 19:26:40,597 DEBUG SenderThread:121 [sender.py:send_request():406] send_request: summary_record
2792
+ 2024-06-02 19:26:40,598 INFO SenderThread:121 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
2793
+ 2024-06-02 19:26:40,734 INFO Thread-12 :121 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240602_180426-ocheitu1/files/wandb-summary.json
2794
+ 2024-06-02 19:26:44,828 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: stop_status
2795
+ 2024-06-02 19:26:44,829 DEBUG SenderThread:121 [sender.py:send_request():406] send_request: stop_status
2796
+ 2024-06-02 19:26:44,831 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: internal_messages
2797
+ 2024-06-02 19:26:45,985 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2798
+ 2024-06-02 19:26:50,986 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2799
+ 2024-06-02 19:26:55,987 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2800
+ 2024-06-02 19:26:57,998 DEBUG SenderThread:121 [sender.py:send():379] send: stats
2801
+ 2024-06-02 19:26:59,829 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: stop_status
2802
+ 2024-06-02 19:26:59,829 DEBUG SenderThread:121 [sender.py:send_request():406] send_request: stop_status
2803
+ 2024-06-02 19:26:59,869 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: internal_messages
2804
+ 2024-06-02 19:27:00,996 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2805
+ 2024-06-02 19:27:05,997 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2806
+ 2024-06-02 19:27:10,998 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2807
+ 2024-06-02 19:27:14,829 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: stop_status
2808
+ 2024-06-02 19:27:14,829 DEBUG SenderThread:121 [sender.py:send_request():406] send_request: stop_status
2809
+ 2024-06-02 19:27:14,869 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: internal_messages
2810
+ 2024-06-02 19:27:16,059 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2811
+ 2024-06-02 19:27:20,508 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: partial_history
2812
+ 2024-06-02 19:27:20,513 DEBUG SenderThread:121 [sender.py:send():379] send: history
2813
+ 2024-06-02 19:27:20,513 DEBUG SenderThread:121 [sender.py:send_request():406] send_request: summary_record
2814
+ 2024-06-02 19:27:20,513 INFO SenderThread:121 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
2815
+ 2024-06-02 19:27:20,750 INFO Thread-12 :121 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240602_180426-ocheitu1/files/wandb-summary.json
2816
+ 2024-06-02 19:27:21,514 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2817
+ 2024-06-02 19:27:26,515 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2818
+ 2024-06-02 19:27:28,000 DEBUG SenderThread:121 [sender.py:send():379] send: stats
2819
+ 2024-06-02 19:27:29,829 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: stop_status
2820
+ 2024-06-02 19:27:29,829 DEBUG SenderThread:121 [sender.py:send_request():406] send_request: stop_status
2821
+ 2024-06-02 19:27:29,831 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: internal_messages
2822
+ 2024-06-02 19:27:32,019 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2823
+ 2024-06-02 19:27:37,020 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2824
+ 2024-06-02 19:27:42,021 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2825
+ 2024-06-02 19:27:44,829 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: stop_status
2826
+ 2024-06-02 19:27:44,830 DEBUG SenderThread:121 [sender.py:send_request():406] send_request: stop_status
2827
+ 2024-06-02 19:27:44,870 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: internal_messages
2828
+ 2024-06-02 19:27:48,014 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2829
+ 2024-06-02 19:27:53,015 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2830
+ 2024-06-02 19:27:58,000 DEBUG SenderThread:121 [sender.py:send():379] send: stats
2831
+ 2024-06-02 19:27:59,001 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2832
+ 2024-06-02 19:27:59,726 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: partial_history
2833
+ 2024-06-02 19:27:59,727 DEBUG SenderThread:121 [sender.py:send():379] send: history
2834
+ 2024-06-02 19:27:59,727 DEBUG SenderThread:121 [sender.py:send_request():406] send_request: summary_record
2835
+ 2024-06-02 19:27:59,727 INFO SenderThread:121 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
2836
+ 2024-06-02 19:27:59,764 INFO Thread-12 :121 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240602_180426-ocheitu1/files/wandb-summary.json
2837
+ 2024-06-02 19:27:59,829 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: stop_status
2838
+ 2024-06-02 19:27:59,830 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: internal_messages
2839
+ 2024-06-02 19:27:59,830 DEBUG SenderThread:121 [sender.py:send_request():406] send_request: stop_status
2840
+ 2024-06-02 19:28:04,054 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2841
+ 2024-06-02 19:28:09,055 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2842
+ 2024-06-02 19:28:14,056 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2843
+ 2024-06-02 19:28:14,829 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: stop_status
2844
+ 2024-06-02 19:28:14,830 DEBUG SenderThread:121 [sender.py:send_request():406] send_request: stop_status
2845
+ 2024-06-02 19:28:14,870 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: internal_messages
2846
+ 2024-06-02 19:28:20,016 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2847
+ 2024-06-02 19:28:25,017 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2848
+ 2024-06-02 19:28:28,002 DEBUG SenderThread:121 [sender.py:send():379] send: stats
2849
+ 2024-06-02 19:28:29,830 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: stop_status
2850
+ 2024-06-02 19:28:29,830 DEBUG SenderThread:121 [sender.py:send_request():406] send_request: stop_status
2851
+ 2024-06-02 19:28:29,870 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: internal_messages
2852
+ 2024-06-02 19:28:30,035 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2853
+ 2024-06-02 19:28:35,036 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2854
+ 2024-06-02 19:28:37,846 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: partial_history
2855
+ 2024-06-02 19:28:37,847 DEBUG SenderThread:121 [sender.py:send():379] send: history
2856
+ 2024-06-02 19:28:37,847 DEBUG SenderThread:121 [sender.py:send_request():406] send_request: summary_record
2857
+ 2024-06-02 19:28:37,847 INFO SenderThread:121 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
2858
+ 2024-06-02 19:28:38,779 INFO Thread-12 :121 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240602_180426-ocheitu1/files/wandb-summary.json
2859
+ 2024-06-02 19:28:40,848 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2860
+ 2024-06-02 19:28:43,781 INFO Thread-12 :121 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240602_180426-ocheitu1/files/output.log
2861
+ 2024-06-02 19:28:44,830 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: stop_status
2862
+ 2024-06-02 19:28:44,830 DEBUG SenderThread:121 [sender.py:send_request():406] send_request: stop_status
2863
+ 2024-06-02 19:28:44,833 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: internal_messages
2864
+ 2024-06-02 19:28:46,009 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2865
+ 2024-06-02 19:28:51,010 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
wandb/run-20240602_180426-ocheitu1/files/output.log CHANGED
@@ -60,4 +60,6 @@
60
  warnings.warn('Was asked to gather along dimension 0, but all '
61
  /opt/conda/lib/python3.10/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
62
  warnings.warn('Was asked to gather along dimension 0, but all '
 
 
63
  /opt/conda/lib/python3.10/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
 
60
  warnings.warn('Was asked to gather along dimension 0, but all '
61
  /opt/conda/lib/python3.10/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
62
  warnings.warn('Was asked to gather along dimension 0, but all '
63
+ /opt/conda/lib/python3.10/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
64
+ warnings.warn('Was asked to gather along dimension 0, but all '
65
  /opt/conda/lib/python3.10/site-packages/torch/nn/parallel/_functions.py:68: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
wandb/run-20240602_180426-ocheitu1/files/wandb-summary.json CHANGED
@@ -1 +1 @@
1
- {"train/loss": 5.5926, "train/grad_norm": 11.566508293151855, "train/learning_rate": 4.4154325798908804e-05, "train/epoch": 2.34, "train/global_step": 6000, "_timestamp": 1717356358.8887088, "_runtime": 4892.206352710724, "_step": 119}
 
1
+ {"train/loss": 5.6575, "train/grad_norm": 7.975935459136963, "train/learning_rate": 4.395946999220577e-05, "train/epoch": 2.42, "train/global_step": 6200, "_timestamp": 1717356517.8455453, "_runtime": 5051.163189172745, "_step": 123}
wandb/run-20240602_180426-ocheitu1/logs/debug-internal.log CHANGED
@@ -2778,3 +2778,88 @@ subprocess.TimeoutExpired: Command '['conda', 'env', 'export']' timed out after
2778
  2024-06-02 19:26:14,829 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: internal_messages
2779
  2024-06-02 19:26:14,829 DEBUG SenderThread:121 [sender.py:send_request():406] send_request: stop_status
2780
  2024-06-02 19:26:19,046 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
2778
  2024-06-02 19:26:14,829 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: internal_messages
2779
  2024-06-02 19:26:14,829 DEBUG SenderThread:121 [sender.py:send_request():406] send_request: stop_status
2780
  2024-06-02 19:26:19,046 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2781
+ 2024-06-02 19:26:24,047 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2782
+ 2024-06-02 19:26:27,998 DEBUG SenderThread:121 [sender.py:send():379] send: stats
2783
+ 2024-06-02 19:26:29,830 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: internal_messages
2784
+ 2024-06-02 19:26:29,831 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: stop_status
2785
+ 2024-06-02 19:26:29,832 DEBUG SenderThread:121 [sender.py:send_request():406] send_request: stop_status
2786
+ 2024-06-02 19:26:29,832 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2787
+ 2024-06-02 19:26:35,028 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2788
+ 2024-06-02 19:26:40,029 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2789
+ 2024-06-02 19:26:40,596 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: partial_history
2790
+ 2024-06-02 19:26:40,597 DEBUG SenderThread:121 [sender.py:send():379] send: history
2791
+ 2024-06-02 19:26:40,597 DEBUG SenderThread:121 [sender.py:send_request():406] send_request: summary_record
2792
+ 2024-06-02 19:26:40,598 INFO SenderThread:121 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
2793
+ 2024-06-02 19:26:40,734 INFO Thread-12 :121 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240602_180426-ocheitu1/files/wandb-summary.json
2794
+ 2024-06-02 19:26:44,828 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: stop_status
2795
+ 2024-06-02 19:26:44,829 DEBUG SenderThread:121 [sender.py:send_request():406] send_request: stop_status
2796
+ 2024-06-02 19:26:44,831 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: internal_messages
2797
+ 2024-06-02 19:26:45,985 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2798
+ 2024-06-02 19:26:50,986 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2799
+ 2024-06-02 19:26:55,987 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2800
+ 2024-06-02 19:26:57,998 DEBUG SenderThread:121 [sender.py:send():379] send: stats
2801
+ 2024-06-02 19:26:59,829 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: stop_status
2802
+ 2024-06-02 19:26:59,829 DEBUG SenderThread:121 [sender.py:send_request():406] send_request: stop_status
2803
+ 2024-06-02 19:26:59,869 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: internal_messages
2804
+ 2024-06-02 19:27:00,996 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2805
+ 2024-06-02 19:27:05,997 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2806
+ 2024-06-02 19:27:10,998 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2807
+ 2024-06-02 19:27:14,829 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: stop_status
2808
+ 2024-06-02 19:27:14,829 DEBUG SenderThread:121 [sender.py:send_request():406] send_request: stop_status
2809
+ 2024-06-02 19:27:14,869 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: internal_messages
2810
+ 2024-06-02 19:27:16,059 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2811
+ 2024-06-02 19:27:20,508 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: partial_history
2812
+ 2024-06-02 19:27:20,513 DEBUG SenderThread:121 [sender.py:send():379] send: history
2813
+ 2024-06-02 19:27:20,513 DEBUG SenderThread:121 [sender.py:send_request():406] send_request: summary_record
2814
+ 2024-06-02 19:27:20,513 INFO SenderThread:121 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
2815
+ 2024-06-02 19:27:20,750 INFO Thread-12 :121 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240602_180426-ocheitu1/files/wandb-summary.json
2816
+ 2024-06-02 19:27:21,514 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2817
+ 2024-06-02 19:27:26,515 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2818
+ 2024-06-02 19:27:28,000 DEBUG SenderThread:121 [sender.py:send():379] send: stats
2819
+ 2024-06-02 19:27:29,829 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: stop_status
2820
+ 2024-06-02 19:27:29,829 DEBUG SenderThread:121 [sender.py:send_request():406] send_request: stop_status
2821
+ 2024-06-02 19:27:29,831 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: internal_messages
2822
+ 2024-06-02 19:27:32,019 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2823
+ 2024-06-02 19:27:37,020 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2824
+ 2024-06-02 19:27:42,021 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2825
+ 2024-06-02 19:27:44,829 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: stop_status
2826
+ 2024-06-02 19:27:44,830 DEBUG SenderThread:121 [sender.py:send_request():406] send_request: stop_status
2827
+ 2024-06-02 19:27:44,870 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: internal_messages
2828
+ 2024-06-02 19:27:48,014 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2829
+ 2024-06-02 19:27:53,015 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2830
+ 2024-06-02 19:27:58,000 DEBUG SenderThread:121 [sender.py:send():379] send: stats
2831
+ 2024-06-02 19:27:59,001 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2832
+ 2024-06-02 19:27:59,726 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: partial_history
2833
+ 2024-06-02 19:27:59,727 DEBUG SenderThread:121 [sender.py:send():379] send: history
2834
+ 2024-06-02 19:27:59,727 DEBUG SenderThread:121 [sender.py:send_request():406] send_request: summary_record
2835
+ 2024-06-02 19:27:59,727 INFO SenderThread:121 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
2836
+ 2024-06-02 19:27:59,764 INFO Thread-12 :121 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240602_180426-ocheitu1/files/wandb-summary.json
2837
+ 2024-06-02 19:27:59,829 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: stop_status
2838
+ 2024-06-02 19:27:59,830 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: internal_messages
2839
+ 2024-06-02 19:27:59,830 DEBUG SenderThread:121 [sender.py:send_request():406] send_request: stop_status
2840
+ 2024-06-02 19:28:04,054 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2841
+ 2024-06-02 19:28:09,055 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2842
+ 2024-06-02 19:28:14,056 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2843
+ 2024-06-02 19:28:14,829 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: stop_status
2844
+ 2024-06-02 19:28:14,830 DEBUG SenderThread:121 [sender.py:send_request():406] send_request: stop_status
2845
+ 2024-06-02 19:28:14,870 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: internal_messages
2846
+ 2024-06-02 19:28:20,016 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2847
+ 2024-06-02 19:28:25,017 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2848
+ 2024-06-02 19:28:28,002 DEBUG SenderThread:121 [sender.py:send():379] send: stats
2849
+ 2024-06-02 19:28:29,830 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: stop_status
2850
+ 2024-06-02 19:28:29,830 DEBUG SenderThread:121 [sender.py:send_request():406] send_request: stop_status
2851
+ 2024-06-02 19:28:29,870 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: internal_messages
2852
+ 2024-06-02 19:28:30,035 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2853
+ 2024-06-02 19:28:35,036 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2854
+ 2024-06-02 19:28:37,846 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: partial_history
2855
+ 2024-06-02 19:28:37,847 DEBUG SenderThread:121 [sender.py:send():379] send: history
2856
+ 2024-06-02 19:28:37,847 DEBUG SenderThread:121 [sender.py:send_request():406] send_request: summary_record
2857
+ 2024-06-02 19:28:37,847 INFO SenderThread:121 [sender.py:_save_file():1390] saving file wandb-summary.json with policy end
2858
+ 2024-06-02 19:28:38,779 INFO Thread-12 :121 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240602_180426-ocheitu1/files/wandb-summary.json
2859
+ 2024-06-02 19:28:40,848 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2860
+ 2024-06-02 19:28:43,781 INFO Thread-12 :121 [dir_watcher.py:_on_file_modified():288] file/dir modified: /kaggle/working/wandb/run-20240602_180426-ocheitu1/files/output.log
2861
+ 2024-06-02 19:28:44,830 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: stop_status
2862
+ 2024-06-02 19:28:44,830 DEBUG SenderThread:121 [sender.py:send_request():406] send_request: stop_status
2863
+ 2024-06-02 19:28:44,833 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: internal_messages
2864
+ 2024-06-02 19:28:46,009 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
2865
+ 2024-06-02 19:28:51,010 DEBUG HandlerThread:121 [handler.py:handle_request():146] handle_request: status_report
wandb/run-20240602_180426-ocheitu1/run-ocheitu1.wandb CHANGED
Binary files a/wandb/run-20240602_180426-ocheitu1/run-ocheitu1.wandb and b/wandb/run-20240602_180426-ocheitu1/run-ocheitu1.wandb differ