2024-02-18 17:17:17,209 INFO MainThread:3204 [wandb_setup.py:_flush():76] Current SDK version is 0.16.3 2024-02-18 17:17:17,209 INFO MainThread:3204 [wandb_setup.py:_flush():76] Configure stats pid to 3204 2024-02-18 17:17:17,209 INFO MainThread:3204 [wandb_setup.py:_flush():76] Loading settings from /home/ubuntu/.config/wandb/settings 2024-02-18 17:17:17,209 INFO MainThread:3204 [wandb_setup.py:_flush():76] Loading settings from /home/ubuntu/torchtune-colorful-llama/colorful/wandb/settings 2024-02-18 17:17:17,210 INFO MainThread:3204 [wandb_setup.py:_flush():76] Loading settings from environment variables: {'api_key': '***REDACTED***'} 2024-02-18 17:17:17,210 INFO MainThread:3204 [wandb_setup.py:_flush():76] Applying setup settings: {'_disable_service': False} 2024-02-18 17:17:17,210 INFO MainThread:3204 [wandb_setup.py:_flush():76] Inferring run settings from compute environment: {'program_relpath': 'colorful/full_finetune.py', 'program_abspath': '/home/ubuntu/torchtune-colorful-llama/colorful/full_finetune.py', 'program': '/home/ubuntu/torchtune-colorful-llama/colorful/./full_finetune.py'} 2024-02-18 17:17:17,210 INFO MainThread:3204 [wandb_init.py:_log_setup():526] Logging user logs to /home/ubuntu/torchtune-colorful-llama/colorful/wandb/run-20240218_171717-bm22a3e4/logs/debug.log 2024-02-18 17:17:17,210 INFO MainThread:3204 [wandb_init.py:_log_setup():527] Logging internal logs to /home/ubuntu/torchtune-colorful-llama/colorful/wandb/run-20240218_171717-bm22a3e4/logs/debug-internal.log 2024-02-18 17:17:17,210 INFO MainThread:3204 [wandb_init.py:init():566] calling init triggers 2024-02-18 17:17:17,210 INFO MainThread:3204 [wandb_init.py:init():573] wandb.init called with sweep_config: {} config: {'log_dir': 'output/alpaca-colorful-llama2-finetune'} 2024-02-18 17:17:17,210 INFO MainThread:3204 [wandb_init.py:init():616] starting backend 2024-02-18 17:17:17,210 INFO MainThread:3204 [wandb_init.py:init():620] setting up manager 2024-02-18 17:17:17,213 INFO MainThread:3204 [backend.py:_multiprocessing_setup():105] multiprocessing start_methods=fork,spawn,forkserver, using: spawn 2024-02-18 17:17:17,216 INFO MainThread:3204 [wandb_init.py:init():628] backend started and connected 2024-02-18 17:17:17,220 INFO MainThread:3204 [wandb_init.py:init():720] updated telemetry 2024-02-18 17:17:17,229 INFO MainThread:3204 [wandb_init.py:init():753] communicating run to backend with 90.0 second timeout 2024-02-18 17:17:17,660 INFO MainThread:3204 [wandb_run.py:_on_init():2262] communicating current version 2024-02-18 17:17:17,912 INFO MainThread:3204 [wandb_run.py:_on_init():2271] got version response 2024-02-18 17:17:17,912 INFO MainThread:3204 [wandb_init.py:init():804] starting run threads in backend 2024-02-18 17:17:18,084 INFO MainThread:3204 [wandb_run.py:_console_start():2241] atexit reg 2024-02-18 17:17:18,085 INFO MainThread:3204 [wandb_run.py:_redirect():2096] redirect: wrap_raw 2024-02-18 17:17:18,085 INFO MainThread:3204 [wandb_run.py:_redirect():2161] Wrapping output streams. 2024-02-18 17:17:18,086 INFO MainThread:3204 [wandb_run.py:_redirect():2186] Redirects installed. 2024-02-18 17:17:18,088 INFO MainThread:3204 [wandb_init.py:init():847] run started, returning control to user process 2024-02-18 22:34:45,248 INFO MainThread:3204 [wandb_run.py:_finish():1970] finishing run laurence_r/colorful-llama/bm22a3e4 2024-02-18 22:34:45,249 INFO MainThread:3204 [wandb_run.py:_atexit_cleanup():2210] got exitcode: 0 2024-02-18 22:34:45,249 INFO MainThread:3204 [wandb_run.py:_restore():2193] restore 2024-02-18 22:34:45,249 INFO MainThread:3204 [wandb_run.py:_restore():2199] restore done 2024-02-18 22:34:51,558 INFO MainThread:3204 [wandb_run.py:_footer_history_summary_info():3866] rendering history 2024-02-18 22:34:51,559 INFO MainThread:3204 [wandb_run.py:_footer_history_summary_info():3898] rendering summary 2024-02-18 22:34:51,566 INFO MainThread:3204 [wandb_run.py:_footer_sync_info():3825] logging synced files