2024-07-10 18:12:07 | INFO | model_worker | args: Namespace(host='0.0.0.0', port=40007, worker_address='http://10.140.60.182:40007', controller_address='http://10.140.60.209:10075', model_path='share_internvl/InternVL2-78B/', model_name=None, device='auto', limit_model_concurrency=5, stream_interval=1, load_8bit=False)
2024-07-10 18:12:07 | INFO | model_worker | Loading the model InternVL2-78B on worker 55a7c0 ...
2024-07-10 18:12:08 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
2024-07-10 18:12:08 | WARNING | transformers.tokenization_utils_base | Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.
2024-07-10 18:12:18 | ERROR | stderr | 
Loading checkpoint shards:   0%|          | 0/33 [00:00<?, ?it/s]
2024-07-10 18:12:20 | ERROR | stderr | 
Loading checkpoint shards:   3%|▎         | 1/33 [00:02<01:06,  2.09s/it]
2024-07-10 18:12:22 | ERROR | stderr | 
Loading checkpoint shards:   6%|▌         | 2/33 [00:04<01:03,  2.05s/it]
2024-07-10 18:12:24 | ERROR | stderr | 
Loading checkpoint shards:   9%|▉         | 3/33 [00:06<01:00,  2.02s/it]
2024-07-10 18:12:26 | ERROR | stderr | 
Loading checkpoint shards:  12%|█▏        | 4/33 [00:08<00:58,  2.02s/it]
2024-07-10 18:12:28 | ERROR | stderr | 
Loading checkpoint shards:  15%|█▌        | 5/33 [00:10<00:55,  1.98s/it]
2024-07-10 18:12:30 | ERROR | stderr | 
Loading checkpoint shards:  18%|█▊        | 6/33 [00:12<00:53,  2.00s/it]
2024-07-10 18:12:32 | ERROR | stderr | 
Loading checkpoint shards:  21%|██        | 7/33 [00:14<00:51,  1.98s/it]
2024-07-10 18:12:34 | ERROR | stderr | 
Loading checkpoint shards:  24%|██▍       | 8/33 [00:15<00:49,  1.96s/it]
2024-07-10 18:12:36 | ERROR | stderr | 
Loading checkpoint shards:  27%|██▋       | 9/33 [00:17<00:47,  1.96s/it]
2024-07-10 18:12:38 | ERROR | stderr | 
Loading checkpoint shards:  30%|███       | 10/33 [00:19<00:44,  1.94s/it]
2024-07-10 18:12:40 | ERROR | stderr | 
Loading checkpoint shards:  33%|███▎      | 11/33 [00:22<00:46,  2.10s/it]
2024-07-10 18:12:42 | ERROR | stderr | 
Loading checkpoint shards:  36%|███▋      | 12/33 [00:24<00:42,  2.00s/it]
2024-07-10 18:12:44 | ERROR | stderr | 
Loading checkpoint shards:  39%|███▉      | 13/33 [00:26<00:41,  2.06s/it]
2024-07-10 18:12:46 | ERROR | stderr | 
Loading checkpoint shards:  42%|████▏     | 14/33 [00:28<00:38,  2.01s/it]
2024-07-10 18:12:48 | ERROR | stderr | 
Loading checkpoint shards:  45%|████▌     | 15/33 [00:29<00:34,  1.94s/it]
2024-07-10 18:12:50 | ERROR | stderr | 
Loading checkpoint shards:  48%|████▊     | 16/33 [00:32<00:34,  2.04s/it]
2024-07-10 18:12:52 | ERROR | stderr | 
Loading checkpoint shards:  52%|█████▏    | 17/33 [00:33<00:31,  1.98s/it]
2024-07-10 18:12:54 | ERROR | stderr | 
Loading checkpoint shards:  55%|█████▍    | 18/33 [00:35<00:28,  1.90s/it]
2024-07-10 18:12:55 | ERROR | stderr | 
Loading checkpoint shards:  58%|█████▊    | 19/33 [00:37<00:26,  1.86s/it]
2024-07-10 18:12:57 | ERROR | stderr | 
Loading checkpoint shards:  61%|██████    | 20/33 [00:39<00:23,  1.80s/it]
2024-07-10 18:12:59 | ERROR | stderr | 
Loading checkpoint shards:  64%|██████▎   | 21/33 [00:41<00:21,  1.82s/it]
2024-07-10 18:13:01 | ERROR | stderr | 
Loading checkpoint shards:  67%|██████▋   | 22/33 [00:42<00:20,  1.84s/it]
2024-07-10 18:13:02 | ERROR | stderr | 
Loading checkpoint shards:  70%|██████▉   | 23/33 [00:44<00:17,  1.80s/it]
2024-07-10 18:13:04 | ERROR | stderr | 
Loading checkpoint shards:  73%|███████▎  | 24/33 [00:46<00:16,  1.82s/it]
2024-07-10 18:13:06 | ERROR | stderr | 
Loading checkpoint shards:  76%|███████▌  | 25/33 [00:48<00:14,  1.79s/it]
2024-07-10 18:13:08 | ERROR | stderr | 
Loading checkpoint shards:  79%|███████▉  | 26/33 [00:49<00:12,  1.79s/it]
2024-07-10 18:13:09 | ERROR | stderr | 
Loading checkpoint shards:  82%|████████▏ | 27/33 [00:51<00:10,  1.75s/it]
2024-07-10 18:13:11 | ERROR | stderr | 
Loading checkpoint shards:  85%|████████▍ | 28/33 [00:53<00:08,  1.74s/it]
2024-07-10 18:13:13 | ERROR | stderr | 
Loading checkpoint shards:  88%|████████▊ | 29/33 [00:55<00:06,  1.71s/it]
2024-07-10 18:13:15 | ERROR | stderr | 
Loading checkpoint shards:  91%|█████████ | 30/33 [00:56<00:05,  1.73s/it]
2024-07-10 18:13:16 | ERROR | stderr | 
Loading checkpoint shards:  94%|█████████▍| 31/33 [00:58<00:03,  1.73s/it]
2024-07-10 18:13:18 | ERROR | stderr | 
Loading checkpoint shards:  97%|█████████▋| 32/33 [00:59<00:01,  1.63s/it]
2024-07-10 18:13:19 | ERROR | stderr | 
Loading checkpoint shards: 100%|██████████| 33/33 [01:00<00:00,  1.45s/it]
2024-07-10 18:13:19 | ERROR | stderr | 
Loading checkpoint shards: 100%|██████████| 33/33 [01:00<00:00,  1.85s/it]
2024-07-10 18:13:19 | ERROR | stderr | 
2024-07-10 18:13:20 | INFO | model_worker | Register to controller
2024-07-10 18:13:20 | ERROR | stderr | INFO:     Started server process [118893]
2024-07-10 18:13:20 | ERROR | stderr | INFO:     Waiting for application startup.
2024-07-10 18:13:20 | ERROR | stderr | INFO:     Application startup complete.
2024-07-10 18:13:20 | ERROR | stderr | INFO:     Uvicorn running on http://0.0.0.0:40007 (Press CTRL+C to quit)
2024-07-10 18:13:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: None. global_counter: 0
2024-07-10 18:13:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: None. global_counter: 0
2024-07-10 18:14:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: None. global_counter: 0
2024-07-10 18:14:20 | INFO | stdout | INFO:     10.140.60.209:37325 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:14:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: None. global_counter: 0
2024-07-10 18:14:23 | INFO | stdout | INFO:     10.140.60.209:37342 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:14:24 | INFO | stdout | INFO:     10.140.60.209:37360 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:14:25 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
2024-07-10 18:14:25 | INFO | stdout | INFO:     10.140.60.209:37366 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-07-10 18:14:25 | INFO | stdout | history: []
2024-07-10 18:14:25 | INFO | stdout | question: Image-1: <image>
2024-07-10 18:14:25 | INFO | stdout | Describe this image in detail.
2024-07-10 18:14:25 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=1024x1024 at 0x7FC66068B5E0>]
2024-07-10 18:14:25 | INFO | model_worker | dynamic_image_size: True
2024-07-10 18:14:25 | INFO | model_worker | use_thumbnail: True
2024-07-10 18:14:25 | INFO | model_worker | Resize images to 448x448
2024-07-10 18:14:25 | INFO | model_worker | Split images to torch.Size([10, 3, 448, 448])
2024-07-10 18:14:26 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
2024-07-10 18:14:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
2024-07-10 18:14:36 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:14:36 | INFO | stdout | INFO:     10.140.60.209:37396 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:14:37 | INFO | stdout | INFO:     10.140.60.209:37414 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:14:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:15:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:15:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:15:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:15:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:16:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:16:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:16:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:16:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:16:57 | INFO | stdout | INFO:     10.140.60.209:37808 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:17:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:17:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:17:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:17:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:18:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:18:13 | INFO | stdout | INFO:     10.140.60.209:38064 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:18:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:18:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:18:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:19:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:19:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:19:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:19:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:20:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:20:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:20:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:20:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:21:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:21:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:21:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:21:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:22:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:22:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:22:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:22:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:23:05 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:23:20 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:23:36 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:23:51 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:24:06 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:24:21 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:24:36 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:24:42 | INFO | stdout | INFO:     10.140.60.209:39396 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:24:51 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:24:57 | INFO | stdout | INFO:     10.140.60.209:39422 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:25:03 | INFO | stdout | INFO:     10.140.60.209:39442 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:25:06 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:25:18 | INFO | stdout | INFO:     10.140.60.209:39598 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:25:21 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:25:36 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:25:51 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:26:06 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:26:08 | INFO | stdout | INFO:     10.140.60.209:39676 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:26:16 | INFO | stdout | INFO:     10.140.60.209:39801 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:26:21 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:26:36 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:26:51 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:27:06 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:27:18 | INFO | stdout | INFO:     10.140.60.209:40068 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:27:21 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:27:36 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:27:51 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:28:06 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:28:21 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:28:25 | INFO | stdout | INFO:     10.140.60.209:40316 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:28:36 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:28:51 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:28:56 | INFO | stdout | INFO:     10.140.60.209:40356 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:29:05 | INFO | stdout | INFO:     10.140.60.209:40382 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:29:06 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:29:21 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:29:36 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:29:51 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:30:06 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:30:21 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:30:34 | INFO | stdout | INFO:     10.140.60.209:40778 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:30:36 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:30:40 | INFO | stdout | INFO:     10.140.60.209:40800 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:30:51 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:31:06 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:31:21 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:31:23 | INFO | stdout | INFO:     10.140.60.209:40990 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:31:31 | INFO | stdout | INFO:     10.140.60.209:41010 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:31:36 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:31:51 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:32:02 | INFO | stdout | INFO:     10.140.60.209:41058 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:32:06 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:32:12 | INFO | stdout | INFO:     10.140.60.209:41084 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:32:19 | INFO | stdout | INFO:     10.140.60.209:41268 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:32:21 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:32:22 | INFO | stdout | INFO:     10.140.60.209:41290 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:32:36 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:32:51 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:33:06 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:33:21 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:33:36 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:33:51 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:34:06 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:34:21 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:34:36 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:34:51 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:35:06 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:35:17 | INFO | stdout | INFO:     10.140.60.209:41850 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:35:21 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:35:25 | INFO | stdout | INFO:     10.140.60.209:41903 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:35:36 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:35:51 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:36:07 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:36:22 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:36:37 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:36:52 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:37:07 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:37:22 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:37:37 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:37:52 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:38:07 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:38:22 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:38:37 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:38:52 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:39:07 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:39:22 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:39:37 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:39:52 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:39:57 | INFO | stdout | INFO:     10.140.60.209:42698 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:40:07 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:40:22 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:40:37 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:40:52 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:40:59 | INFO | stdout | INFO:     10.140.60.209:42954 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:41:02 | INFO | stdout | INFO:     10.140.60.209:42974 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:41:03 | INFO | stdout | INFO:     10.140.60.209:42998 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:41:04 | INFO | stdout | INFO:     10.140.60.209:43018 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:41:06 | INFO | stdout | INFO:     10.140.60.209:43038 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:41:07 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:41:08 | INFO | stdout | INFO:     10.140.60.209:43060 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:41:13 | INFO | stdout | INFO:     10.140.60.209:43125 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:41:14 | INFO | stdout | INFO:     10.140.60.209:43158 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:41:22 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:41:37 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:41:52 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:42:07 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:42:15 | INFO | stdout | INFO:     10.140.60.209:43408 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:42:22 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:42:30 | INFO | stdout | INFO:     10.140.60.209:43512 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:42:37 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:42:38 | INFO | stdout | INFO:     10.140.60.209:43540 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:42:48 | INFO | stdout | INFO:     10.140.60.209:43576 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:42:52 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:42:58 | INFO | stdout | INFO:     10.140.60.209:43604 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:43:07 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:43:22 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:43:24 | INFO | stdout | INFO:     10.140.60.209:43792 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:43:25 | INFO | stdout | INFO:     10.140.60.209:43812 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:43:30 | INFO | stdout | INFO:     10.140.60.209:43834 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:43:34 | INFO | stdout | INFO:     10.140.60.209:43854 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:43:35 | INFO | stdout | INFO:     10.140.60.209:43874 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:43:37 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:43:52 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:43:57 | INFO | stdout | INFO:     10.140.60.209:43910 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:44:07 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:44:22 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:44:37 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:44:52 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:45:07 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:45:22 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:45:37 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:45:52 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:46:02 | INFO | stdout | INFO:     10.140.60.209:44332 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:46:03 | INFO | stdout | INFO:     10.140.60.209:44352 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:46:07 | INFO | stdout | INFO:     10.140.60.209:44372 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:46:07 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:46:21 | INFO | stdout | INFO:     10.140.60.209:44564 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:46:22 | INFO | stdout | INFO:     10.140.60.209:44584 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:46:22 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:46:23 | INFO | stdout | INFO:     10.140.60.209:44604 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:46:28 | INFO | stdout | INFO:     10.140.60.209:44634 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:46:37 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:46:44 | INFO | stdout | INFO:     10.140.60.209:44734 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:46:52 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:46:56 | INFO | stdout | INFO:     10.140.60.209:44778 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:46:59 | INFO | stdout | INFO:     10.140.60.209:44802 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:46:59 | INFO | stdout | INFO:     10.140.60.209:44822 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:47:07 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:47:09 | INFO | stdout | INFO:     10.140.60.209:44848 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:47:14 | INFO | stdout | INFO:     10.140.60.209:44938 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:47:21 | INFO | stdout | INFO:     10.140.60.209:45090 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:47:22 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-07-10 18:47:29 | INFO | stdout | INFO:     10.140.60.209:45126 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:47:32 | INFO | stdout | INFO:     10.140.60.209:45164 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:47:35 | INFO | stdout | INFO:     10.140.60.209:45184 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:47:35 | INFO | stdout | INFO:     10.140.60.209:45204 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:47:35 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 2
2024-07-10 18:47:35 | INFO | stdout | INFO:     10.140.60.209:45222 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-07-10 18:47:35 | INFO | stdout | history: []
2024-07-10 18:47:35 | INFO | stdout | question: Image-1: <image>
2024-07-10 18:47:35 | INFO | stdout | 这是啥
2024-07-10 18:47:35 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=1024x587 at 0x7FC660582B00>]
2024-07-10 18:47:35 | INFO | model_worker | dynamic_image_size: True
2024-07-10 18:47:35 | INFO | model_worker | use_thumbnail: True
2024-07-10 18:47:36 | INFO | model_worker | Resize images to 448x448
2024-07-10 18:47:36 | INFO | model_worker | Split images to torch.Size([7, 3, 448, 448])
2024-07-10 18:47:36 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
2024-07-10 18:47:37 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 2
2024-07-10 18:47:52 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 2
2024-07-10 18:48:07 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 2
2024-07-10 18:48:15 | INFO | stdout | INFO:     10.140.60.209:45390 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:48:22 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 2
2024-07-10 18:48:32 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-10 18:48:37 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-07-10 18:48:47 | INFO | stdout | INFO:     10.140.60.209:45524 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:48:47 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 3
2024-07-10 18:48:47 | INFO | stdout | INFO:     10.140.60.209:45532 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-07-10 18:48:47 | INFO | stdout | history: [['Image-1: <image>\n这是啥', '这是一张展示八只不同品种的狗的照片。这些狗并排坐在一张长椅上，背景是蓝天和绿地。具体来说，这些狗的品种包括：\n\n1. 黑色卷毛狗：可能是贵宾犬（Poodle）。\n2. 棕色长毛狗：可能是德国牧羊犬（German Shepherd）。\n3. 白色长毛狗：可能是西高地白梗犬（West Highland White Terrier）。\n4. 棕色长毛狗：可能是英国可卡犬（English Cocker Spaniel）。\n5. 白色和棕色的狗：可能是比格犬（Beagle）。\n6. 灰色和白色的小狗：可能是法国斗牛犬（French Bulldog）。\n7. 棕色和白色的小狗：可能是法国斗牛犬（French Bulldog）。\n8. 白色和棕色的小狗：可能是比格犬（Beagle）。\n\n这些狗看起来都很健康，而且很享受在户外的时光。']]
2024-07-10 18:48:47 | INFO | stdout | question: 请检测图中所有的狗，并给出坐标框
2024-07-10 18:48:47 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=1024x587 at 0x7FC660583220>]
2024-07-10 18:48:47 | INFO | model_worker | dynamic_image_size: True
2024-07-10 18:48:47 | INFO | model_worker | use_thumbnail: True
2024-07-10 18:48:47 | INFO | model_worker | Resize images to 448x448
2024-07-10 18:48:47 | INFO | model_worker | Split images to torch.Size([7, 3, 448, 448])
2024-07-10 18:48:48 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
2024-07-10 18:48:52 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 3
2024-07-10 18:49:07 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 3
2024-07-10 18:49:12 | INFO | stdout | INFO:     10.140.60.209:45580 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:49:16 | INFO | stdout | INFO:     10.140.60.209:45691 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:49:17 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-07-10 18:49:22 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-07-10 18:49:25 | INFO | stdout | INFO:     10.140.60.209:45772 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:49:36 | INFO | stdout | INFO:     10.140.60.209:45800 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:49:36 | INFO | stdout | INFO:     10.140.60.209:45820 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:49:36 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 4
2024-07-10 18:49:36 | INFO | stdout | INFO:     10.140.60.209:45828 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-07-10 18:49:36 | INFO | stdout | history: []
2024-07-10 18:49:36 | INFO | stdout | question: Image-1: <image>
2024-07-10 18:49:36 | INFO | stdout | 请检测图中所有的物体，并给出坐标框
2024-07-10 18:49:36 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=800x800 at 0x7FC660583700>]
2024-07-10 18:49:36 | INFO | model_worker | dynamic_image_size: True
2024-07-10 18:49:36 | INFO | model_worker | use_thumbnail: True
2024-07-10 18:49:36 | INFO | model_worker | Resize images to 448x448
2024-07-10 18:49:36 | INFO | model_worker | Split images to torch.Size([5, 3, 448, 448])
2024-07-10 18:49:37 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
2024-07-10 18:49:38 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 4
2024-07-10 18:49:53 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 4
2024-07-10 18:50:08 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 4
2024-07-10 18:50:23 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 4
2024-07-10 18:50:38 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 4
2024-07-10 18:50:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 4
2024-07-10 18:50:53 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 4
2024-07-10 18:51:06 | INFO | stdout | INFO:     10.140.60.209:46056 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:51:08 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 4
2024-07-10 18:51:09 | INFO | stdout | INFO:     10.140.60.209:46078 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:51:10 | INFO | stdout | INFO:     10.140.60.209:46098 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:51:13 | INFO | stdout | INFO:     10.140.60.209:46150 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:51:14 | INFO | stdout | INFO:     10.140.60.209:46192 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:51:15 | INFO | stdout | INFO:     10.140.60.209:46240 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:51:18 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 5
2024-07-10 18:51:18 | INFO | stdout | INFO:     10.140.60.209:46319 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-07-10 18:51:18 | INFO | stdout | history: []
2024-07-10 18:51:18 | INFO | stdout | question: Image-1: <image>
2024-07-10 18:51:18 | INFO | stdout | 请检测图中所有的物体，并给出坐标框
2024-07-10 18:51:18 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=5472x3648 at 0x7FC660583C40>]
2024-07-10 18:51:18 | INFO | model_worker | dynamic_image_size: True
2024-07-10 18:51:18 | INFO | model_worker | use_thumbnail: True
2024-07-10 18:51:19 | INFO | model_worker | Resize images to 448x448
2024-07-10 18:51:19 | INFO | model_worker | Split images to torch.Size([7, 3, 448, 448])
2024-07-10 18:51:20 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
2024-07-10 18:51:23 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 5
2024-07-10 18:51:38 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 5
2024-07-10 18:51:53 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 5
2024-07-10 18:51:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 5
2024-07-10 18:52:08 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 5
2024-07-10 18:52:23 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 5
2024-07-10 18:52:38 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 5
2024-07-10 18:52:45 | INFO | stdout | INFO:     10.140.60.209:46744 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:52:48 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 6
2024-07-10 18:52:48 | INFO | stdout | INFO:     10.140.60.209:46754 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-07-10 18:52:48 | INFO | stdout | history: [['Image-1: <image>\n请检测图中所有的物体，并给出坐标框', '好的，我会检测图中所有的物体，并给出坐标框。\n\n```\n<ref>柠檬茶</ref><box>[[382, 404, 619, 783]]</box>\n<ref>玻璃杯</ref><box>[[376, 338, 623, 804]]</box>\n<ref>杯子</ref><box>[[10, 342, 215, 645]]</box>\n<ref>容器，器皿</ref><box>[[0, 673, 677, 1000]]</box>\n<ref>方桌</ref><box>[[0, 584, 998, 1000]]</box>\n```\n']]
2024-07-10 18:52:48 | INFO | stdout | question: 请检测图中的<ref>冰块</ref>
2024-07-10 18:52:48 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=5472x3648 at 0x7FC6605AD0F0>]
2024-07-10 18:52:48 | INFO | model_worker | dynamic_image_size: True
2024-07-10 18:52:48 | INFO | model_worker | use_thumbnail: True
2024-07-10 18:52:49 | INFO | model_worker | Resize images to 448x448
2024-07-10 18:52:49 | INFO | model_worker | Split images to torch.Size([7, 3, 448, 448])
2024-07-10 18:52:50 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
2024-07-10 18:52:53 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 6
2024-07-10 18:52:59 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 6
2024-07-10 18:53:08 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 6
2024-07-10 18:53:08 | INFO | stdout | INFO:     10.140.60.209:46778 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:53:12 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 7
2024-07-10 18:53:12 | INFO | stdout | INFO:     10.140.60.209:46786 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-07-10 18:53:12 | INFO | stdout | history: [['Image-1: <image>\n请检测图中所有的物体，并给出坐标框', '好的，我会检测图中所有的物体，并给出坐标框。\n\n```\n<ref>柠檬茶</ref><box>[[382, 404, 619, 783]]</box>\n<ref>玻璃杯</ref><box>[[376, 338, 623, 804]]</box>\n<ref>杯子</ref><box>[[10, 342, 215, 645]]</box>\n<ref>容器，器皿</ref><box>[[0, 673, 677, 1000]]</box>\n<ref>方桌</ref><box>[[0, 584, 998, 1000]]</box>\n```\n'], ['请检测图中的<ref>冰块</ref>', '图中可以看到四个冰块。其中三个冰块在桌子的右侧，另一个冰块在左侧的木制托盘上。']]
2024-07-10 18:53:12 | INFO | stdout | question: 请检测图中的<ref>冰块</ref>，并输出坐标框
2024-07-10 18:53:12 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=5472x3648 at 0x7FC6605AD720>]
2024-07-10 18:53:12 | INFO | model_worker | dynamic_image_size: True
2024-07-10 18:53:12 | INFO | model_worker | use_thumbnail: True
2024-07-10 18:53:13 | INFO | model_worker | Resize images to 448x448
2024-07-10 18:53:13 | INFO | model_worker | Split images to torch.Size([7, 3, 448, 448])
2024-07-10 18:53:13 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
2024-07-10 18:53:23 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 7
2024-07-10 18:53:38 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 7
2024-07-10 18:53:53 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 7
2024-07-10 18:54:02 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 7
2024-07-10 18:54:08 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 7
2024-07-10 18:54:23 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 7
2024-07-10 18:54:38 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 7
2024-07-10 18:54:53 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 7
2024-07-10 18:54:54 | INFO | stdout | INFO:     10.140.60.209:47354 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:54:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 8
2024-07-10 18:54:58 | INFO | stdout | INFO:     10.140.60.209:47364 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-07-10 18:54:58 | INFO | stdout | history: [['Image-1: <image>\n请检测图中所有的物体，并给出坐标框', '好的，我会检测图中所有的物体，并给出坐标框。\n\n```\n<ref>柠檬茶</ref><box>[[382, 404, 619, 783]]</box>\n<ref>玻璃杯</ref><box>[[376, 338, 623, 804]]</box>\n<ref>杯子</ref><box>[[10, 342, 215, 645]]</box>\n<ref>容器，器皿</ref><box>[[0, 673, 677, 1000]]</box>\n<ref>方桌</ref><box>[[0, 584, 998, 1000]]</box>\n```\n'], ['请检测图中的<ref>冰块</ref>', '图中可以看到四个冰块。其中三个冰块在桌子的右侧，另一个冰块在左侧的木制托盘上。'], ['请检测图中的<ref>冰块</ref>，并输出坐标框', '为了检测图中的冰块并输出坐标框，我们可以使用图像处理技术。以下是每个冰块的坐标框：\n\n1. **冰块1**（在木托盘上）\n   - 左上角坐标：(250, 600)\n   - 右下角坐标：(340, 730)\n\n2. **冰块2**（在木托盘右边）\n   - 左上角坐标：(690, 620)\n   - 右下角坐标：(770, 750)\n\n3. **冰块3**（在背景，靠右）\n   - 左上角坐标：(770, 520)\n   - 右下角坐标：(840, 650)\n\n这些坐标框可以帮助我们定位和识别图中的冰块。']]
2024-07-10 18:54:58 | INFO | stdout | question: 组织成<ref>class name</ref><box>[[x1, y1, x2, y2], ...]</box>的格式
2024-07-10 18:54:58 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=5472x3648 at 0x7FC660580AF0>]
2024-07-10 18:54:58 | INFO | model_worker | dynamic_image_size: True
2024-07-10 18:54:58 | INFO | model_worker | use_thumbnail: True
2024-07-10 18:54:59 | INFO | model_worker | Resize images to 448x448
2024-07-10 18:54:59 | INFO | model_worker | Split images to torch.Size([7, 3, 448, 448])
2024-07-10 18:54:59 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
2024-07-10 18:55:08 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 8
2024-07-10 18:55:23 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 8
2024-07-10 18:55:38 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 8
2024-07-10 18:55:46 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-07-10 18:55:53 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-07-10 18:56:08 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-07-10 18:56:23 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-07-10 18:56:38 | INFO | stdout | INFO:     10.140.60.209:47870 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:56:38 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-07-10 18:56:53 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-07-10 18:56:56 | INFO | stdout | INFO:     10.140.60.209:47894 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 18:57:08 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-07-10 18:57:23 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-07-10 18:57:38 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-07-10 18:57:53 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-07-10 18:58:08 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-07-10 18:58:23 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-07-10 18:58:38 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-07-10 18:58:53 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-07-10 18:59:08 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-07-10 18:59:23 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-07-10 18:59:38 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-07-10 18:59:53 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-07-10 19:00:08 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-07-10 19:00:23 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-07-10 19:00:38 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-07-10 19:00:53 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-07-10 19:01:08 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-07-10 19:01:23 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-07-10 19:01:38 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-07-10 19:01:53 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-07-10 19:02:08 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-07-10 19:02:23 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-07-10 19:02:38 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-07-10 19:02:53 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-07-10 19:03:08 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-07-10 19:03:23 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-07-10 19:03:39 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-07-10 19:03:54 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-07-10 19:04:09 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-07-10 19:04:24 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-07-10 19:04:39 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-07-10 19:04:54 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-07-10 19:05:09 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-07-10 19:05:24 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-07-10 19:05:39 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-07-10 19:05:54 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-07-10 19:06:09 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-07-10 19:06:24 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-07-10 19:06:39 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-07-10 19:06:51 | INFO | stdout | INFO:     10.140.60.209:50640 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 19:06:54 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 8
2024-07-10 19:06:56 | INFO | stdout | INFO:     10.140.60.209:50660 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 19:07:03 | INFO | stdout | INFO:     10.140.60.209:50696 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 19:07:03 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 9
2024-07-10 19:07:03 | INFO | stdout | INFO:     10.140.60.209:50704 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-07-10 19:07:03 | INFO | stdout | history: []
2024-07-10 19:07:03 | INFO | stdout | question: Image-1: <image>
2024-07-10 19:07:03 | INFO | stdout | 详细描述这张图片
2024-07-10 19:07:03 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=1024x1024 at 0x7FC660582290>]
2024-07-10 19:07:03 | INFO | model_worker | dynamic_image_size: True
2024-07-10 19:07:03 | INFO | model_worker | use_thumbnail: True
2024-07-10 19:07:04 | INFO | model_worker | Resize images to 448x448
2024-07-10 19:07:04 | INFO | model_worker | Split images to torch.Size([10, 3, 448, 448])
2024-07-10 19:07:04 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
2024-07-10 19:07:09 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 9
2024-07-10 19:07:14 | INFO | stdout | INFO:     10.140.60.209:50802 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 19:07:24 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 9
2024-07-10 19:07:39 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 9
2024-07-10 19:07:50 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
2024-07-10 19:07:54 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
2024-07-10 19:08:09 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
2024-07-10 19:08:24 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
2024-07-10 19:08:39 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
2024-07-10 19:08:40 | INFO | stdout | INFO:     10.140.60.209:51288 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 19:08:44 | INFO | stdout | INFO:     10.140.60.209:51320 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 19:08:54 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
2024-07-10 19:09:05 | INFO | stdout | INFO:     10.140.60.209:51426 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 19:09:09 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
2024-07-10 19:09:16 | INFO | stdout | INFO:     10.140.60.209:51620 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 19:09:17 | INFO | stdout | INFO:     10.140.60.209:51666 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 19:09:24 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
2024-07-10 19:09:39 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
2024-07-10 19:09:54 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
2024-07-10 19:10:09 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
2024-07-10 19:10:24 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
2024-07-10 19:10:39 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
2024-07-10 19:10:51 | INFO | stdout | INFO:     10.140.60.209:52090 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 19:10:52 | INFO | stdout | INFO:     10.140.60.209:52110 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 19:10:54 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
2024-07-10 19:11:09 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
2024-07-10 19:11:24 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
2024-07-10 19:11:39 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
2024-07-10 19:11:54 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
2024-07-10 19:12:07 | INFO | stdout | INFO:     10.140.60.209:52410 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 19:12:09 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
2024-07-10 19:12:24 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
2024-07-10 19:12:39 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 9
2024-07-10 19:12:44 | INFO | stdout | INFO:     10.140.60.209:52662 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 19:12:44 | INFO | stdout | INFO:     10.140.60.209:52682 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 19:12:45 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 10
2024-07-10 19:12:45 | INFO | stdout | INFO:     10.140.60.209:52690 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-07-10 19:12:45 | INFO | stdout | history: []
2024-07-10 19:12:45 | INFO | stdout | question: Image-1: <image>
2024-07-10 19:12:45 | INFO | stdout | 请问这张图片用作微信头像怎么样？是一位什么样的人。
2024-07-10 19:12:45 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=940x940 at 0x7FC660582470>]
2024-07-10 19:12:45 | INFO | model_worker | dynamic_image_size: True
2024-07-10 19:12:45 | INFO | model_worker | use_thumbnail: True
2024-07-10 19:12:45 | INFO | model_worker | Resize images to 448x448
2024-07-10 19:12:45 | INFO | model_worker | Split images to torch.Size([5, 3, 448, 448])
2024-07-10 19:12:46 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
2024-07-10 19:12:50 | INFO | stdout | INFO:     10.140.60.209:52708 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 19:12:54 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 10
2024-07-10 19:13:09 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 10
2024-07-10 19:13:17 | INFO | stdout | INFO:     10.140.60.209:52852 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 19:13:24 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 10
2024-07-10 19:13:39 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 10
2024-07-10 19:13:44 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
2024-07-10 19:13:46 | INFO | stdout | INFO:     10.140.60.209:52948 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 19:13:47 | INFO | stdout | INFO:     10.140.60.209:52974 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 19:13:54 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
2024-07-10 19:14:09 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
2024-07-10 19:14:24 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
2024-07-10 19:14:39 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
2024-07-10 19:14:54 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
2024-07-10 19:15:09 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
2024-07-10 19:15:24 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
2024-07-10 19:15:39 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
2024-07-10 19:15:54 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
2024-07-10 19:16:02 | INFO | stdout | INFO:     10.140.60.209:53446 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 19:16:09 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
2024-07-10 19:16:16 | INFO | stdout | INFO:     10.140.60.209:53574 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 19:16:23 | INFO | stdout | INFO:     10.140.60.209:53666 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 19:16:24 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
2024-07-10 19:16:31 | INFO | stdout | INFO:     10.140.60.209:53692 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 19:16:39 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
2024-07-10 19:16:40 | INFO | stdout | INFO:     10.140.60.209:53714 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 19:16:41 | INFO | stdout | INFO:     10.140.60.209:53736 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 19:16:54 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
2024-07-10 19:17:00 | INFO | stdout | INFO:     10.140.60.209:53766 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 19:17:04 | INFO | stdout | INFO:     10.140.60.209:53786 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 19:17:08 | INFO | stdout | INFO:     10.140.60.209:53808 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 19:17:10 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
2024-07-10 19:17:10 | INFO | stdout | INFO:     10.140.60.209:53828 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 19:17:19 | INFO | stdout | INFO:     10.140.60.209:54028 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 19:17:25 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
2024-07-10 19:17:40 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
2024-07-10 19:17:41 | INFO | stdout | INFO:     10.140.60.209:54058 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 19:17:46 | INFO | stdout | INFO:     10.140.60.209:54078 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 19:17:47 | INFO | stdout | INFO:     10.140.60.209:54098 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 19:17:51 | INFO | stdout | INFO:     10.140.60.209:54120 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 19:17:54 | INFO | stdout | INFO:     10.140.60.209:54142 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 19:17:55 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 10
2024-07-10 19:17:58 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 11
2024-07-10 19:17:58 | INFO | stdout | INFO:     10.140.60.209:54150 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-07-10 19:17:58 | INFO | stdout | history: [['Image-1: <image>\nImage-2: <image>\nImage-3: <image>\nImage-4: <image>\nImage-5: <image>\n数一下总共看到了几张图片', '在这张图片中，我总共看到了五张图片。 ']]
2024-07-10 19:17:58 | INFO | stdout | question: 分别描述这些图片
2024-07-10 19:17:58 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=640x1039 at 0x7FC660583F40>, <PIL.PngImagePlugin.PngImageFile image mode=RGB size=640x1800 at 0x7FC6605825F0>, <PIL.PngImagePlugin.PngImageFile image mode=RGB size=571x1280 at 0x7FC660583190>, <PIL.PngImagePlugin.PngImageFile image mode=RGB size=5472x3648 at 0x7FC660582470>, <PIL.PngImagePlugin.PngImageFile image mode=RGB size=800x800 at 0x7FC660581390>]
2024-07-10 19:17:58 | INFO | model_worker | dynamic_image_size: True
2024-07-10 19:17:58 | INFO | model_worker | use_thumbnail: True
2024-07-10 19:17:59 | INFO | model_worker | Resize images to 448x448
2024-07-10 19:17:59 | INFO | model_worker | Split images to torch.Size([34, 3, 448, 448])
2024-07-10 19:17:59 | WARNING | transformers.tokenization_utils_base | Token indices sequence length is longer than the specified maximum sequence length for this model (8777 > 8192). Running this sequence through the model will result in indexing errors
2024-07-10 19:17:59 | WARNING | transformers.tokenization_utils_base | Token indices sequence length is longer than the specified maximum sequence length for this model (8777 > 8192). Running this sequence through the model will result in indexing errors
2024-07-10 19:18:00 | INFO | stdout | INFO:     10.140.60.209:54168 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 19:18:02 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
2024-07-10 19:18:02 | ERROR | stderr | Exception in thread Thread-13 (chat):
2024-07-10 19:18:02 | ERROR | stderr | Traceback (most recent call last):
2024-07-10 19:18:02 | ERROR | stderr |   File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/threading.py", line 1009, in _bootstrap_inner
2024-07-10 19:18:03 | ERROR | stderr |     self.run()
2024-07-10 19:18:03 | ERROR | stderr |   File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/threading.py", line 946, in run
2024-07-10 19:18:03 | ERROR | stderr |     self._target(*self._args, **self._kwargs)
2024-07-10 19:18:03 | ERROR | stderr |   File "/mnt/petrelfs/wangweiyun/.cache/huggingface/modules/transformers_modules/InternVL2-78B/modeling_internvl_chat.py", line 283, in chat
2024-07-10 19:18:03 | ERROR | stderr |     generation_output = self.generate(
2024-07-10 19:18:03 | ERROR | stderr |   File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
2024-07-10 19:18:03 | ERROR | stderr |     return func(*args, **kwargs)
2024-07-10 19:18:03 | ERROR | stderr |   File "/mnt/petrelfs/wangweiyun/.cache/huggingface/modules/transformers_modules/InternVL2-78B/modeling_internvl_chat.py", line 333, in generate
2024-07-10 19:18:03 | ERROR | stderr |     outputs = self.language_model.generate(
2024-07-10 19:18:03 | ERROR | stderr |   File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
2024-07-10 19:18:03 | ERROR | stderr |     return func(*args, **kwargs)
2024-07-10 19:18:03 | ERROR | stderr |   File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/site-packages/transformers/generation/utils.py", line 1525, in generate
2024-07-10 19:18:03 | ERROR | stderr |     return self.sample(
2024-07-10 19:18:03 | ERROR | stderr |   File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/site-packages/transformers/generation/utils.py", line 2628, in sample
2024-07-10 19:18:03 | ERROR | stderr |     outputs = self(
2024-07-10 19:18:03 | ERROR | stderr |   File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1518, in _wrapped_call_impl
2024-07-10 19:18:03 | ERROR | stderr |     return self._call_impl(*args, **kwargs)
2024-07-10 19:18:03 | ERROR | stderr |   File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1527, in _call_impl
2024-07-10 19:18:03 | ERROR | stderr |     return forward_call(*args, **kwargs)
2024-07-10 19:18:03 | ERROR | stderr |   File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/site-packages/transformers/models/qwen2/modeling_qwen2.py", line 1173, in forward
2024-07-10 19:18:03 | ERROR | stderr |     outputs = self.model(
2024-07-10 19:18:03 | ERROR | stderr |   File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1518, in _wrapped_call_impl
2024-07-10 19:18:03 | ERROR | stderr |     return self._call_impl(*args, **kwargs)
2024-07-10 19:18:03 | ERROR | stderr |   File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1527, in _call_impl
2024-07-10 19:18:03 | ERROR | stderr |     return forward_call(*args, **kwargs)
2024-07-10 19:18:03 | ERROR | stderr |   File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/site-packages/transformers/models/qwen2/modeling_qwen2.py", line 1058, in forward
2024-07-10 19:18:03 | ERROR | stderr |     layer_outputs = decoder_layer(
2024-07-10 19:18:03 | ERROR | stderr |   File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1518, in _wrapped_call_impl
2024-07-10 19:18:03 | ERROR | stderr |     return self._call_impl(*args, **kwargs)
2024-07-10 19:18:03 | ERROR | stderr |   File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1527, in _call_impl
2024-07-10 19:18:03 | ERROR | stderr |     return forward_call(*args, **kwargs)
2024-07-10 19:18:03 | ERROR | stderr |   File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/site-packages/accelerate/hooks.py", line 166, in new_forward
2024-07-10 19:18:03 | ERROR | stderr |     output = module._old_forward(*args, **kwargs)
2024-07-10 19:18:03 | ERROR | stderr |   File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/site-packages/transformers/models/qwen2/modeling_qwen2.py", line 773, in forward
2024-07-10 19:18:03 | ERROR | stderr |     hidden_states, self_attn_weights, present_key_value = self.self_attn(
2024-07-10 19:18:03 | ERROR | stderr |   File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1518, in _wrapped_call_impl
2024-07-10 19:18:03 | ERROR | stderr |     return self._call_impl(*args, **kwargs)
2024-07-10 19:18:03 | ERROR | stderr |   File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1527, in _call_impl
2024-07-10 19:18:03 | ERROR | stderr |     return forward_call(*args, **kwargs)
2024-07-10 19:18:03 | ERROR | stderr |   File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/site-packages/accelerate/hooks.py", line 166, in new_forward
2024-07-10 19:18:03 | ERROR | stderr |     output = module._old_forward(*args, **kwargs)
2024-07-10 19:18:03 | ERROR | stderr |   File "/mnt/petrelfs/wangweiyun/miniconda3/envs/internvl/lib/python3.10/site-packages/transformers/models/qwen2/modeling_qwen2.py", line 305, in forward
2024-07-10 19:18:03 | ERROR | stderr |     attn_weights = nn.functional.softmax(attn_weights, dim=-1, dtype=torch.float32).to(query_states.dtype)
2024-07-10 19:18:03 | ERROR | stderr | torch.cuda.OutOfMemoryError: CUDA out of memory. Tried to allocate 9.18 GiB. GPU 0 has a total capacty of 79.33 GiB of which 1.78 GiB is free. Including non-PyTorch memory, this process has 77.53 GiB memory in use. Of the allocated memory 75.90 GiB is allocated by PyTorch, and 1.10 GiB is reserved by PyTorch but unallocated. If reserved but unallocated memory is large try setting max_split_size_mb to avoid fragmentation.  See documentation for Memory Management and PYTORCH_CUDA_ALLOC_CONF
2024-07-10 19:18:09 | INFO | stdout | Caught Unknown Error
2024-07-10 19:18:09 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 11
2024-07-10 19:18:10 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=5, locked=False). global_counter: 11
2024-07-10 19:18:11 | INFO | stdout | INFO:     10.140.60.209:54190 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 19:18:12 | INFO | stdout | INFO:     10.140.60.209:54224 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 19:18:12 | INFO | stdout | INFO:     10.140.60.209:54252 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-07-10 19:18:16 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 12
2024-07-10 19:18:16 | INFO | stdout | INFO:     10.140.60.209:54342 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-07-10 19:18:16 | INFO | stdout | history: []
2024-07-10 19:18:16 | INFO | stdout | question: Image-1: <image>
2024-07-10 19:18:16 | INFO | stdout | 请检测图中所有物体，并输出坐标框
2024-07-10 19:18:16 | INFO | stdout | pil_images: [<PIL.PngImagePlugin.PngImageFile image mode=RGB size=4032x3024 at 0x7FC660583250>]
2024-07-10 19:18:16 | INFO | model_worker | dynamic_image_size: True
2024-07-10 19:18:16 | INFO | model_worker | use_thumbnail: True
2024-07-10 19:18:17 | INFO | model_worker | Resize images to 448x448
2024-07-10 19:18:17 | INFO | model_worker | Split images to torch.Size([13, 3, 448, 448])
2024-07-10 19:18:18 | WARNING | transformers.generation.utils | Setting `pad_token_id` to `eos_token_id`:151645 for open-end generation.
2024-07-10 19:18:25 | INFO | model_worker | Send heart beat. Models: ['InternVL2-78B']. Semaphore: Semaphore(value=4, locked=False). global_counter: 12