File size: 16,865 Bytes
37c870e
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
2024-07-02 09:48:49 | INFO | gradio_web_server | args: Namespace(concurrency_count=10, controller_url='http://localhost:21001', gradio_auth_path=None, gradio_root_path=None, host='0.0.0.0', model_list_mode='once', moderate=False, port=None, register_api_endpoint_file=None, share=False, show_terms_of_use=False, use_remote_storage=False)
2024-07-02 09:48:49 | ERROR | stderr | Traceback (most recent call last):
2024-07-02 09:48:49 | ERROR | stderr |   File "/usr/local/lib/python3.8/dist-packages/urllib3/connection.py", line 196, in _new_conn
2024-07-02 09:48:49 | ERROR | stderr |     sock = connection.create_connection(
2024-07-02 09:48:49 | ERROR | stderr |   File "/usr/local/lib/python3.8/dist-packages/urllib3/util/connection.py", line 85, in create_connection
2024-07-02 09:48:49 | ERROR | stderr |     raise err
2024-07-02 09:48:49 | ERROR | stderr |   File "/usr/local/lib/python3.8/dist-packages/urllib3/util/connection.py", line 73, in create_connection
2024-07-02 09:48:49 | ERROR | stderr |     sock.connect(sa)
2024-07-02 09:48:49 | ERROR | stderr | ConnectionRefusedError: [Errno 111] Connection refused
2024-07-02 09:48:49 | ERROR | stderr | 
2024-07-02 09:48:49 | ERROR | stderr | The above exception was the direct cause of the following exception:
2024-07-02 09:48:49 | ERROR | stderr | 
2024-07-02 09:48:49 | ERROR | stderr | Traceback (most recent call last):
2024-07-02 09:48:49 | ERROR | stderr |   File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 789, in urlopen
2024-07-02 09:48:49 | ERROR | stderr |     response = self._make_request(
2024-07-02 09:48:49 | ERROR | stderr |   File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 495, in _make_request
2024-07-02 09:48:49 | ERROR | stderr |     conn.request(
2024-07-02 09:48:49 | ERROR | stderr |   File "/usr/local/lib/python3.8/dist-packages/urllib3/connection.py", line 398, in request
2024-07-02 09:48:49 | ERROR | stderr |     self.endheaders()
2024-07-02 09:48:49 | ERROR | stderr |   File "/usr/lib/python3.8/http/client.py", line 1251, in endheaders
2024-07-02 09:48:49 | ERROR | stderr |     self._send_output(message_body, encode_chunked=encode_chunked)
2024-07-02 09:48:49 | ERROR | stderr |   File "/usr/lib/python3.8/http/client.py", line 1011, in _send_output
2024-07-02 09:48:49 | ERROR | stderr |     self.send(msg)
2024-07-02 09:48:49 | ERROR | stderr |   File "/usr/lib/python3.8/http/client.py", line 951, in send
2024-07-02 09:48:49 | ERROR | stderr |     self.connect()
2024-07-02 09:48:49 | ERROR | stderr |   File "/usr/local/lib/python3.8/dist-packages/urllib3/connection.py", line 236, in connect
2024-07-02 09:48:49 | ERROR | stderr |     self.sock = self._new_conn()
2024-07-02 09:48:49 | ERROR | stderr |   File "/usr/local/lib/python3.8/dist-packages/urllib3/connection.py", line 211, in _new_conn
2024-07-02 09:48:49 | ERROR | stderr |     raise NewConnectionError(
2024-07-02 09:48:49 | ERROR | stderr | urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPConnection object at 0x7f6c3d8227f0>: Failed to establish a new connection: [Errno 111] Connection refused
2024-07-02 09:48:49 | ERROR | stderr | 
2024-07-02 09:48:49 | ERROR | stderr | The above exception was the direct cause of the following exception:
2024-07-02 09:48:49 | ERROR | stderr | 
2024-07-02 09:48:49 | ERROR | stderr | Traceback (most recent call last):
2024-07-02 09:48:49 | ERROR | stderr |   File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 667, in send
2024-07-02 09:48:49 | ERROR | stderr |     resp = conn.urlopen(
2024-07-02 09:48:49 | ERROR | stderr |   File "/usr/local/lib/python3.8/dist-packages/urllib3/connectionpool.py", line 843, in urlopen
2024-07-02 09:48:49 | ERROR | stderr |     retries = retries.increment(
2024-07-02 09:48:49 | ERROR | stderr |   File "/usr/local/lib/python3.8/dist-packages/urllib3/util/retry.py", line 519, in increment
2024-07-02 09:48:49 | ERROR | stderr |     raise MaxRetryError(_pool, url, reason) from reason  # type: ignore[arg-type]
2024-07-02 09:48:49 | ERROR | stderr | urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='localhost', port=21001): Max retries exceeded with url: /refresh_all_workers (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f6c3d8227f0>: Failed to establish a new connection: [Errno 111] Connection refused'))
2024-07-02 09:48:49 | ERROR | stderr | 
2024-07-02 09:48:49 | ERROR | stderr | During handling of the above exception, another exception occurred:
2024-07-02 09:48:49 | ERROR | stderr | 
2024-07-02 09:48:49 | ERROR | stderr | Traceback (most recent call last):
2024-07-02 09:48:49 | ERROR | stderr |   File "/usr/lib/python3.8/runpy.py", line 194, in _run_module_as_main
2024-07-02 09:48:49 | ERROR | stderr |     return _run_code(code, main_globals, None,
2024-07-02 09:48:49 | ERROR | stderr |   File "/usr/lib/python3.8/runpy.py", line 87, in _run_code
2024-07-02 09:48:49 | ERROR | stderr |     exec(code, run_globals)
2024-07-02 09:48:49 | ERROR | stderr |   File "/LLM_32T/evelyn/FastChat/fastchat/serve/gradio_web_server.py", line 1038, in <module>
2024-07-02 09:48:49 | ERROR | stderr |     models, all_models = get_model_list(
2024-07-02 09:48:49 | ERROR | stderr |   File "/LLM_32T/evelyn/FastChat/fastchat/serve/gradio_web_server.py", line 178, in get_model_list
2024-07-02 09:48:49 | ERROR | stderr |     ret = requests.post(controller_url + "/refresh_all_workers")
2024-07-02 09:48:49 | ERROR | stderr |   File "/usr/local/lib/python3.8/dist-packages/requests/api.py", line 115, in post
2024-07-02 09:48:49 | ERROR | stderr |     return request("post", url, data=data, json=json, **kwargs)
2024-07-02 09:48:49 | ERROR | stderr |   File "/usr/local/lib/python3.8/dist-packages/requests/api.py", line 59, in request
2024-07-02 09:48:49 | ERROR | stderr |     return session.request(method=method, url=url, **kwargs)
2024-07-02 09:48:49 | ERROR | stderr |   File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 589, in request
2024-07-02 09:48:49 | ERROR | stderr |     resp = self.send(prep, **send_kwargs)
2024-07-02 09:48:49 | ERROR | stderr |   File "/usr/local/lib/python3.8/dist-packages/requests/sessions.py", line 703, in send
2024-07-02 09:48:49 | ERROR | stderr |     r = adapter.send(request, **kwargs)
2024-07-02 09:48:49 | ERROR | stderr |   File "/usr/local/lib/python3.8/dist-packages/requests/adapters.py", line 700, in send
2024-07-02 09:48:49 | ERROR | stderr |     raise ConnectionError(e, request=request)
2024-07-02 09:48:49 | ERROR | stderr | requests.exceptions.ConnectionError: HTTPConnectionPool(host='localhost', port=21001): Max retries exceeded with url: /refresh_all_workers (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f6c3d8227f0>: Failed to establish a new connection: [Errno 111] Connection refused'))
2024-07-02 09:49:42 | INFO | gradio_web_server | args: Namespace(concurrency_count=10, controller_url='http://localhost:21002', gradio_auth_path=None, gradio_root_path=None, host='0.0.0.0', model_list_mode='once', moderate=False, port=None, register_api_endpoint_file=None, share=False, show_terms_of_use=False, use_remote_storage=False)
2024-07-02 09:49:42 | INFO | gradio_web_server | All models: ['vicuna-7b-v1.5']
2024-07-02 09:49:42 | INFO | gradio_web_server | Visible models: ['vicuna-7b-v1.5']
2024-07-02 09:49:42 | INFO | stdout | Running on local URL:  http://0.0.0.0:7860
2024-07-02 09:49:42 | INFO | stdout | 
2024-07-02 09:49:42 | INFO | stdout | To create a public link, set `share=True` in `launch()`.
2024-07-02 09:49:52 | INFO | gradio_web_server | load_demo. ip: 127.0.0.1. params: {}
2024-07-02 09:50:46 | INFO | gradio_web_server | add_text. ip: 127.0.0.1. len: 2
2024-07-02 09:50:46 | INFO | gradio_web_server | bot_response. ip: 127.0.0.1
2024-07-02 09:50:46 | INFO | gradio_web_server | monitor error: HTTPConnectionPool(host='localhost', port=9090): Max retries exceeded with url: /is_limit_reached?model=vicuna-7b-v1.5&user_id=127.0.0.1 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f2ae7dd8310>: Failed to establish a new connection: [Errno 111] Connection refused'))
2024-07-02 09:50:46 | INFO | gradio_web_server | model_name: vicuna-7b-v1.5, worker_addr: http://127.0.0.1:21003
2024-07-02 09:50:46 | INFO | gradio_web_server | ==== request ====
{'model': 'vicuna-7b-v1.5', 'prompt': "A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the user's questions. USER: hi ASSISTANT:", 'temperature': 0.7, 'repetition_penalty': 1.0, 'top_p': 1.0, 'max_new_tokens': 1024, 'stop': None, 'stop_token_ids': None, 'echo': False}
2024-07-02 09:50:48 | INFO | gradio_web_server | Hello! How can I assist you today?
2024-07-02 09:50:56 | INFO | gradio_web_server | add_text. ip: 127.0.0.1. len: 18
2024-07-02 09:50:56 | INFO | gradio_web_server | bot_response. ip: 127.0.0.1
2024-07-02 09:50:56 | INFO | gradio_web_server | monitor error: HTTPConnectionPool(host='localhost', port=9090): Max retries exceeded with url: /is_limit_reached?model=vicuna-7b-v1.5&user_id=127.0.0.1 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f2ad404db80>: Failed to establish a new connection: [Errno 111] Connection refused'))
2024-07-02 09:50:56 | INFO | gradio_web_server | model_name: vicuna-7b-v1.5, worker_addr: http://127.0.0.1:21003
2024-07-02 09:50:56 | INFO | gradio_web_server | ==== request ====
{'model': 'vicuna-7b-v1.5', 'prompt': "A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the user's questions. USER: hi ASSISTANT: Hello! How can I assist you today?</s>USER: how are you today? ASSISTANT:", 'temperature': 0.7, 'repetition_penalty': 1.0, 'top_p': 1.0, 'max_new_tokens': 1024, 'stop': None, 'stop_token_ids': None, 'echo': False}
2024-07-02 09:50:58 | INFO | gradio_web_server | As an AI language model, I don't have feelings, but I'm functioning properly and ready to assist you. How can I help you today?
2024-07-02 09:54:20 | INFO | gradio_web_server | upvote. ip: 127.0.0.1
2024-07-02 09:54:20 | INFO | gradio_web_server | downvote. ip: 127.0.0.1
2024-07-02 09:54:56 | INFO | stdout | Keyboard interruption in main thread... closing server.
2024-07-02 09:54:57 | ERROR | stderr | Traceback (most recent call last):
2024-07-02 09:54:57 | ERROR | stderr |   File "/usr/local/lib/python3.8/dist-packages/gradio/blocks.py", line 2664, in block_thread
2024-07-02 09:54:57 | ERROR | stderr |     time.sleep(0.1)
2024-07-02 09:54:57 | ERROR | stderr | KeyboardInterrupt
2024-07-02 09:54:57 | ERROR | stderr | 
2024-07-02 09:54:57 | ERROR | stderr | During handling of the above exception, another exception occurred:
2024-07-02 09:54:57 | ERROR | stderr | 
2024-07-02 09:54:57 | ERROR | stderr | Traceback (most recent call last):
2024-07-02 09:54:57 | ERROR | stderr |   File "/usr/lib/python3.8/runpy.py", line 194, in _run_module_as_main
2024-07-02 09:54:57 | ERROR | stderr |     return _run_code(code, main_globals, None,
2024-07-02 09:54:57 | ERROR | stderr |   File "/usr/lib/python3.8/runpy.py", line 87, in _run_code
2024-07-02 09:54:57 | ERROR | stderr |     exec(code, run_globals)
2024-07-02 09:54:57 | ERROR | stderr |   File "/LLM_32T/evelyn/FastChat/fastchat/serve/gradio_web_server.py", line 1049, in <module>
2024-07-02 09:54:57 | ERROR | stderr |     demo.queue(
2024-07-02 09:54:57 | ERROR | stderr |   File "/usr/local/lib/python3.8/dist-packages/gradio/blocks.py", line 2569, in launch
2024-07-02 09:54:57 | ERROR | stderr |     self.block_thread()
2024-07-02 09:54:57 | ERROR | stderr |   File "/usr/local/lib/python3.8/dist-packages/gradio/blocks.py", line 2668, in block_thread
2024-07-02 09:54:57 | ERROR | stderr |     self.server.close()
2024-07-02 09:54:57 | ERROR | stderr |   File "/usr/local/lib/python3.8/dist-packages/gradio/http_server.py", line 68, in close
2024-07-02 09:54:57 | ERROR | stderr |     self.thread.join(timeout=5)
2024-07-02 09:54:57 | ERROR | stderr |   File "/usr/lib/python3.8/threading.py", line 1015, in join
2024-07-02 09:54:57 | ERROR | stderr |     self._wait_for_tstate_lock(timeout=max(timeout, 0))
2024-07-02 09:54:57 | ERROR | stderr |   File "/usr/lib/python3.8/threading.py", line 1027, in _wait_for_tstate_lock
2024-07-02 09:54:57 | ERROR | stderr |     elif lock.acquire(block, timeout):
2024-07-02 09:54:57 | ERROR | stderr | KeyboardInterrupt
2024-07-03 02:55:52 | INFO | gradio_web_server | args: Namespace(concurrency_count=10, controller_url='http://localhost:21002', gradio_auth_path=None, gradio_root_path=None, host='0.0.0.0', model_list_mode='once', moderate=False, port=None, register_api_endpoint_file=None, share=False, show_terms_of_use=False, use_remote_storage=False)
2024-07-03 02:55:52 | INFO | gradio_web_server | All models: []
2024-07-03 02:55:52 | INFO | gradio_web_server | Visible models: []
2024-07-03 02:55:52 | ERROR | stderr | /usr/local/lib/python3.8/dist-packages/gradio/components/dropdown.py:181: UserWarning: The value passed into gr.Dropdown() is not in the list of choices. Please update the list of choices to include:  or set allow_custom_value=True.
2024-07-03 02:55:52 | ERROR | stderr |   warnings.warn(
2024-07-03 02:55:53 | INFO | stdout | Running on local URL:  http://0.0.0.0:7860
2024-07-03 02:55:53 | INFO | stdout | 
2024-07-03 02:55:53 | INFO | stdout | To create a public link, set `share=True` in `launch()`.
2024-07-03 02:56:11 | INFO | gradio_web_server | load_demo. ip: 127.0.0.1. params: {}
2024-07-03 02:56:11 | ERROR | stderr | /usr/local/lib/python3.8/dist-packages/gradio/components/dropdown.py:181: UserWarning: The value passed into gr.Dropdown() is not in the list of choices. Please update the list of choices to include:  or set allow_custom_value=True.
2024-07-03 02:56:11 | ERROR | stderr |   warnings.warn(
2024-07-03 03:54:34 | INFO | stdout | Keyboard interruption in main thread... closing server.
2024-07-03 03:55:06 | ERROR | stderr | /usr/bin/python3: Error while finding module specification for 'fastchat.serve.gradio_block_arena_anony.py' (ModuleNotFoundError: __path__ attribute not found on 'fastchat.serve.gradio_block_arena_anony' while trying to find 'fastchat.serve.gradio_block_arena_anony.py')
2024-07-03 03:55:32 | ERROR | stderr | /usr/bin/python3: Error while finding module specification for 'fastchat.serve.gradio_block_arena_named.py' (ModuleNotFoundError: __path__ attribute not found on 'fastchat.serve.gradio_block_arena_named' while trying to find 'fastchat.serve.gradio_block_arena_named.py')
2024-07-03 03:56:11 | ERROR | stderr | Traceback (most recent call last):
2024-07-03 03:56:11 | ERROR | stderr |   File "/usr/lib/python3.8/runpy.py", line 185, in _run_module_as_main
2024-07-03 03:56:11 | ERROR | stderr |     mod_name, mod_spec, code = _get_module_details(mod_name, _Error)
2024-07-03 03:56:11 | ERROR | stderr |   File "/usr/lib/python3.8/runpy.py", line 111, in _get_module_details
2024-07-03 03:56:11 | ERROR | stderr |     __import__(pkg_name)
2024-07-03 03:56:11 | ERROR | stderr |   File "/LLM_32T/evelyn/FastChat/fastchat/serve/gradio_web_server_multi.py", line 42, in <module>
2024-07-03 03:56:11 | ERROR | stderr |     from fastchat.serve.monitor.monitor import build_leaderboard_tab
2024-07-03 03:56:11 | ERROR | stderr |   File "/LLM_32T/evelyn/FastChat/fastchat/serve/monitor/monitor.py", line 21, in <module>
2024-07-03 03:56:11 | ERROR | stderr |     from fastchat.serve.monitor.basic_stats import report_basic_stats, get_log_files
2024-07-03 03:56:11 | ERROR | stderr |   File "/LLM_32T/evelyn/FastChat/fastchat/serve/monitor/basic_stats.py", line 10, in <module>
2024-07-03 03:56:11 | ERROR | stderr |     import plotly.express as px
2024-07-03 03:56:11 | ERROR | stderr | ModuleNotFoundError: No module named 'plotly'
2024-07-03 03:56:36 | ERROR | stderr | /usr/bin/python3: Error while finding module specification for 'fastchat.serve.gradio_block_arena_named.py' (ModuleNotFoundError: __path__ attribute not found on 'fastchat.serve.gradio_block_arena_named' while trying to find 'fastchat.serve.gradio_block_arena_named.py')
2024-07-03 03:56:57 | ERROR | stderr | /usr/bin/python3: Error while finding module specification for 'fastchat.serve.gradio_web_server_multi.py' (ModuleNotFoundError: __path__ attribute not found on 'fastchat.serve.gradio_web_server_multi' while trying to find 'fastchat.serve.gradio_web_server_multi.py')
2024-07-03 03:57:54 | ERROR | stderr | /usr/bin/python3: Error while finding module specification for 'fastchat.serve.gradio_web_server_multi.py' (ModuleNotFoundError: __path__ attribute not found on 'fastchat.serve.gradio_web_server_multi' while trying to find 'fastchat.serve.gradio_web_server_multi.py')