runtime error
Exit code: 1. Reason: wnloading shards: 25%|βββ | 1/4 [00:24<01:12, 24.14s/it][A Downloading shards: 50%|βββββ | 2/4 [00:46<00:46, 23.12s/it][A Downloading shards: 75%|ββββββββ | 3/4 [01:10<00:23, 23.32s/it][A Downloading shards: 100%|ββββββββββ| 4/4 [01:28<00:00, 21.20s/it][A Downloading shards: 100%|ββββββββββ| 4/4 [01:28<00:00, 22.01s/it] Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s][A Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s] Traceback (most recent call last): File "/home/user/app/web_demo.py", line 282, in <module> initialize_fn() File "/home/user/app/web_demo.py", line 72, in initialize_fn worker = ModelWorker(model_path0,device) File "/home/user/app/model_server.py", line 74, in __init__ self.glm_model = AutoModel.from_pretrained( File "/usr/local/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py", line 559, in from_pretrained return model_class.from_pretrained( File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 3960, in from_pretrained ) = cls._load_pretrained_model( File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 4434, in _load_pretrained_model new_error_msgs, offload_index, state_dict_index = _load_state_dict_into_meta_model( File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 961, in _load_state_dict_into_meta_model set_module_tensor_to_device(model, param_name, param_device, **set_module_kwargs) File "/usr/local/lib/python3.10/site-packages/accelerate/utils/modeling.py", line 329, in set_module_tensor_to_device new_value = value.to(device) File "/usr/local/lib/python3.10/site-packages/torch/cuda/__init__.py", line 293, in _lazy_init torch._C._cuda_init() RuntimeError: Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from http://www.nvidia.com/Download/index.aspx
Container logs:
Fetching error logs...