runtime error
Exit code: 1. Reason: s: /home/user/.cache/huggingface/hub/models--T145--ZEUS-8B-V2/snapshots/d9cba7abdcdf92541854bb14dfb8ee0e35389e04/splitted_model/model.layers.30.safetensors saved as: /home/user/.cache/huggingface/hub/models--T145--ZEUS-8B-V2/snapshots/d9cba7abdcdf92541854bb14dfb8ee0e35389e04/splitted_model/model.layers.31.safetensors saved as: /home/user/.cache/huggingface/hub/models--T145--ZEUS-8B-V2/snapshots/d9cba7abdcdf92541854bb14dfb8ee0e35389e04/splitted_model/model.norm.safetensors saved as: /home/user/.cache/huggingface/hub/models--T145--ZEUS-8B-V2/snapshots/d9cba7abdcdf92541854bb14dfb8ee0e35389e04/splitted_model/lm_head.safetensors new version of transfomer, no need to use BetterTransformer, try setting attn impl to sdpa... attn imp: <class 'transformers.models.llama.modeling_llama.LlamaSdpaAttention'> Traceback (most recent call last): File "/home/user/app/app.py", line 10, in <module> model = AutoModel.from_pretrained("T145/ZEUS-8B-V2") File "/home/user/.local/lib/python3.10/site-packages/airllm/auto_model.py", line 54, in from_pretrained return class_(pretrained_model_name_or_path, *inputs, ** kwargs) File "/home/user/.local/lib/python3.10/site-packages/airllm/airllm.py", line 9, in __init__ super(AirLLMLlama2, self).__init__(*args, **kwargs) File "/home/user/.local/lib/python3.10/site-packages/airllm/airllm_base.py", line 131, in __init__ self.init_model() File "/home/user/.local/lib/python3.10/site-packages/airllm/airllm_base.py", line 233, in init_model set_module_tensor_to_device(self.model, buffer_name, self.running_device, value=buffer, File "/home/user/.local/lib/python3.10/site-packages/accelerate/utils/modeling.py", line 329, in set_module_tensor_to_device new_value = value.to(device) File "/home/user/.local/lib/python3.10/site-packages/torch/cuda/__init__.py", line 319, in _lazy_init torch._C._cuda_init() RuntimeError: Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from http://www.nvidia.com/Download/index.aspx
Container logs:
Fetching error logs...