Spaces:

fava-uw

/

fava

like 47

Runtime error

i am also getting error when i duplicate this space :

Exit code: 1. Reason: The token has not been saved to the git credentials helper. Pass `add_to_git_credential=True` in this function directly or `--add-to-git-credential` if using via `huggingface-cli` if you want to set the git credential as well.
Token is valid (permission: read).
Your token has been saved to /home/user/.cache/huggingface/token
Login successful
Traceback (most recent call last):
  File "/home/user/app/app.py", line 13, in <module>
    model = vllm.LLM(model="fava-uw/fava-model")
  File "/usr/local/lib/python3.10/site-packages/vllm/utils.py", line 990, in inner
    return fn(*args, **kwargs)
  File "/usr/local/lib/python3.10/site-packages/vllm/entrypoints/llm.py", line 230, in __init__
    self.llm_engine = self.engine_class.from_engine_args(
  File "/usr/local/lib/python3.10/site-packages/vllm/engine/llm_engine.py", line 529, in from_engine_args
    engine_config = engine_args.create_engine_config(usage_context)
  File "/usr/local/lib/python3.10/site-packages/vllm/engine/arg_utils.py", line 1026, in create_engine_config
    device_config = DeviceConfig(device=self.device)
  File "/usr/local/lib/python3.10/site-packages/vllm/config.py", line 1433, in __init__
    raise RuntimeError("Failed to infer device type")
RuntimeError: Failed to infer device type
Exception ignored in: <function LLM.__del__ at 0x7fc04e0b6b90>
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/vllm/entrypoints/llm.py", line 236, in __del__
    if self.llm_engine and hasattr(self.llm_engine, "shutdown"):
AttributeError: 'LLM' object has no attribute 'llm_engine'

Any idea how to fix this ? @abhika-m