runtime error
Exit code: 3. Reason: ponse.raise_for_status() File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 1024, in raise_for_status raise HTTPError(http_error_msg, response=self) requests.exceptions.HTTPError: 504 Server Error: Gateway Timeout for url: https://api-inference.huggingface.co/models/Qwen/Qwen2.5-7B-Instruct-GGUF The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/local/lib/python3.9/site-packages/starlette/routing.py", line 693, in lifespan async with self.lifespan_context(app) as maybe_state: File "/usr/local/lib/python3.9/site-packages/starlette/routing.py", line 569, in __aenter__ await self._router.startup() File "/usr/local/lib/python3.9/site-packages/starlette/routing.py", line 670, in startup await handler() File "/code/main.py", line 60, in preload_model client.text_generation(dummy_prompt, max_new_tokens=1) File "/usr/local/lib/python3.9/site-packages/huggingface_hub/inference/_client.py", line 2332, in text_generation raise_text_generation_error(e) File "/usr/local/lib/python3.9/site-packages/huggingface_hub/inference/_common.py", line 466, in raise_text_generation_error raise http_error File "/usr/local/lib/python3.9/site-packages/huggingface_hub/inference/_client.py", line 2302, in text_generation bytes_output = self.post(json=payload, model=model, task="text-generation", stream=stream) # type: ignore File "/usr/local/lib/python3.9/site-packages/huggingface_hub/inference/_client.py", line 296, in post hf_raise_for_status(response) File "/usr/local/lib/python3.9/site-packages/huggingface_hub/utils/_http.py", line 477, in hf_raise_for_status raise _format(HfHubHTTPError, str(e), response) from e huggingface_hub.errors.HfHubHTTPError: 504 Server Error: Gateway Timeout for url: https://api-inference.huggingface.co/models/Qwen/Qwen2.5-7B-Instruct-GGUF (Request ID: b7b8vVfyoUDh8dhXjK0ZD) Model Qwen/Qwen2.5-7B-Instruct-GGUF time out ERROR: Application startup failed. Exiting.
Container logs:
Fetching error logs...