runtime error
Exit code: 1. Reason: █████████▉| 9.95G/9.95G [00:09<00:00, 1.03GB/s] model-00002-of-00002.safetensors: 0%| | 0.00/4.48G [00:00<?, ?B/s][A model-00002-of-00002.safetensors: 1%| | 41.9M/4.48G [00:01<01:53, 39.3MB/s][A model-00002-of-00002.safetensors: 14%|█▍ | 640M/4.48G [00:02<00:10, 352MB/s] [A model-00002-of-00002.safetensors: 43%|████▎ | 1.91G/4.48G [00:03<00:03, 756MB/s][A model-00002-of-00002.safetensors: 72%|███████▏ | 3.22G/4.48G [00:04<00:01, 970MB/s][A model-00002-of-00002.safetensors: 100%|█████████▉| 4.48G/4.48G [00:05<00:00, 886MB/s] Loading checkpoint shards: 0%| | 0/2 [00:00<?, ?it/s][A Loading checkpoint shards: 50%|█████ | 1/2 [00:02<00:02, 2.14s/it][A Loading checkpoint shards: 100%|██████████| 2/2 [00:02<00:00, 1.45s/it] generation_config.json: 0%| | 0.00/117 [00:00<?, ?B/s][A generation_config.json: 100%|██████████| 117/117 [00:00<00:00, 1.22MB/s] Traceback (most recent call last): File "/home/user/app/app.py", line 17, in <module> instruct_pipeline_falcon = pipeline(model="tiiuae/falcon-7b-instruct", tokenizer = tokenizer, torch_dtype=torch.bfloat16, trust_remote_code=True, device_map="auto", device=0) File "/home/user/.pyenv/versions/3.10.16/lib/python3.10/site-packages/transformers/pipelines/__init__.py", line 1180, in pipeline return pipeline_class(model=model, framework=framework, task=task, **kwargs) File "/home/user/.pyenv/versions/3.10.16/lib/python3.10/site-packages/transformers/pipelines/text_generation.py", line 99, in __init__ super().__init__(*args, **kwargs) File "/home/user/.pyenv/versions/3.10.16/lib/python3.10/site-packages/transformers/pipelines/base.py", line 934, in __init__ raise ValueError( ValueError: The model has been loaded with `accelerate` and therefore cannot be moved to a specific device. Please discard the `device` argument when creating your pipeline object.
Container logs:
Fetching error logs...