runtime error
35%|███▍ | 1.55G/4.48G [00:03<00:05, 555MB/s][A pytorch_model-00002-of-00002.bin: 54%|█████▍ | 2.44G/4.48G [00:04<00:02, 683MB/s][A pytorch_model-00002-of-00002.bin: 75%|███████▌ | 3.37G/4.48G [00:05<00:01, 768MB/s][A pytorch_model-00002-of-00002.bin: 100%|█████████▉| 4.48G/4.48G [00:06<00:00, 732MB/s] Downloading shards: 100%|██████████| 2/2 [00:19<00:00, 9.18s/it][A Downloading shards: 100%|██████████| 2/2 [00:19<00:00, 9.77s/it] Loading checkpoint shards: 0%| | 0/2 [00:00<?, ?it/s][A Loading checkpoint shards: 50%|█████ | 1/2 [00:04<00:04, 4.33s/it][A Loading checkpoint shards: 100%|██████████| 2/2 [00:06<00:00, 2.96s/it][A Loading checkpoint shards: 100%|██████████| 2/2 [00:06<00:00, 3.17s/it] generation_config.json: 0%| | 0.00/117 [00:00<?, ?B/s][A generation_config.json: 100%|██████████| 117/117 [00:00<00:00, 862kB/s] Traceback (most recent call last): File "/home/user/app/app.py", line 17, in <module> instruct_pipeline_falcon = pipeline(model="tiiuae/falcon-7b-instruct", tokenizer = tokenizer, torch_dtype=torch.bfloat16, trust_remote_code=True, device_map="auto", device=0) File "/home/user/.pyenv/versions/3.10.13/lib/python3.10/site-packages/transformers/pipelines/__init__.py", line 1070, in pipeline return pipeline_class(model=model, framework=framework, task=task, **kwargs) File "/home/user/.pyenv/versions/3.10.13/lib/python3.10/site-packages/transformers/pipelines/text_generation.py", line 70, in __init__ super().__init__(*args, **kwargs) File "/home/user/.pyenv/versions/3.10.13/lib/python3.10/site-packages/transformers/pipelines/base.py", line 790, in __init__ raise ValueError( ValueError: The model has been loaded with `accelerate` and therefore cannot be moved to a specific device. Please discard the `device` argument when creating your pipeline object.
Container logs:
Fetching error logs...