runtime error

7<00:07, 3.89s/it] Downloading shards: 75%|███████▌ | 3/4 [00:11<00:03, 3.95s/it] Downloading shards: 100%|██████████| 4/4 [00:13<00:00, 2.91s/it] Downloading shards: 100%|██████████| 4/4 [00:13<00:00, 3.27s/it] Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s] Loading checkpoint shards: 25%|██▌ | 1/4 [00:03<00:11, 3.74s/it] Loading checkpoint shards: 50%|█████ | 2/4 [00:07<00:07, 3.77s/it] Loading checkpoint shards: 75%|███████▌ | 3/4 [00:11<00:03, 3.82s/it] Loading checkpoint shards: 100%|██████████| 4/4 [00:12<00:00, 3.01s/it] Traceback (most recent call last): File "/home/user/app/app.py", line 67, in <module> model = AutoModel.from_pretrained('nvidia/NV-Embed-v1', trust_remote_code=True).to(device) File "/home/user/.pyenv/versions/3.10.14/lib/python3.10/site-packages/transformers/modeling_utils.py", line 2724, in to return super().to(*args, **kwargs) File "/home/user/.pyenv/versions/3.10.14/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1173, in to return self._apply(convert) File "/home/user/.pyenv/versions/3.10.14/lib/python3.10/site-packages/torch/nn/modules/module.py", line 779, in _apply module._apply(fn) File "/home/user/.pyenv/versions/3.10.14/lib/python3.10/site-packages/torch/nn/modules/module.py", line 779, in _apply module._apply(fn) File "/home/user/.pyenv/versions/3.10.14/lib/python3.10/site-packages/torch/nn/modules/module.py", line 779, in _apply module._apply(fn) [Previous line repeated 2 more times] File "/home/user/.pyenv/versions/3.10.14/lib/python3.10/site-packages/torch/nn/modules/module.py", line 804, in _apply param_applied = fn(param) File "/home/user/.pyenv/versions/3.10.14/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1159, in convert return t.to( torch.cuda.OutOfMemoryError: CUDA out of memory. Tried to allocate 64.00 MiB. GPU

Container logs: