runtime error

Exit code: 1. Reason: Model Class: LlavaQwenForCausalLM ### model name mammoth-vl-8b ### loading vision tower... You shouldn't move a model that is dispatched using accelerate hooks. ### vision tower SigLipVisionTower( (vision_tower): SigLipVisionModel( (vision_model): SigLipVisionTransformer( (embeddings): SigLipVisionEmbeddings( (patch_embedding): Conv2d(3, 1152, kernel_size=(14, 14), stride=(14, 14), padding=valid) (position_embedding): Embedding(729, 1152) ) (encoder): SigLipEncoder( (layers): ModuleList( (0-25): 26 x SigLipEncoderLayer( (self_attn): SigLipAttention( (k_proj): Linear(in_features=1152, out_features=1152, bias=True) (v_proj): Linear(in_features=1152, out_features=1152, bias=True) (q_proj): Linear(in_features=1152, out_features=1152, bias=True) (out_proj): Linear(in_features=1152, out_features=1152, bias=True) ) (layer_norm1): LayerNorm((1152,), eps=1e-06, elementwise_affine=True) (mlp): SigLipMLP( (activation_fn): PytorchGELUTanh() (fc1): Linear(in_features=1152, out_features=4304, bias=True) (fc2): Linear(in_features=4304, out_features=1152, bias=True) ) (layer_norm2): LayerNorm((1152,), eps=1e-06, elementwise_affine=True) ) ) ) (post_layernorm): LayerNorm((1152,), eps=1e-06, elementwise_affine=True) (head): Identity() ) ) ) ### image processpr in bulder <llava.model.multimodal_encoder.siglip_encoder.SigLipImageProcessor object at 0x7f0c0b930b80> Traceback (most recent call last): File "/home/user/app/app.py", line 723, in <module> model=model.to(torch.device('cuda')) File "/usr/local/lib/python3.10/site-packages/accelerate/big_modeling.py", line 460, in wrapper raise RuntimeError("You can't move a model that has some modules offloaded to cpu or disk.") RuntimeError: You can't move a model that has some modules offloaded to cpu or disk.

Container logs: