Image-Text-to-Text
Transformers
Safetensors
English
idefics2
pretraining
multimodal
vision
Inference Endpoints
5 papers
SalmanFaroz commited on
Commit
fe08217
1 Parent(s): 317fdf2

Update README.md

Browse files

ValueError: `.to` is not supported for `4-bit` or `8-bit` bitsandbytes models. Please use the model as it is, since the model has already been set to the correct devices and casted to the correct `dtype`.

Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -339,7 +339,7 @@ model = AutoModelForVision2Seq.from_pretrained(
339
  "HuggingFaceM4/idefics2-8b",
340
  + torch_dtype=torch.float16,
341
  + quantization_config=quantization_config,
342
- ).to(DEVICE)
343
  ```
344
 
345
  </details>
 
339
  "HuggingFaceM4/idefics2-8b",
340
  + torch_dtype=torch.float16,
341
  + quantization_config=quantization_config,
342
+ )
343
  ```
344
 
345
  </details>