Visual Question Answering
Transformers
Safetensors
internvl_chat
feature-extraction
custom_code
8-bit precision
bitsandbytes

多gpu推理有bug

#1
by timecome - opened

您好,多gpu推理的示例代码有问题会报以下错误
RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cuda:1!

祝好!

github issue找找可能有惊喜

OpenGVLab org

现在应该已经解决了,拉一下最新的代码试试

很可惜,并没解决

Sign up or log in to comment