OpenGVLab
/

InternVL-Chat-V1-5

Image-Text-to-Text

feature-extraction

Model card Files Files and versions Metrics Training metrics Community

czczup commited on Apr 29

Commit

2942258

•

1 Parent(s): 44e41e8

Update README.md

Files changed (1) hide show

README.md +2 -0

README.md CHANGED Viewed

@@ -184,6 +184,8 @@ model = AutoModel.from_pretrained(
     low_cpu_mem_usage=True,
     trust_remote_code=True).eval().cuda()
 # Otherwise, you need to set device_map='auto' to use multiple GPUs for inference.
 # model = AutoModel.from_pretrained(
 #     path,
 #     torch_dtype=torch.bfloat16,

     low_cpu_mem_usage=True,
     trust_remote_code=True).eval().cuda()
 # Otherwise, you need to set device_map='auto' to use multiple GPUs for inference.
+# import os
+# os.environ["CUDA_LAUNCH_BLOCKING"] = "1"
 # model = AutoModel.from_pretrained(
 #     path,
 #     torch_dtype=torch.bfloat16,