Spaces:

akhil2808
/

Qwen2_VL72B_OCR

Runtime error

akhil2808 commited on Oct 9

Commit

4f963ef

•

1 Parent(s): 67c7f10

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -7,7 +7,7 @@ from qwen_vl_utils import process_vision_info
 model = Qwen2VLForConditionalGeneration.from_pretrained(
     "Qwen/Qwen2-VL-72B-Instruct-AWQ",
     torch_dtype=torch.float16,
-    device_map="auto"
 )
 processor = AutoProcessor.from_pretrained("Qwen/Qwen2-VL-72B-Instruct-AWQ")

 model = Qwen2VLForConditionalGeneration.from_pretrained(
     "Qwen/Qwen2-VL-72B-Instruct-AWQ",
     torch_dtype=torch.float16,
+    #device_map="auto"
 )
 processor = AutoProcessor.from_pretrained("Qwen/Qwen2-VL-72B-Instruct-AWQ")