Spaces:

svbgbn
/

meta-llama-Llama-2-7b-hf

Runtime error

svbgbn commited on Oct 31, 2023

Commit

b278be0

1 Parent(s): b847bc6

Update model.py

Files changed (1) hide show

model.py CHANGED Viewed

@@ -10,7 +10,8 @@ if torch.cuda.is_available():
     model = AutoModelForCausalLM.from_pretrained(
         model_id,
         torch_dtype=torch.float16,
-        device_map='auto'
     )
 else:
     model = None

     model = AutoModelForCausalLM.from_pretrained(
         model_id,
         torch_dtype=torch.float16,
+        device_map='auto',
+        token="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"
     )
 else:
     model = None