Hugging Face's logo

Spaces:
Daemontatox
/
SmartAssistant
Running on Zero

App Files Community
1
Daemontatox commited on
Commit
8e3f5cc
·
verified ·
1 Parent(s): b8496fb

Update app.py

Browse files
Files changed (1) hide show
  1. app.py +1 -1
app.py CHANGED
@@ -87,7 +87,7 @@ def initialize_model():
87
  torch_dtype=torch.float16,
88
  device_map="cuda",
89
  attn_implementation="flash_attention_2",
90
- quantization_config=quantization_config
91
 
92
  )
93
 
 
87
  torch_dtype=torch.float16,
88
  device_map="cuda",
89
  attn_implementation="flash_attention_2",
90
+ # quantization_config=quantization_config
91
 
92
  )
93