Spaces:

ighoshsubho
/

youtube-summarize-QA

Runtime error

Subho Ghosh commited on Aug 30, 2023

Commit

6032796

•

1 Parent(s): 482eb17

Updated app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -35,7 +35,6 @@ model_repo = 'tiiuae/falcon-rw-1b'
 tokenizer = AutoTokenizer.from_pretrained(model_repo)
 model = AutoModelForCausalLM.from_pretrained(model_repo,
-                                             load_in_8bit=True,
                                              device_map='auto',
                                              torch_dtype=torch.float16,
                                              low_cpu_mem_usage=True,

 tokenizer = AutoTokenizer.from_pretrained(model_repo)
 model = AutoModelForCausalLM.from_pretrained(model_repo,
                                              device_map='auto',
                                              torch_dtype=torch.float16,
                                              low_cpu_mem_usage=True,