Spaces:

CreitinGameplays
/

ConvAIChat

Runtime error

CreitinGameplays commited on 8 days ago

Commit

2136c56

•

1 Parent(s): c76b802

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -32,8 +32,6 @@ def load_model():
             torch_dtype=torch.float16,
             device_map="auto"
         )
-    tokenizer = Tokenizer(BPE())
-    tokenizer.pre_tokenizer = Whitespace()
     tokenizer = AutoTokenizer.from_pretrained(model_id, padding_side='left')
     tokenizer.use_default_system_prompt = False

             torch_dtype=torch.float16,
             device_map="auto"
         )
     tokenizer = AutoTokenizer.from_pretrained(model_id, padding_side='left')
     tokenizer.use_default_system_prompt = False