codefuse-ai
/

CodeFuse-CodeLlama-34B-4bits

goforce5500 commited on Nov 29, 2023

Commit

14c11c4

•

1 Parent(s): 444fe8f

Update README.md (#2)

- Update README.md (29eb44e14fd8c2a09799930dc8703896340394fc)

Co-authored-by: GoForce5500 <goforce5500@users.noreply.huggingface.co>

Files changed (1) hide show

README.md CHANGED Viewed

@@ -135,7 +135,7 @@ def load_model_tokenizer(model_name_or_local_path):
     tokenizer = AutoTokenizer.from_pretrained(model_name_or_local_path,
                                               trust_remote_code=True,
                                               use_fast=False,
-                                              lagecy=False)
     tokenizer.padding_side = "left"
     model = AutoGPTQForCausalLM.from_quantized(model_name_or_local_path,
@@ -338,7 +338,7 @@ def load_model_tokenizer(model_name_or_local_path):
     tokenizer = AutoTokenizer.from_pretrained(model_name_or_local_path,
                                               trust_remote_code=True,
                                               use_fast=False,
-                                              lagecy=False)
     tokenizer.padding_side = "left"
     model = AutoGPTQForCausalLM.from_quantized(model_name_or_local_path,

     tokenizer = AutoTokenizer.from_pretrained(model_name_or_local_path,
                                               trust_remote_code=True,
                                               use_fast=False,
+                                              legacy=False)
     tokenizer.padding_side = "left"
     model = AutoGPTQForCausalLM.from_quantized(model_name_or_local_path,
     tokenizer = AutoTokenizer.from_pretrained(model_name_or_local_path,
                                               trust_remote_code=True,
                                               use_fast=False,
+                                              legacy=False)
     tokenizer.padding_side = "left"
     model = AutoGPTQForCausalLM.from_quantized(model_name_or_local_path,