IlyaGusev
/

saiga_7b_lora

Text Generation

Model card Files Files and versions Community

IlyaGusev commited on Apr 26, 2023

Commit

3d6684a

•

1 Parent(s): 793ea81

Update README.md

Files changed (1) hide show

README.md +5 -1

README.md CHANGED Viewed

@@ -86,7 +86,11 @@ model = AutoModelForCausalLM.from_pretrained(
     torch_dtype=torch.float16,
     device_map="auto"
 )
-model = PeftModel.from_pretrained(model, MODEL_NAME)
 tokenizer = AutoTokenizer.from_pretrained(MODEL_NAME)
 generation_config = GenerationConfig.from_pretrained(MODEL_NAME)
 print(generation_config)

     torch_dtype=torch.float16,
     device_map="auto"
 )
+model = PeftModel.from_pretrained(
+    model,
+    MODEL_NAME,
+    torch_dtype=torch.float16
+)
 tokenizer = AutoTokenizer.from_pretrained(MODEL_NAME)
 generation_config = GenerationConfig.from_pretrained(MODEL_NAME)
 print(generation_config)