IlyaGusev
/

saiga_7b_lora

Text Generation

Model card Files Files and versions Community

IlyaGusev commited on Apr 26, 2023

Commit

8a4f384

•

1 Parent(s): 3d6684a

Update README.md

Files changed (1) hide show

README.md +2 -0

README.md CHANGED Viewed

@@ -91,6 +91,8 @@ model = PeftModel.from_pretrained(
     MODEL_NAME,
     torch_dtype=torch.float16
 )
 tokenizer = AutoTokenizer.from_pretrained(MODEL_NAME)
 generation_config = GenerationConfig.from_pretrained(MODEL_NAME)
 print(generation_config)

     MODEL_NAME,
     torch_dtype=torch.float16
 )
+model.eval()
 tokenizer = AutoTokenizer.from_pretrained(MODEL_NAME)
 generation_config = GenerationConfig.from_pretrained(MODEL_NAME)
 print(generation_config)