NousResearch
/

Nous-Hermes-2-Mistral-7B-DPO

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

teknium commited on Feb 22, 2024

Commit

b66d6a6

•

1 Parent(s): 488062b

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -184,7 +184,7 @@ from transformers import LlamaTokenizer, MixtralForCausalLM
 import bitsandbytes, flash_attn
 tokenizer = LlamaTokenizer.from_pretrained('NousResearch/Nous-Hermes-2-Mistral-7B-DPO', trust_remote_code=True)
-model = MixtralForCausalLM.from_pretrained(
     "NousResearch/Nous-Hermes-2-Mistral-7B-DPO",
     torch_dtype=torch.float16,
     device_map="auto",

 import bitsandbytes, flash_attn
 tokenizer = LlamaTokenizer.from_pretrained('NousResearch/Nous-Hermes-2-Mistral-7B-DPO', trust_remote_code=True)
+model = MistralForCausalLM.from_pretrained(
     "NousResearch/Nous-Hermes-2-Mistral-7B-DPO",
     torch_dtype=torch.float16,
     device_map="auto",