Update README.md

README.md

@@ -48,47 +48,55 @@ You can load the model directly from the Hugging Face model hub using
 from transformers import AutoTokenizer, AutoModelForCausalLM
 
 tokenizer = AutoTokenizer.from_pretrained("togethercomputer/Llama-2-7B-32K-Instruct")
-model = AutoModelForCausalLM.from_pretrained("togethercomputer/Llama-2-7B-32K-Instruct", trust_remote_code=True, torch_dtype=torch.float16)
-input_ids = tokenizer.encode(<your instruction>, return_tensors="pt")
-output = model.generate(input_ids, max_length=128, temperature=0.7)
+model = AutoModelForCausalLM.from_pretrained("togethercomputer/Llama-2-7B-32K-Instruct",
+    trust_remote_code=True, torch_dtype=torch.float16)
+input_ids = tokenizer.encode("[INST]\nWrite a poem about cats\n[/INST]\n\n", return_tensors="pt")
+output = model.generate(input_ids, max_length=128,
+    temperature=0.7, repetition_panelty=1.1, top_p=0.7, top_k=50)
 output_text = tokenizer.decode(output[0], skip_special_tokens=True)
 ```
 
 The model is also hosted on [Together Playground](https://api.together.xyz/playground). You can simply play with the model by using prompt formatted by:
 
 ```
-[INST] <your instruction here> [\INST]\n\n
+[INST]\n<your instruction here>\n[\INST]\n\n
 ```
 
 For example, if we query the model with 
 
 ```
-[INST] Write a poem about cats [\INST]\n\n
+[INST]\nWrite a poem about cats\n[\INST]\n\n
 ```
 
 the model will return
 ```
-Sure, here's a short poem about cats:
-
-Cats, cats, oh how they enthrall,
-With their soft fur and gentle grace,
-They purr with joy, their eyes aglow,
-And steal our hearts with their charm and grace.
-
-In their own time, they move about,
-With graceful strides, they tiptoe out,
-Their whiskers twitching, as they go,
-Their curiosity piqued, they want to know.
-
-They climb, they jump, they play, they chase,
-Their agility, a sight to behold,
-Their naps, a treat, a break from the chase,
-A time to rest, a time to be told.
-
-Cats, cats, they're unique and special,
-A part of our lives, a treasure to hold,
-Their personalities, so diverse,
-Their charm, a gift, that's forever told.
+[INST]
+Write a poem about cats
+[/INST]
+
+Cats are mysterious creatures, with their aloof and independent nature. They're also incredibly beautiful, with their sleek fur and piercing eyes. Here's a poem that captures the essence of cats:
+
+Cats, oh cats, how can I describe you?
+Your beauty is beyond compare, it seems.
+You're graceful and elegant, like a ballerina's dance,
+But don't let your charm fool you, for you're not easily tamed.
+
+With your soft purring and playful meows,
+You draw us in with your enchanting powers.
+We love to watch you play, your tail twirling 'round,
+As if you're dancing on air, with no sound.
+
+But don't be fooled by your sweetness, my friend,
+For beneath that gentle exterior, lies a fierce defender.
+When danger lurks, you'll spring into action,
+Protecting those you hold dear, without question.
+
+Solet us admire you, from afar,
+For in your own way, you're truly unique, a star.
+And though we may never fully understand,
+The depths of your soul, we'll always stand, hand in paw, as one.
+
+This poem captures the essence of cats, highlighting their beauty, independence,and protective nature. It also celebrates the special bond between humans and cats, recognizing their unique qualities and the joy they bring to our lives.
 ```
 
 ## Model Evaluation