Update README.md

README.md

@@ -28,10 +28,13 @@ torch.set_default_device("cuda")
 model = AutoModelForCausalLM.from_pretrained("voidful/phi-1_5_chat_32k")
 tokenizer = AutoTokenizer.from_pretrained("voidful/phi-1_5_chat_32k",device_map="auto")
 
-from fastchat.conversation import get_conv_template
-conv = get_conv_template('qwen-7b-chat')
-conv.append_message(conv.roles[0], "how to make a keyboard?")
-conv.append_message(conv.roles[1], """To make a keyboard, you will need the following materials:
+messages = [
+    {
+        "role": "system",
+        "content": "You are a helpful assistant.",
+    },
+    {"role": "user", "content": "how to make a keyboard?"},
+    {"role": "assistant", "content": """To make a keyboard, you will need the following materials:
 
 1. A set of keys, such as those found on a standard computer keyboard.
 2. A circuit board, such as a MOSFET (Metal-Oxide-Semiconductor-Fluorescent) board.
@@ -47,24 +50,23 @@ Here is a basic outline of the steps involved in making a keyboard:
 4. Test the keyboard to ensure that it works properly.
 5. Package the keyboard in a box or case for shipping or sale.
 
-Note that this is just a basic outline, and there are many additional steps and considerations that will depend on the specific design and requirements of your keyboard.</s>""")
-conv.append_message(conv.roles[0], "where to buy the circuit?")
-prompt = conv.get_prompt()
+Note that this is just a basic outline, and there are many additional steps and considerations that will depend on the specific design and requirements of your keyboard.</s>"""},
+    {"role": "user", "content": "where to buy the circuit?"},
+ ]
+tokenized_chat = tokenizer.apply_chat_template(messages, tokenize=True, add_generation_prompt=True, return_tensors="pt")
 
-inputs = tokenizer(prompt, return_tensors="pt", return_attention_mask=True)
-outputs = model.generate(**inputs, max_length=1024)
-text = tokenizer.batch_decode(outputs[:,inputs.input_ids.shape[-1]:])[0]
+outputs = model.generate(tokenized_chat, max_length=1024)
+text = tokenizer.batch_decode(outputs[:,tokenized_chat.shape[-1]:-1])[0]
 print(text)
 ```
 
 ### Result
 ```
+There are several places where you can buy a circuit board. Here are some of the most common places:
 
-You can buy the circuit board from a variety of sources, including:
+1. Electronics stores: Many electronics stores carry a variety of circuit boards for different purposes.
+2. Online marketplaces: There are several online marketplaces where you can buy circuit boards, such as Amazon, eBay, and Alibaba.
+3. Specialty stores: There are several specialty stores that carry a variety of circuit boards for different purposes, such as hobby stores, craft stores, and home improvement stores.
 
-1. Online retailers: There are many online retailers that sell circuit boards, including Amazon, Best Buy, and Walmart.
-2. Electronics stores: Many electronics stores, such as Best Buy, Walmart, and Target, carry circuit boards.
-3. Specialty stores: There are also specialty stores that sell circuit boards, such as Circuit City, Best Buy, and Walmart.
-
-When buying a circuit board, it is important to consider factors such as the size and type of circuit board, the quality and reliability of the circuit board, and the cost and availability of the circuit board.<|im_end|>
+In general, it is a good idea to shop around and compare prices and features before making a purchase.
 ```