TheBloke commited on
Commit
e51b8aa
1 Parent(s): cd46b13

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -7
README.md CHANGED
@@ -52,9 +52,10 @@ Multiple GPTQ parameter permutations are provided; see Provided Files below for
52
  ## Prompt template: Llama-2-Chat
53
 
54
  ```
55
- System: You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. If a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.
56
- User: {prompt}
57
- Assistant:
 
58
  ```
59
 
60
  ## Provided files
@@ -138,10 +139,10 @@ model = AutoGPTQForCausalLM.from_quantized(model_name_or_path,
138
  """
139
 
140
  prompt = "Tell me about AI"
141
- prompt_template=f'''System: You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. If a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.
142
- User: {prompt}
143
- Assistant:
144
- '''
145
 
146
  print("\n\n*** Generate:")
147
 
 
52
  ## Prompt template: Llama-2-Chat
53
 
54
  ```
55
+ [INST] <<SYS>>
56
+ You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. If a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.
57
+ <</SYS>>
58
+ {prompt}[/INST]
59
  ```
60
 
61
  ## Provided files
 
139
  """
140
 
141
  prompt = "Tell me about AI"
142
+ prompt_template=f'''[INST] <<SYS>>
143
+ You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature. If a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information.
144
+ <</SYS>>
145
+ {prompt}[/INST]'''
146
 
147
  print("\n\n*** Generate:")
148