sophosympatheia commited on
Commit
2f2f295
·
verified ·
1 Parent(s): 1e915cc

Update README.md

Browse files

Added some advice about dealing with the model speaking as the user or out of turn during group chats.

Files changed (1) hide show
  1. README.md +3 -0
README.md CHANGED
@@ -160,6 +160,9 @@ If you save this as a .json file, you can import it directly into Silly Tavern.
160
  "name": "New Dawn Llama 3.1 70B"
161
  }
162
  ```
 
 
 
163
 
164
  ### Instruct Formats
165
  Use the Llama 3 instruct format. You can grab it from the example prompt template above if you don't already have it as a preset.
 
160
  "name": "New Dawn Llama 3.1 70B"
161
  }
162
  ```
163
+ **NOTE:** If you have trouble with this model speaking as the user or other characters out of turn during group chats, try setting
164
+ ```<|start_header_id|>assistant - {{char}} ONLY<|end_header_id|>``` as the last_output_sequence, which is displayed in the SillyTavern GUI as "Last Assistant Prefix."
165
+ This version definitely has more of a tendency to speak out of turn as compared to v1.0 that was based solely on Llama 3.
166
 
167
  ### Instruct Formats
168
  Use the Llama 3 instruct format. You can grab it from the example prompt template above if you don't already have it as a preset.