ycros commited on
Commit
85546a3
1 Parent(s): 8eb9292

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -28,7 +28,7 @@ I'm not sure if it's better or not yet, or how it does at higher (8k+) contexts
28
 
29
  Similar sampler advice applies as for BMT: minP (0.07 - 0.3 to taste) -> temp (either dynatemp 0-4ish, or like a temp of 3-4 with a smoothing factor of around 2.5ish).
30
  And yes, that's temp last. It does okay without rep pen up to a point, it doesn't seem to get into a complete jam, but it can start to repeat sentences,
31
- so you'll probably need some, perhaps 1.07 at a 1024 range seems okayish.
32
  (rep pen sucks, but there are better things coming).
33
 
34
  I've mainly tested with LimaRP style Alpaca prompts (instruction/input/response), and briefly with Mistral's own format.
 
28
 
29
  Similar sampler advice applies as for BMT: minP (0.07 - 0.3 to taste) -> temp (either dynatemp 0-4ish, or like a temp of 3-4 with a smoothing factor of around 2.5ish).
30
  And yes, that's temp last. It does okay without rep pen up to a point, it doesn't seem to get into a complete jam, but it can start to repeat sentences,
31
+ so you'll probably need some, perhaps 1.02-1.05 at a 1024 range seems okayish.
32
  (rep pen sucks, but there are better things coming).
33
 
34
  I've mainly tested with LimaRP style Alpaca prompts (instruction/input/response), and briefly with Mistral's own format.