Mozilla
/

mathstral-7B-v0.1-llamafile

Model card Files Files and versions Community

jartine commited on Jul 19

Commit

01d1f5f

•

1 Parent(s): 5dd67d4

Update README.md

Files changed (1) hide show

README.md +3 -2

README.md CHANGED Viewed

@@ -29,9 +29,10 @@ chmod +x mathstral-7B-v0.1.Q6_K.llamafile
 You then need to fill out the prompt / history template (see below).
-This model has a max context window size of 8k tokens. By default, a
 context window size of 512 tokens is used. You may increase this to the
-maximum by passing the `-c 0` flag.
 On GPUs with sufficient RAM, the `-ngl 999` flag may be passed to use
 the system's NVIDIA or AMD GPU(s). On Windows, only the graphics card

 You then need to fill out the prompt / history template (see below).
+This model has a max context window size of 32k tokens. By default, a
 context window size of 512 tokens is used. You may increase this to the
+maximum by passing the `-c 0` flag. By default the temperature for this
+model is set to zero. You may change it by setting e.g. `--temp 0.8`.
 On GPUs with sufficient RAM, the `-ngl 999` flag may be passed to use
 the system's NVIDIA or AMD GPU(s). On Windows, only the graphics card