algorithm commited on
Commit
81d3233
1 Parent(s): f4708fd

-cml / --chatml has been discontinued in llama.cpp

Browse files

Please see: https://github.com/ggerganov/llama.cpp/pull/7675
I have formatted the prompt manually and tested it to confirm that it works.

Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -38,7 +38,7 @@ huggingface-cli download Qwen/Qwen2-7B-Instruct-GGUF qwen2-7b-instruct-q8_0.gguf
38
 
39
  We demonstrate how to use `llama.cpp` to run Qwen2:
40
  ```shell
41
- ./main -m qwen2-7b-instruct-q8_0.gguf -n 512 --color -i -cml -f prompts/chat-with-qwen.txt
42
  ```
43
 
44
  ## Citation
 
38
 
39
  We demonstrate how to use `llama.cpp` to run Qwen2:
40
  ```shell
41
+ ./main -m qwen2-7b-instruct-q8_0.gguf -n 512 --color -i --interactive-first --in-prefix '<|im_start|>user\n' --in-suffix '<|im_end|>\n<|im_start|>assistant\n' --reverse-prompt '<|im_end|>' -p '<|im_start|>system\nYou are a helpful assistant<|im_end|>'
42
  ```
43
 
44
  ## Citation