Update README.md

README.md

@@ -22,6 +22,8 @@ prompt_template: '<|im_start|>system
 
 *I've copy-pased some information from TheBloke's model cards, hope it's ok*
 
+For a model of this size, with stronger quantization, quality appears to decline much more than for larger models. Personally, I would advise to stick with `fp16` or `int8` for this model.
+
 ## Prompt template: ChatML
 
 ```
@@ -44,7 +46,3 @@ Change `-ngl 32` to the number of layers to offload to GPU. Remove it if you don
 Change `-c 2048` to the desired sequence length. For extended sequence models - eg 8K, 16K, 32K - the necessary RoPE scaling parameters are read from the GGUF file and set by llama.cpp automatically.
 
 If you want to have a chat-style conversation, replace the `-p <PROMPT>` argument with `-i -ins`
-
-## Notes on performance
-
-For a model of this size, with stronger quantization, quality appears to decline much more than for larger models. Personally, I would advise to stick with `fp16` or `int8` for this model.