Update README.md

README.md

@@ -17,22 +17,11 @@ license: other
 license_name: llama3
 license_link: LICENSE
 ---
-
-## Note about eos token
-It seems llama 3 uses a different eos tokens depending if it is in instruct mode.
-The initial upload had some issues with this as it uses the "default" eos token of 128001, but when in instruct mode llama only outputs 128009 as eos token which causes it to ramble on and on without stopping.
-
-I have uploaded fixed quants with the eos token id manually set to 128009.
-
-This fixes the issue for me, but you have to make sure to use the correct chat template, ~I recommend using [this](https://github.com/ggerganov/llama.cpp/pull/6751) PR~(it has been merged just used the newest llama.cpp master) and then launching llama.cpp with `--chat-template llama3`.
-
-If you do not want to redownload you can fix your local gguf file with this command:
-```
-python3 ./path-to-llama.cpp/gguf-py/scripts/gguf-set-metadata.py $file tokenizer.ggml.eos_token_id 128009 --force
-```
-
 # Quant Infos
 
+- quants done with an importance matrix for improved quantization loss
+- K & IQ quants in basically all variants from Q6_K down to IQ_S
+- fixed end token for instruct mode (<|eot_id|>[128009])
 
 Quantized with [llama.cpp](https://github.com/ggerganov/llama.cpp) commit [0d56246f4b9764158525d894b96606f6163c53a8](https://github.com/ggerganov/llama.cpp/commit/0d56246f4b9764158525d894b96606f6163c53a8) (master from 2024-04-18)
  
@@ -47,7 +36,22 @@ Using this command to generate the importance matrix from the f16.gguf with [thi
 ./imatrix -c 512 -m $model_name-f16.gguf -f $llama_cpp_path/groups_merged.txt -o $out_path/imat-f16-gmerged.dat
 ```
 
-# Original Readme:
+## Note about eos token
+It seems llama 3 uses a different eos tokens depending if it is in instruct mode.
+The initial upload had some issues with this as it uses the "default" eos token of 128001, but when in instruct mode llama only outputs 128009 as eos token which causes it to ramble on and on without stopping.
+
+I have uploaded fixed quants with the eos token id manually set to 128009.
+
+This fixes the issue for me, but you have to make sure to use the correct chat template, ~I recommend using [this](https://github.com/ggerganov/llama.cpp/pull/6751) PR~(it has been merged just used the newest llama.cpp master) and then launching llama.cpp with `--chat-template llama3`.
+
+If you do not want to redownload you can fix your local gguf file with this command:
+```
+python3 ./path-to-llama.cpp/gguf-py/scripts/gguf-set-metadata.py $file tokenizer.ggml.eos_token_id 128009 --force
+```
+
+------------------------
+
+# Original Model Card:
 
 ## Model Details