Update README.md

README.md

@@ -94,6 +94,19 @@ If you choose to use `llama-cli`, pay attention to the removal of `-cml` for the
   -ngl 28 -fa
 ```
 
+## Evaluation
+
+We implement perplexity evaluation using wikitext following the practice of `llama.cpp` with `./llama-perplexity` (the previous `./perplexity`). 
+In the following we report the PPL of GGUF models of different sizes and different quantization levels.
+
+|Size    | fp16    | q8_0    | q6_k    | q5_k_m  | q5_0    | q4_k_m  | q4_0    | q3_k_m  | q2_k    | iq1_m   |
+|--------|---------|---------|---------|---------|---------|---------|---------|---------|---------|---------|
+|0.5B    | 15.11   | 15.13   | 15.14   | 15.24   | 15.40   | 15.36   | 16.28   | 15.70   | 16.74   | -       |
+|1.5B    | 10.43   | 10.43   | 10.45   | 10.50   | 10.56   | 10.61   | 10.79   | 11.08   | 13.04   | -       |
+|7B      | 7.93    | 7.94    | 7.96    | 7.97    | 7.98    | 8.02    | 8.19    | 8.20    | 10.58   | -       |
+|57B-A14B| 6.81    | 6.81    | 6.83    | 6.84    | 6.89    | 6.99    | 7.02    | 7.43    | -       | -       |
+|72B     | 5.58    | 5.58    | 5.59    | 5.59    | 5.60    | 5.61    | 5.66    | 5.68    | 5.91    | 6.75    |
+
 ## Citation
 
 If you find our work helpful, feel free to give us a cite.