Commit
•
43933b7
1
Parent(s):
d3b9250
Upload perplexity.md
Browse files- perplexity.md +31 -0
perplexity.md
ADDED
|
@@ -0,0 +1,31 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
|
| 2 |
+
Qwen2.5-0.5B-Instruct
|
| 3 |
+
Quant Size (MB) PPL Size (%) Accuracy (%) PPL error rate
|
| 4 |
+
IQ1_S 302 30.0453 0.23714
|
| 5 |
+
IQ1_M 304 24.9151 0.19238
|
| 6 |
+
IQ2_XXS 307 21.4864 0.16704
|
| 7 |
+
IQ2_XS 310 19.7829 0.15355
|
| 8 |
+
IQ2_S 311 19.2041 0.14841
|
| 9 |
+
IQ2_M 314 18.3250 0.14001
|
| 10 |
+
Q2_K_S 316 18.3462 0.14091
|
| 11 |
+
IQ3_XXS 319 16.9784 0.12828
|
| 12 |
+
Q3_K_S 323 17.7765 0.13668
|
| 13 |
+
IQ3_S 323 16.3794 0.12173
|
| 14 |
+
IQ3_XS 323 16.3794 0.12173
|
| 15 |
+
Q2_K 323 17.6841 0.13561
|
| 16 |
+
IQ3_M 327 16.3667 0.12182
|
| 17 |
+
IQ4_XS 334 15.8792 0.11933
|
| 18 |
+
IQ4_NL 337 15.8468 0.11921
|
| 19 |
+
Q4_0 337 17.1007 0.13053
|
| 20 |
+
Q3_K_M 339 15.8499 0.11934
|
| 21 |
+
Q3_K_L 353 15.7298 0.11820
|
| 22 |
+
Q4_1 358 16.1819 0.12328
|
| 23 |
+
Q4_K_S 368 15.5497 0.11716
|
| 24 |
+
Q5_0 380 15.5038 0.11702
|
| 25 |
+
Q4_K_M 380 15.4428 0.11637
|
| 26 |
+
Q5_K_S 394 15.5266 0.11682
|
| 27 |
+
Q5_1 400 15.4875 0.11641
|
| 28 |
+
Q5_K_M 401 15.4788 0.11631
|
| 29 |
+
Q6_K 483 15.2145 0.11422
|
| 30 |
+
Q8_0 507 15.2390 0.11452
|
| 31 |
+
F16 949 15.1819 0.11400
|