Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
@@ -43,30 +43,15 @@ Below are the perplexity scores for the EXL2 models. A lower score is better.
|
|
43 |
|
44 |
Here are the EQ Bench scores for the EXL2 quants using Alpaca, ChatML and Chat-Vicuna prompt templates. A higher score is better.
|
45 |
|
46 |
-
|
47 |
-
|
48 |
-
|
49 |
-
|
|
50 |
-
|
|
51 |
-
|
|
52 |
-
|
|
53 |
-
|
|
54 |
-
|
|
55 |
-
| 6.0 | Alpaca | 75.11 |
|
56 |
-
| 6.0 | ChatML | 74.29 |
|
57 |
-
| 6.0 | Chat-Vicuna | 74.16 |
|
58 |
-
| 5.0 | Alpaca | 74.11 |
|
59 |
-
| 5.0 | ChatML | 72.74 |
|
60 |
-
| 5.0 | Chat-Vicuna | 73.28 |
|
61 |
-
| 4.5 | Alpaca | 73.18 |
|
62 |
-
| 4.5 | ChatML | 73.62 |
|
63 |
-
| 4.5 | Chat-Vicuna | 73.32 |
|
64 |
-
| 4.0 | Alpaca | 71.85 |
|
65 |
-
| 4.0 | ChatML | 73.99 |
|
66 |
-
| 4.0 | Chat-Vicuna | 74.74 |
|
67 |
-
| 3.5 | Alpaca | 73.73 |
|
68 |
-
| 3.5 | ChatML | 72.07 |
|
69 |
-
| 3.5 | Chat-Vicuna | 73.56 |
|
70 |
|
71 |
### Chat-Vicuna Template
|
72 |
|
|
|
43 |
|
44 |
Here are the EQ Bench scores for the EXL2 quants using Alpaca, ChatML and Chat-Vicuna prompt templates. A higher score is better.
|
45 |
|
46 |
+
| Quant Size | ChatML | Alpaca | Chat-Vicuna |
|
47 |
+
|------------|--------|--------|-------------|
|
48 |
+
| 8.0 | 73.82 | 75.02 | 73.53 |
|
49 |
+
| 7.0 | 74.22 | 74.96 | 72.71 |
|
50 |
+
| 6.0 | 74.29 | 75.11 | 74.16 |
|
51 |
+
| 5.0 | 72.74 | 74.11 | 73.28 |
|
52 |
+
| 4.5 | 73.62 | 73.18 | 73.32 |
|
53 |
+
| 4.0 | 73.99 | 71.85 | 74.74 |
|
54 |
+
| 3.5 | 72.07 | 73.73 | 73.56 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
55 |
|
56 |
### Chat-Vicuna Template
|
57 |
|