Dracones commited on
Commit
fc73b72
1 Parent(s): 9600786

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +23 -68
README.md CHANGED
@@ -69,78 +69,33 @@ Here are the EQ Bench scores for the EXL2 quants using Alpaca, ChatML, Command-R
69
 
70
  ### Quants
71
 
72
- | Quant Size | Instruct Template | Score |
73
- |------------|-------------------|-------|
74
- | 8.0 | Alpaca | 56.67 |
75
- | 8.0 | ChatML | 47.28 |
76
- | 8.0 | Command-R | 58.46 |
77
- | 8.0 | Command-R-Plus | 58.49 |
78
- | 7.0 | Alpaca | 57.5 |
79
- | 7.0 | ChatML | 46.86 |
80
- | 7.0 | Command-R | 57.29 |
81
- | 7.0 | Command-R-Plus | 57.91 |
82
- | 6.0 | Alpaca | 56.5 |
83
- | 6.0 | ChatML | 48.61 |
84
- | 6.0 | Command-R | 57.8 |
85
- | 6.0 | Command-R-Plus | 58.64 |
86
- | 5.0 | Alpaca | 54.64 |
87
- | 5.0 | ChatML | 48.48 |
88
- | 5.0 | Command-R | 57.14 |
89
- | 5.0 | Command-R-Plus | 56.63 |
90
- | 4.5 | Alpaca | 57.75 |
91
- | 4.5 | ChatML | 48.1 |
92
- | 4.5 | Command-R | 57.08 |
93
- | 4.5 | Command-R-Plus | 56.7 |
94
- | 4.0 | Alpaca | 53.41 |
95
- | 4.0 | ChatML | 50.99 |
96
- | 4.0 | Command-R | 57.46 |
97
- | 4.0 | Command-R-Plus | 57.99 |
98
- | 3.5 | Alpaca | 56.68 |
99
- | 3.5 | ChatML | 52.72 |
100
- | 3.5 | Command-R | 60.91 |
101
- | 3.5 | Command-R-Plus | 60.91 |
102
- | 3.0 | Alpaca | 36.45 |
103
- | 3.0 | ChatML | 39.19 |
104
- | 3.0 | Command-R | 49.17 |
105
- | 3.0 | Command-R-Plus | 49.68 |
106
 
107
 
108
  ### RP Calibrated Quants
109
 
110
- | Quant Size | Instruct Template | Score |
111
- |------------|-------------------|-------|
112
- | 8.0 | Alpaca | 56.23 |
113
- | 8.0 | ChatML | 48.42 |
114
- | 8.0 | Command-R | 58.41 |
115
- | 8.0 | Command-R-Plus | 58.41 |
116
- | 7.0 | Alpaca | 57.01 |
117
- | 7.0 | ChatML | 48.47 |
118
- | 7.0 | Command-R | 57.85 |
119
- | 7.0 | Command-R-Plus | 57.67 |
120
- | 6.0 | Alpaca | 58.33 |
121
- | 6.0 | ChatML | 50.93 |
122
- | 6.0 | Command-R | 60.32 |
123
- | 6.0 | Command-R-Plus | 59.83 |
124
- | 5.0 | Alpaca | 55.28 |
125
- | 5.0 | ChatML | 50.29 |
126
- | 5.0 | Command-R | 58.96 |
127
- | 5.0 | Command-R-Plus | 59.23 |
128
- | 4.5 | Alpaca | 55.01 |
129
- | 4.5 | ChatML | 46.63 |
130
- | 4.5 | Command-R | 57.7 |
131
- | 4.5 | Command-R-Plus | 59.24 |
132
- | 4.0 | Alpaca | 49.76 |
133
- | 4.0 | ChatML | 47.13 |
134
- | 4.0 | Command-R | 54.76 |
135
- | 4.0 | Command-R-Plus | 55.5 |
136
- | 3.5 | Alpaca | 56.39 |
137
- | 3.5 | ChatML | 52.98 |
138
- | 3.5 | Command-R | 59.19 |
139
- | 3.5 | Command-R-Plus | 58.32 |
140
- | 3.0 | Alpaca | 50.36 |
141
- | 3.0 | ChatML | 47.94 |
142
- | 3.0 | Command-R | 54.89 |
143
- | 3.0 | Command-R-Plus | 53.61 |
144
 
145
 
146
  ### Command-R-Plus Template
 
69
 
70
  ### Quants
71
 
72
+ Here's the updated markdown table based on the provided example:
73
+
74
+
75
+ | Quant Size | ChatML | Alpaca | Command-R | Command-R-Plus |
76
+ |------------|--------|--------|-----------|----------------|
77
+ | 8.0 | 47.28 | 56.67 | 58.46 | 58.49 |
78
+ | 7.0 | 46.86 | 57.5 | 57.29 | 57.91 |
79
+ | 6.0 | 48.61 | 56.5 | 57.8 | 58.64 |
80
+ | 5.0 | 48.48 | 54.64 | 57.14 | 56.63 |
81
+ | 4.5 | 48.1 | 57.75 | 57.08 | 56.7 |
82
+ | 4.0 | 50.99 | 53.41 | 57.46 | 57.99 |
83
+ | 3.5 | 52.72 | 56.68 | 60.91 | 60.91 |
84
+ | 3.0 | 39.19 | 36.45 | 49.17 | 49.68 |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
85
 
86
 
87
  ### RP Calibrated Quants
88
 
89
+ | Quant Size | ChatML | Alpaca | Command-R | Command-R-Plus |
90
+ |------------|--------|--------|-----------|----------------|
91
+ | 8.0 | 48.42 | 56.23 | 58.41 | 58.41 |
92
+ | 7.0 | 48.47 | 57.01 | 57.85 | 57.67 |
93
+ | 6.0 | 50.93 | 58.33 | 60.32 | 59.83 |
94
+ | 5.0 | 50.29 | 55.28 | 58.96 | 59.23 |
95
+ | 4.5 | 46.63 | 55.01 | 57.7 | 59.24 |
96
+ | 4.0 | 47.13 | 49.76 | 54.76 | 55.5 |
97
+ | 3.5 | 52.98 | 56.39 | 59.19 | 58.32 |
98
+ | 3.0 | 47.94 | 50.36 | 54.89 | 53.61 |
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
99
 
100
 
101
  ### Command-R-Plus Template