Update README.md
Browse files
README.md
CHANGED
|
@@ -96,6 +96,10 @@ and
|
|
| 96 |
`{'pass@1': 0.47560975609756095}`
|
| 97 |
`Base + Extra`
|
| 98 |
`{'pass@1': 0.45121951219512196}`
|
|
|
|
|
|
|
|
|
|
|
|
|
| 99 |
|
| 100 |
**CT2 int8_float16 Wizard Coder:**
|
| 101 |
`Base`
|
|
@@ -152,6 +156,11 @@ Base
|
|
| 152 |
Base + Extra
|
| 153 |
{'pass@1': 0.3902439024390244}
|
| 154 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 155 |
|
| 156 |
--------------
|
| 157 |
|
|
|
|
| 96 |
`{'pass@1': 0.47560975609756095}`
|
| 97 |
`Base + Extra`
|
| 98 |
`{'pass@1': 0.45121951219512196}`
|
| 99 |
+
**one of the worse reruns:**
|
| 100 |
+
{'pass@1': 0.4573170731707317}
|
| 101 |
+
Base + Extra
|
| 102 |
+
{'pass@1': 0.4146341463414634}
|
| 103 |
|
| 104 |
**CT2 int8_float16 Wizard Coder:**
|
| 105 |
`Base`
|
|
|
|
| 156 |
Base + Extra
|
| 157 |
{'pass@1': 0.3902439024390244}
|
| 158 |
|
| 159 |
+
**Full-weight Hermes Coder model loaded with --load-in-8bit, default preset:**
|
| 160 |
+
Base
|
| 161 |
+
{'pass@1': 0.4451219512195122}
|
| 162 |
+
Base + Extra
|
| 163 |
+
{'pass@1': 0.4146341463414634}
|
| 164 |
|
| 165 |
--------------
|
| 166 |
|