Commit
•
08bfe99
1
Parent(s):
a01086f
Update README.md
Browse files
README.md
CHANGED
@@ -15,14 +15,22 @@ LLM4Decompile aims to decompile x86 assembly instructions into C. The newly rele
|
|
15 |
|
16 |
|
17 |
### 2. Evaluation Results
|
18 |
-
|
19 |
-
|
20 |
-
|
|
21 |
-
|
22 |
-
|
|
23 |
-
|
24 |
-
|
|
25 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
26 |
|
27 |
|
28 |
### 3. How to Use
|
|
|
15 |
|
16 |
|
17 |
### 2. Evaluation Results
|
18 |
+
|
19 |
+
+------------------------+-------------------------------------------------+-------------------------------------------------+
|
20 |
+
| Model/Benchmark | HumanEval-Decompile | ExeBench |
|
21 |
+
+------------------------+---------+---------+---------+---------+---------+---------+---------+---------+---------+---------+
|
22 |
+
| Optimization Level | O0 | O1 | O2 | O3 | AVG | O0 | O1 | O2 | O3 | AVG |
|
23 |
+
+------------------------+---------+---------+---------+---------+---------+---------+---------+---------+---------+---------+
|
24 |
+
| DeepSeek-Coder-6.7B | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.0000 |
|
25 |
+
+------------------------+---------+---------+---------+---------+---------+---------+---------+---------+---------+---------+
|
26 |
+
| GPT-4o | 0.3049 | 0.1159 | 0.1037 | 0.1159 | 0.1601 | 0.0443 | 0.0328 | 0.0397 | 0.0343 | 0.0378 |
|
27 |
+
+------------------------+---------+---------+---------+---------+---------+---------+---------+---------+---------+---------+
|
28 |
+
| LLM4Decompile-End-1.3B | 0.4720 | 0.2061 | 0.2122 | 0.2024 | 0.2732 | 0.1786 | 0.1362 | 0.1320 | 0.1328 | 0.1449 |
|
29 |
+
+------------------------+---------+---------+---------+---------+---------+---------+---------+---------+---------+---------+
|
30 |
+
| LLM4Decompile-End-6.7B | 0.6805 | 0.3951 | 0.3671 | 0.3720 | 0.4537 | 0.2289 | 0.1660 | 0.1618 | 0.1625 | 0.1798 |
|
31 |
+
+------------------------+---------+---------+---------+---------+---------+---------+---------+---------+---------+---------+
|
32 |
+
| LLM4Decompile-End-33B | 0.5168 | 0.2956 | 0.2815 | 0.2675 | 0.3404 | 0.1886 | 0.1465 | 0.1396 | 0.1411 | 0.1540 |
|
33 |
+
+------------------------+---------+---------+---------+---------+---------+---------+---------+---------+---------+---------+
|
34 |
|
35 |
|
36 |
### 3. How to Use
|