LLM4Binary
commited on
Commit
•
06291f5
1
Parent(s):
08bfe99
Update README.md
Browse files
README.md
CHANGED
@@ -16,22 +16,14 @@ LLM4Decompile aims to decompile x86 assembly instructions into C. The newly rele
|
|
16 |
|
17 |
### 2. Evaluation Results
|
18 |
|
19 |
-
|
20 |
-
|
21 |
-
|
22 |
-
|
|
23 |
-
|
24 |
-
|
|
25 |
-
|
26 |
-
|
|
27 |
-
+------------------------+---------+---------+---------+---------+---------+---------+---------+---------+---------+---------+
|
28 |
-
| LLM4Decompile-End-1.3B | 0.4720 | 0.2061 | 0.2122 | 0.2024 | 0.2732 | 0.1786 | 0.1362 | 0.1320 | 0.1328 | 0.1449 |
|
29 |
-
+------------------------+---------+---------+---------+---------+---------+---------+---------+---------+---------+---------+
|
30 |
-
| LLM4Decompile-End-6.7B | 0.6805 | 0.3951 | 0.3671 | 0.3720 | 0.4537 | 0.2289 | 0.1660 | 0.1618 | 0.1625 | 0.1798 |
|
31 |
-
+------------------------+---------+---------+---------+---------+---------+---------+---------+---------+---------+---------+
|
32 |
-
| LLM4Decompile-End-33B | 0.5168 | 0.2956 | 0.2815 | 0.2675 | 0.3404 | 0.1886 | 0.1465 | 0.1396 | 0.1411 | 0.1540 |
|
33 |
-
+------------------------+---------+---------+---------+---------+---------+---------+---------+---------+---------+---------+
|
34 |
-
|
35 |
|
36 |
### 3. How to Use
|
37 |
Here is an example of how to use our model (Revised for V1.5).
|
|
|
16 |
|
17 |
### 2. Evaluation Results
|
18 |
|
19 |
+
| Model/Benchmark | HumanEval-Decompile | | | | | ExeBench | | | | |
|
20 |
+
|:----------------------:|:-------------------:|:-------:|:-------:|:-------:|:-------:|:--------:|:-------:|:-------:|:-------:|:-------:|
|
21 |
+
| Optimization Level | O0 | O1 | O2 | O3 | AVG | O0 | O1 | O2 | O3 | AVG |
|
22 |
+
| DeepSeek-Coder-6.7B | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.0000 |
|
23 |
+
| GPT-4o | 0.3049 | 0.1159 | 0.1037 | 0.1159 | 0.1601 | 0.0443 | 0.0328 | 0.0397 | 0.0343 | 0.0378 |
|
24 |
+
| LLM4Decompile-End-1.3B | 0.4720 | 0.2061 | 0.2122 | 0.2024 | 0.2732 | 0.1786 | 0.1362 | 0.1320 | 0.1328 | 0.1449 |
|
25 |
+
| LLM4Decompile-End-6.7B | 0.6805 | 0.3951 | 0.3671 | 0.3720 | 0.4537 | 0.2289 | 0.1660 | 0.1618 | 0.1625 | 0.1798 |
|
26 |
+
| LLM4Decompile-End-33B | 0.5168 | 0.2956 | 0.2815 | 0.2675 | 0.3404 | 0.1886 | 0.1465 | 0.1396 | 0.1411 | 0.1540 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
27 |
|
28 |
### 3. How to Use
|
29 |
Here is an example of how to use our model (Revised for V1.5).
|