LLM4Binary commited on
Commit
06291f5
1 Parent(s): 08bfe99

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -16
README.md CHANGED
@@ -16,22 +16,14 @@ LLM4Decompile aims to decompile x86 assembly instructions into C. The newly rele
16
 
17
  ### 2. Evaluation Results
18
 
19
- +------------------------+-------------------------------------------------+-------------------------------------------------+
20
- | Model/Benchmark | HumanEval-Decompile | ExeBench |
21
- +------------------------+---------+---------+---------+---------+---------+---------+---------+---------+---------+---------+
22
- | Optimization Level | O0 | O1 | O2 | O3 | AVG | O0 | O1 | O2 | O3 | AVG |
23
- +------------------------+---------+---------+---------+---------+---------+---------+---------+---------+---------+---------+
24
- | DeepSeek-Coder-6.7B | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.0000 |
25
- +------------------------+---------+---------+---------+---------+---------+---------+---------+---------+---------+---------+
26
- | GPT-4o | 0.3049 | 0.1159 | 0.1037 | 0.1159 | 0.1601 | 0.0443 | 0.0328 | 0.0397 | 0.0343 | 0.0378 |
27
- +------------------------+---------+---------+---------+---------+---------+---------+---------+---------+---------+---------+
28
- | LLM4Decompile-End-1.3B | 0.4720 | 0.2061 | 0.2122 | 0.2024 | 0.2732 | 0.1786 | 0.1362 | 0.1320 | 0.1328 | 0.1449 |
29
- +------------------------+---------+---------+---------+---------+---------+---------+---------+---------+---------+---------+
30
- | LLM4Decompile-End-6.7B | 0.6805 | 0.3951 | 0.3671 | 0.3720 | 0.4537 | 0.2289 | 0.1660 | 0.1618 | 0.1625 | 0.1798 |
31
- +------------------------+---------+---------+---------+---------+---------+---------+---------+---------+---------+---------+
32
- | LLM4Decompile-End-33B | 0.5168 | 0.2956 | 0.2815 | 0.2675 | 0.3404 | 0.1886 | 0.1465 | 0.1396 | 0.1411 | 0.1540 |
33
- +------------------------+---------+---------+---------+---------+---------+---------+---------+---------+---------+---------+
34
-
35
 
36
  ### 3. How to Use
37
  Here is an example of how to use our model (Revised for V1.5).
 
16
 
17
  ### 2. Evaluation Results
18
 
19
+ | Model/Benchmark | HumanEval-Decompile | | | | | ExeBench | | | | |
20
+ |:----------------------:|:-------------------:|:-------:|:-------:|:-------:|:-------:|:--------:|:-------:|:-------:|:-------:|:-------:|
21
+ | Optimization Level | O0 | O1 | O2 | O3 | AVG | O0 | O1 | O2 | O3 | AVG |
22
+ | DeepSeek-Coder-6.7B | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0.0000 |
23
+ | GPT-4o | 0.3049 | 0.1159 | 0.1037 | 0.1159 | 0.1601 | 0.0443 | 0.0328 | 0.0397 | 0.0343 | 0.0378 |
24
+ | LLM4Decompile-End-1.3B | 0.4720 | 0.2061 | 0.2122 | 0.2024 | 0.2732 | 0.1786 | 0.1362 | 0.1320 | 0.1328 | 0.1449 |
25
+ | LLM4Decompile-End-6.7B | 0.6805 | 0.3951 | 0.3671 | 0.3720 | 0.4537 | 0.2289 | 0.1660 | 0.1618 | 0.1625 | 0.1798 |
26
+ | LLM4Decompile-End-33B | 0.5168 | 0.2956 | 0.2815 | 0.2675 | 0.3404 | 0.1886 | 0.1465 | 0.1396 | 0.1411 | 0.1540 |
 
 
 
 
 
 
 
 
27
 
28
  ### 3. How to Use
29
  Here is an example of how to use our model (Revised for V1.5).