Commit
•
aa6b5d3
1
Parent(s):
7961458
Update src/tasks_content.py
Browse files- src/tasks_content.py +7 -1
src/tasks_content.py
CHANGED
|
@@ -25,7 +25,13 @@ TASKS_DESCRIPTIONS = {
|
|
| 25 |
|
| 26 |
**Note.** The leaderboard is sorted by ROUGE-1 metric by default.
|
| 27 |
""",
|
| 28 |
-
"bug_localization": "
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 29 |
"module_to_text": """# Module-to-Text\n
|
| 30 |
|
| 31 |
Our Module-to-Text benchmark 🤗 [JetBrains-Research/lca-module-to-text](https://huggingface.co/datasets/JetBrains-Research/lca-module-to-text) includes 206 manually curated text files describing modules from different Python projects.
|
|
|
|
| 25 |
|
| 26 |
**Note.** The leaderboard is sorted by ROUGE-1 metric by default.
|
| 27 |
""",
|
| 28 |
+
"bug_localization": """# Bug Localization\n
|
| 29 |
+
|
| 30 |
+
Our Module-to-Text benchmark 🤗 [JetBrains-Research/lca-bug-localization](https://huggingface.co/datasets/JetBrains-Research/lca-bug-localization) includes 7,479 bug issue descriptions with information about pull request that fix them for Python, Java and Kotlin projects.
|
| 31 |
+
|
| 32 |
+
Moreover, 150 data points from the test split were manually verified and can be used for bug localization approaches evaluation.
|
| 33 |
+
We used information retrieval metrics such as R@k, P@k and F1-score for evaluation, taking k equals to 2.
|
| 34 |
+
""",
|
| 35 |
"module_to_text": """# Module-to-Text\n
|
| 36 |
|
| 37 |
Our Module-to-Text benchmark 🤗 [JetBrains-Research/lca-module-to-text](https://huggingface.co/datasets/JetBrains-Research/lca-module-to-text) includes 206 manually curated text files describing modules from different Python projects.
|