Update src/tasks_content.py
Browse files- src/tasks_content.py +2 -1
src/tasks_content.py
CHANGED
@@ -46,6 +46,7 @@ TASKS_DESCRIPTIONS = {
|
|
46 |
* `medium-context`: 224 data points,
|
47 |
* `large-context`: 270 data points,
|
48 |
* `huge-context`: 296 data points.
|
|
|
49 |
Each data point contains the file for completion, a list of lines to complete with their categories (see the categorization below),
|
50 |
and a repository snapshot that can be used to build the context.
|
51 |
|
@@ -63,7 +64,7 @@ TASKS_DESCRIPTIONS = {
|
|
63 |
|
64 |
"commit_message_generation": """# Commit message generation\n
|
65 |
|
66 |
-
Our Commit message generation benchmark 🤗 [JetBrains-Research/lca-commit-message-generation](https://huggingface.co/datasets/JetBrains-Research/lca-commit-message-generation) includes 163 manually curated commits with large diffs from 34 Python projects.
|
67 |
|
68 |
We use the following metrics for evaluation:
|
69 |
* [BLEU](https://huggingface.co/spaces/evaluate-metric/sacrebleu)
|
|
|
46 |
* `medium-context`: 224 data points,
|
47 |
* `large-context`: 270 data points,
|
48 |
* `huge-context`: 296 data points.
|
49 |
+
|
50 |
Each data point contains the file for completion, a list of lines to complete with their categories (see the categorization below),
|
51 |
and a repository snapshot that can be used to build the context.
|
52 |
|
|
|
64 |
|
65 |
"commit_message_generation": """# Commit message generation\n
|
66 |
|
67 |
+
Our Commit message generation benchmark 🤗 [JetBrains-Research/lca-commit-message-generation](https://huggingface.co/datasets/JetBrains-Research/lca-commit-message-generation) includes 163 manually curated commits with large diffs from 34 Python projects, which the model needs to generate commit messages for.
|
68 |
|
69 |
We use the following metrics for evaluation:
|
70 |
* [BLEU](https://huggingface.co/spaces/evaluate-metric/sacrebleu)
|