Spaces:
Runtime error
Runtime error
shounakpaul95
commited on
Commit
•
59f79a1
1
Parent(s):
8011593
Update app.py
Browse files
app.py
CHANGED
@@ -444,10 +444,15 @@ with demo:
|
|
444 |
|
445 |
```python
|
446 |
from datasets import load_dataset
|
447 |
-
dataset = load_dataset("Exploration-Lab/IL-TUR","<task_name>")
|
448 |
```
|
449 |
|
450 |
-
|
|
|
|
|
|
|
|
|
|
|
451 |
"""
|
452 |
)
|
453 |
|
|
|
444 |
|
445 |
```python
|
446 |
from datasets import load_dataset
|
447 |
+
dataset = load_dataset("Exploration-Lab/IL-TUR", "<task_name>", revision="script")
|
448 |
```
|
449 |
|
450 |
+
## Creating a submission file
|
451 |
+
|
452 |
+
A submission file should exactly follow the format as "IL_TUR_eval_submission_dummy.json".
|
453 |
+
Each key in the file corresponds to each task. You can submit predictions for one, multiple, or all tasks.
|
454 |
+
However, for any task you submit, you should have predictions corresponding to every instance in the test set (keys in the submission file).
|
455 |
+
In most cases, the format of the predictions is similar to that of the gold-standard labels in the dataset.
|
456 |
"""
|
457 |
)
|
458 |
|