shounakpaul95 commited on
Commit
59f79a1
1 Parent(s): 8011593

Update app.py

Browse files
Files changed (1) hide show
  1. app.py +7 -2
app.py CHANGED
@@ -444,10 +444,15 @@ with demo:
444
 
445
  ```python
446
  from datasets import load_dataset
447
- dataset = load_dataset("Exploration-Lab/IL-TUR","<task_name>")
448
  ```
449
 
450
-
 
 
 
 
 
451
  """
452
  )
453
 
 
444
 
445
  ```python
446
  from datasets import load_dataset
447
+ dataset = load_dataset("Exploration-Lab/IL-TUR", "<task_name>", revision="script")
448
  ```
449
 
450
+ ## Creating a submission file
451
+
452
+ A submission file should exactly follow the format as "IL_TUR_eval_submission_dummy.json".
453
+ Each key in the file corresponds to each task. You can submit predictions for one, multiple, or all tasks.
454
+ However, for any task you submit, you should have predictions corresponding to every instance in the test set (keys in the submission file).
455
+ In most cases, the format of the predictions is similar to that of the gold-standard labels in the dataset.
456
  """
457
  )
458