leo19941227 commited on
Commit
62488f8
1 Parent(s): 9a1bc5c

emphasize private submission

Browse files
README.md CHANGED
@@ -2,11 +2,11 @@
2
 
3
  Welcome to the [SUPERB Challenge](https://superbbenchmark.org/challenge)! SUPERB is a collection of benchmarking resources to evaluate the capability of a universal shared representation for speech processing. It comes with a benchmark on the publicly available datasets and a challenge on a secret/not released hidden dataset. In SUPERB Challenge, a challenging hidden dataset is newly recorded to evaluate the ultimate generaliziblity across various tasks and data.
4
 
5
- You can participate the challenge by simply submitting your self-supervised (SSL) pretrained models (model definition & pretrained weights), and we benchmark it with the hidden dataset. This repository constains useful tools to let you easliy [submit](https://superbbenchmark.org/submit) your models for evaluation to [the challenge leaderboard](https://superbbenchmark.org/leaderboard):
6
 
7
  1. Generate a submission template
8
  2. Validate the format/interface correctness of your model
9
- 3. Upload to Huggingface's Hub
10
  4. Submit the upload information to [SUPERB website](https://superbbenchmark.org/submit)
11
 
12
  #### Note 1.
@@ -21,7 +21,7 @@ If you are not feasible to submit the pre-trained model, please [fill this form]
21
 
22
  ### 1. Create an account and organization on the Hugging Face Hub
23
 
24
- First create an account on the Hugging Face Hub and you can sign up [here](https://huggingface.co/join) if you haven't already! Next, create a new organization and invite the SUPERB Hidden Set Committee to join. You will upload your model to a repository under this organization so that members inside it can access the model.
25
 
26
  * [superb-hidden-set](https://huggingface.co/superb-hidden-set)
27
 
 
2
 
3
  Welcome to the [SUPERB Challenge](https://superbbenchmark.org/challenge)! SUPERB is a collection of benchmarking resources to evaluate the capability of a universal shared representation for speech processing. It comes with a benchmark on the publicly available datasets and a challenge on a secret/not released hidden dataset. In SUPERB Challenge, a challenging hidden dataset is newly recorded to evaluate the ultimate generaliziblity across various tasks and data.
4
 
5
+ You can participate the challenge by simply submitting your self-supervised (SSL) pretrained models (model definition & pretrained weights), and we benchmark it with the hidden dataset. This repository constains useful tools to let you easliy [submit](https://superbbenchmark.org/submit) your models ***privately*** for evaluation to [the challenge hidden-set leaderboard](https://superbbenchmark.org/leaderboard?track=constrained&subset=Hidden+Dev+Set).
6
 
7
  1. Generate a submission template
8
  2. Validate the format/interface correctness of your model
9
+ 3. Upload to Huggingface's Hub (privately)
10
  4. Submit the upload information to [SUPERB website](https://superbbenchmark.org/submit)
11
 
12
  #### Note 1.
 
21
 
22
  ### 1. Create an account and organization on the Hugging Face Hub
23
 
24
+ First create an account on the Hugging Face Hub and you can sign up [here](https://huggingface.co/join) if you haven't already! Next, create a new organization and invite the SUPERB Hidden Set Committee to join. You will upload your model to a repository under this organization so that members inside it can access the model which is not publicly available.
25
 
26
  * [superb-hidden-set](https://huggingface.co/superb-hidden-set)
27
 
{{cookiecutter.repo_name}}/README.md CHANGED
@@ -2,11 +2,11 @@
2
 
3
  Welcome to the [SUPERB Challenge](https://superbbenchmark.org/challenge)! SUPERB is a collection of benchmarking resources to evaluate the capability of a universal shared representation for speech processing. It comes with a benchmark on the publicly available datasets and a challenge on a secret/not released hidden dataset. In SUPERB Challenge, a challenging hidden dataset is newly recorded to evaluate the ultimate generaliziblity across various tasks and data.
4
 
5
- You can participate the challenge by simply submitting your self-supervised (SSL) pretrained models (model definition & pretrained weights), and we benchmark it with the hidden dataset. This repository constains useful tools to let you easliy [submit](https://superbbenchmark.org/submit) your models for evaluation to [the challenge leaderboard](https://superbbenchmark.org/leaderboard):
6
 
7
  1. Generate a submission template
8
  2. Validate the format/interface correctness of your model
9
- 3. Upload to Huggingface's Hub
10
  4. Submit the upload information to [SUPERB website](https://superbbenchmark.org/submit)
11
 
12
  #### Note 1.
@@ -21,7 +21,7 @@ If you are not feasible to submit the pre-trained model, please [fill this form]
21
 
22
  ### 1. Create an account and organization on the Hugging Face Hub
23
 
24
- First create an account on the Hugging Face Hub and you can sign up [here](https://huggingface.co/join) if you haven't already! Next, create a new organization and invite the SUPERB Hidden Set Committee to join. You will upload your model to a repository under this organization so that members inside it can access the model.
25
 
26
  * [superb-hidden-set](https://huggingface.co/superb-hidden-set)
27
 
 
2
 
3
  Welcome to the [SUPERB Challenge](https://superbbenchmark.org/challenge)! SUPERB is a collection of benchmarking resources to evaluate the capability of a universal shared representation for speech processing. It comes with a benchmark on the publicly available datasets and a challenge on a secret/not released hidden dataset. In SUPERB Challenge, a challenging hidden dataset is newly recorded to evaluate the ultimate generaliziblity across various tasks and data.
4
 
5
+ You can participate the challenge by simply submitting your self-supervised (SSL) pretrained models (model definition & pretrained weights), and we benchmark it with the hidden dataset. This repository constains useful tools to let you easliy [submit](https://superbbenchmark.org/submit) your models ***privately*** for evaluation to [the challenge hidden-set leaderboard](https://superbbenchmark.org/leaderboard?track=constrained&subset=Hidden+Dev+Set).
6
 
7
  1. Generate a submission template
8
  2. Validate the format/interface correctness of your model
9
+ 3. Upload to Huggingface's Hub (privately)
10
  4. Submit the upload information to [SUPERB website](https://superbbenchmark.org/submit)
11
 
12
  #### Note 1.
 
21
 
22
  ### 1. Create an account and organization on the Hugging Face Hub
23
 
24
+ First create an account on the Hugging Face Hub and you can sign up [here](https://huggingface.co/join) if you haven't already! Next, create a new organization and invite the SUPERB Hidden Set Committee to join. You will upload your model to a repository under this organization so that members inside it can access the model which is not publicly available.
25
 
26
  * [superb-hidden-set](https://huggingface.co/superb-hidden-set)
27