leo19941227
commited on
Commit
•
62488f8
1
Parent(s):
9a1bc5c
emphasize private submission
Browse files- README.md +3 -3
- {{cookiecutter.repo_name}}/README.md +3 -3
README.md
CHANGED
@@ -2,11 +2,11 @@
|
|
2 |
|
3 |
Welcome to the [SUPERB Challenge](https://superbbenchmark.org/challenge)! SUPERB is a collection of benchmarking resources to evaluate the capability of a universal shared representation for speech processing. It comes with a benchmark on the publicly available datasets and a challenge on a secret/not released hidden dataset. In SUPERB Challenge, a challenging hidden dataset is newly recorded to evaluate the ultimate generaliziblity across various tasks and data.
|
4 |
|
5 |
-
You can participate the challenge by simply submitting your self-supervised (SSL) pretrained models (model definition & pretrained weights), and we benchmark it with the hidden dataset. This repository constains useful tools to let you easliy [submit](https://superbbenchmark.org/submit) your models for evaluation to [the challenge leaderboard](https://superbbenchmark.org/leaderboard)
|
6 |
|
7 |
1. Generate a submission template
|
8 |
2. Validate the format/interface correctness of your model
|
9 |
-
3. Upload to Huggingface's Hub
|
10 |
4. Submit the upload information to [SUPERB website](https://superbbenchmark.org/submit)
|
11 |
|
12 |
#### Note 1.
|
@@ -21,7 +21,7 @@ If you are not feasible to submit the pre-trained model, please [fill this form]
|
|
21 |
|
22 |
### 1. Create an account and organization on the Hugging Face Hub
|
23 |
|
24 |
-
First create an account on the Hugging Face Hub and you can sign up [here](https://huggingface.co/join) if you haven't already! Next, create a new organization and invite the SUPERB Hidden Set Committee to join. You will upload your model to a repository under this organization so that members inside it can access the model.
|
25 |
|
26 |
* [superb-hidden-set](https://huggingface.co/superb-hidden-set)
|
27 |
|
|
|
2 |
|
3 |
Welcome to the [SUPERB Challenge](https://superbbenchmark.org/challenge)! SUPERB is a collection of benchmarking resources to evaluate the capability of a universal shared representation for speech processing. It comes with a benchmark on the publicly available datasets and a challenge on a secret/not released hidden dataset. In SUPERB Challenge, a challenging hidden dataset is newly recorded to evaluate the ultimate generaliziblity across various tasks and data.
|
4 |
|
5 |
+
You can participate the challenge by simply submitting your self-supervised (SSL) pretrained models (model definition & pretrained weights), and we benchmark it with the hidden dataset. This repository constains useful tools to let you easliy [submit](https://superbbenchmark.org/submit) your models ***privately*** for evaluation to [the challenge hidden-set leaderboard](https://superbbenchmark.org/leaderboard?track=constrained&subset=Hidden+Dev+Set).
|
6 |
|
7 |
1. Generate a submission template
|
8 |
2. Validate the format/interface correctness of your model
|
9 |
+
3. Upload to Huggingface's Hub (privately)
|
10 |
4. Submit the upload information to [SUPERB website](https://superbbenchmark.org/submit)
|
11 |
|
12 |
#### Note 1.
|
|
|
21 |
|
22 |
### 1. Create an account and organization on the Hugging Face Hub
|
23 |
|
24 |
+
First create an account on the Hugging Face Hub and you can sign up [here](https://huggingface.co/join) if you haven't already! Next, create a new organization and invite the SUPERB Hidden Set Committee to join. You will upload your model to a repository under this organization so that members inside it can access the model which is not publicly available.
|
25 |
|
26 |
* [superb-hidden-set](https://huggingface.co/superb-hidden-set)
|
27 |
|
{{cookiecutter.repo_name}}/README.md
CHANGED
@@ -2,11 +2,11 @@
|
|
2 |
|
3 |
Welcome to the [SUPERB Challenge](https://superbbenchmark.org/challenge)! SUPERB is a collection of benchmarking resources to evaluate the capability of a universal shared representation for speech processing. It comes with a benchmark on the publicly available datasets and a challenge on a secret/not released hidden dataset. In SUPERB Challenge, a challenging hidden dataset is newly recorded to evaluate the ultimate generaliziblity across various tasks and data.
|
4 |
|
5 |
-
You can participate the challenge by simply submitting your self-supervised (SSL) pretrained models (model definition & pretrained weights), and we benchmark it with the hidden dataset. This repository constains useful tools to let you easliy [submit](https://superbbenchmark.org/submit) your models for evaluation to [the challenge leaderboard](https://superbbenchmark.org/leaderboard)
|
6 |
|
7 |
1. Generate a submission template
|
8 |
2. Validate the format/interface correctness of your model
|
9 |
-
3. Upload to Huggingface's Hub
|
10 |
4. Submit the upload information to [SUPERB website](https://superbbenchmark.org/submit)
|
11 |
|
12 |
#### Note 1.
|
@@ -21,7 +21,7 @@ If you are not feasible to submit the pre-trained model, please [fill this form]
|
|
21 |
|
22 |
### 1. Create an account and organization on the Hugging Face Hub
|
23 |
|
24 |
-
First create an account on the Hugging Face Hub and you can sign up [here](https://huggingface.co/join) if you haven't already! Next, create a new organization and invite the SUPERB Hidden Set Committee to join. You will upload your model to a repository under this organization so that members inside it can access the model.
|
25 |
|
26 |
* [superb-hidden-set](https://huggingface.co/superb-hidden-set)
|
27 |
|
|
|
2 |
|
3 |
Welcome to the [SUPERB Challenge](https://superbbenchmark.org/challenge)! SUPERB is a collection of benchmarking resources to evaluate the capability of a universal shared representation for speech processing. It comes with a benchmark on the publicly available datasets and a challenge on a secret/not released hidden dataset. In SUPERB Challenge, a challenging hidden dataset is newly recorded to evaluate the ultimate generaliziblity across various tasks and data.
|
4 |
|
5 |
+
You can participate the challenge by simply submitting your self-supervised (SSL) pretrained models (model definition & pretrained weights), and we benchmark it with the hidden dataset. This repository constains useful tools to let you easliy [submit](https://superbbenchmark.org/submit) your models ***privately*** for evaluation to [the challenge hidden-set leaderboard](https://superbbenchmark.org/leaderboard?track=constrained&subset=Hidden+Dev+Set).
|
6 |
|
7 |
1. Generate a submission template
|
8 |
2. Validate the format/interface correctness of your model
|
9 |
+
3. Upload to Huggingface's Hub (privately)
|
10 |
4. Submit the upload information to [SUPERB website](https://superbbenchmark.org/submit)
|
11 |
|
12 |
#### Note 1.
|
|
|
21 |
|
22 |
### 1. Create an account and organization on the Hugging Face Hub
|
23 |
|
24 |
+
First create an account on the Hugging Face Hub and you can sign up [here](https://huggingface.co/join) if you haven't already! Next, create a new organization and invite the SUPERB Hidden Set Committee to join. You will upload your model to a repository under this organization so that members inside it can access the model which is not publicly available.
|
25 |
|
26 |
* [superb-hidden-set](https://huggingface.co/superb-hidden-set)
|
27 |
|