Update README.md
Browse files
README.md
CHANGED
@@ -161,6 +161,8 @@ The number of examples per task was capped to 64. The model was trained for 20k
|
|
161 |
You can fine-tune this model to use it for multiple-choice or any classification task (e.g. NLI) like any debertav2 model.
|
162 |
This model has strong zero-shot validation performance on many tasks (e.g. 70% on WNLI).
|
163 |
|
|
|
|
|
164 |
The list of tasks is available in tasks.md
|
165 |
|
166 |
code: https://colab.research.google.com/drive/1iB4Oxl9_B5W3ZDzXoWJN-olUbqLBxgQS?usp=sharing
|
|
|
161 |
You can fine-tune this model to use it for multiple-choice or any classification task (e.g. NLI) like any debertav2 model.
|
162 |
This model has strong zero-shot validation performance on many tasks (e.g. 70% on WNLI).
|
163 |
|
164 |
+
The untuned model CLS embedding also has strong linear probing performance (90% on MNLI), due to the multitask training.
|
165 |
+
|
166 |
The list of tasks is available in tasks.md
|
167 |
|
168 |
code: https://colab.research.google.com/drive/1iB4Oxl9_B5W3ZDzXoWJN-olUbqLBxgQS?usp=sharing
|