sileod commited on
Commit
bb7474c
1 Parent(s): 48f9a72

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -161,6 +161,8 @@ The number of examples per task was capped to 64. The model was trained for 20k
161
  You can fine-tune this model to use it for multiple-choice or any classification task (e.g. NLI) like any debertav2 model.
162
  This model has strong zero-shot validation performance on many tasks (e.g. 70% on WNLI).
163
 
 
 
164
  The list of tasks is available in tasks.md
165
 
166
  code: https://colab.research.google.com/drive/1iB4Oxl9_B5W3ZDzXoWJN-olUbqLBxgQS?usp=sharing
 
161
  You can fine-tune this model to use it for multiple-choice or any classification task (e.g. NLI) like any debertav2 model.
162
  This model has strong zero-shot validation performance on many tasks (e.g. 70% on WNLI).
163
 
164
+ The untuned model CLS embedding also has strong linear probing performance (90% on MNLI), due to the multitask training.
165
+
166
  The list of tasks is available in tasks.md
167
 
168
  code: https://colab.research.google.com/drive/1iB4Oxl9_B5W3ZDzXoWJN-olUbqLBxgQS?usp=sharing