yarongef commited on
Commit
0ac854d
1 Parent(s): 2ceed49

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -3
README.md CHANGED
@@ -9,6 +9,7 @@ datasets:
9
 
10
  # DistilProtBert model
11
 
12
- Distilled protein language of [ProtBert](https://huggingface.co/Rostlab/prot_bert) pretrained on protein sequences using a masked language modeling (MLM) objective. It was introduced in
13
- [this paper]() and can be used by this
14
- [this repository](). This model is trained on uppercase amino acids: it only works with capital letter amino acids.
 
 
9
 
10
  # DistilProtBert model
11
 
12
+ Distilled protein language of [ProtBert](https://huggingface.co/Rostlab/prot_bert).
13
+ In addition to cross entropy and cosine teacher-student losses, DistilProtBert was pretrained on a masked language modeling (MLM) objective and it only works with capital letter amino acids.
14
+
15
+ # Model description