Hugging Face's logo

yarongef
/
DistilProtBert

Fill-Mask
Transformers
PyTorch
bert
protein language model
Inference Endpoints
Model card Files Community
1
yarongef commited on
Commit
1710191
·
1 Parent(s): b63691f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -16,7 +16,7 @@ In addition to cross entropy and cosine teacher-student losses, DistilProtBert w
16
  Access to [git](https://github.com/yarongef/DistilProtBert)
17
  # DistilProtBert comparison to ProtBert
18
 
19
- | **Model** | **# of parameters** | **# of hidden layers** | **Pretraining dataset** | **# of pretraining sequences** | **Pretraining hardware** |
20
  |:--------------:|:-------------------:|:----------------------:|:-----------------------:|:------------------------------:|:------------------------:|
21
  | ProtBert | 420M | 30 | UniRef100 | 216M | 512 16GB Tpus |
22
  | DistilProtBert | 230M | 15 | UniRef50 | 43M | 5 v100 32GB GPUs |
 
16
  Access to [git](https://github.com/yarongef/DistilProtBert)
17
  # DistilProtBert comparison to ProtBert
18
 
19
+ | **Model** | **# of parameters** | **# of hidden layers** | **Pretraining dataset** | **# of proteins** | **Pretraining hardware** |
20
  |:--------------:|:-------------------:|:----------------------:|:-----------------------:|:------------------------------:|:------------------------:|
21
  | ProtBert | 420M | 30 | UniRef100 | 216M | 512 16GB Tpus |
22
  | DistilProtBert | 230M | 15 | UniRef50 | 43M | 5 v100 32GB GPUs |