google-bert/bert-base-cased

Fill-Mask • Updated Feb 19 • 8.67M • 268

Note Base BERT model, smaller variant. Trained on the "cased" dataset, meaning that it wasn't lowercase and all accents were kept. 12-layer, 768-hidden, 12-heads , 110M parameters

google-bert/bert-base-uncased

Fill-Mask • Updated Feb 19 • 68.3M • • 1.92k

Note Base BERT model, smaller variant. Trained on the "uncased" dataset, meaning that it was lowercase and all accents were removed. 12-layer, 768-hidden, 12-heads , 110M parameters

google-bert/bert-large-cased

Fill-Mask • Updated Feb 19 • 1.21M • 31

Note Large BERT model, larger variant. Trained on the "cased" dataset, meaning that it wasn't lowercase and all accents were kept. 24-layer, 1024-hidden, 16-heads, 340M parameters

google-bert/bert-large-uncased

Fill-Mask • Updated Feb 19 • 1.82M • 115

Note Large BERT model, larger variant. Trained on the "uncased" dataset, meaning that it was lowercase and all accents were removed. 24-layer, 1024-hidden, 16-heads, 340M parameters

google-bert/bert-base-multilingual-cased

Fill-Mask • Updated Feb 19 • 5.3M • 449

Note Base BERT model, smaller variant. The list of supported languages is available here: https://github.com/google-research/bert/blob/master/multilingual.md#list-of-languages 104 languages, 12-layer, 768-hidden, 12-heads, 110M parameters

google-bert/bert-base-chinese

Fill-Mask • Updated Feb 19 • 1.65M • 996

Note Base BERT model, smaller variant. Chinese Simplified and Traditional, 12-layer, 768-hidden, 12-heads, 110M parameters

google-bert/bert-large-cased-whole-word-masking

Fill-Mask • Updated Apr 10 • 4.3k • 15

Note Large BERT model, larger variant. Trained on the "cased" dataset, meaning that it wasn't lowercase and all accents were kept. Whole word masking indicates a different preprocessing where entire words are masked rather than subwords. The BERT team reports better metrics with the wwm models. 24-layer, 1024-hidden, 16-heads, 340M parameters

google-bert/bert-large-uncased-whole-word-masking

Fill-Mask • Updated Feb 19 • 28.2k • 19

Note Large BERT model, larger variant. Trained on the "uncased" dataset, meaning that it was lowercase and all accents were removed. Whole word masking indicates a different preprocessing where entire words are masked rather than subwords. The BERT team reports better metrics with the wwm models. 24-layer, 1024-hidden, 16-heads, 340M parameters