mosaicml
/

mosaic-bert-base-seqlen-256

Model card Files Files and versions Community

mosaic-bert-base-seqlen-256

Commit History

Create LICENSE (#1)

5137f0d
verified

kobindra commited on Mar 5, 2024

Clarify how to load model and use ALiBi

4f88b6e

jacobfulano commited on Jan 3, 2024

Update citation in README

885cc97

jacobfulano commited on Jan 3, 2024

Change attention_probs_dropout_prob to 0.1 so that triton FlashAttention dependencies are avoided

48ab7cc

jacobfulano commited on Jan 3, 2024

Update README.md

6f75d01

jacobfulano commited on May 2, 2023

Update README.md

6fccab2

jacobfulano commited on May 2, 2023

Create README.md

82a6d46

jacobfulano commited on May 2, 2023

Upload BertForMaskedLM

51f2ae5

jacobfulano commited on May 2, 2023

initial commit

779c4a9

jacobfulano commited on May 2, 2023