mosaicml
/

mosaic-bert-base-seqlen-2048

Model card Files Files and versions Community

mosaic-bert-base-seqlen-2048

Commit History

Create LICENSE

9f28d43
verified

kobindra commited on Mar 5, 2024

Update citation in README

d257607

jacobfulano commited on Jan 3, 2024

Update Readme to clarify how to load model

f5a307f

jacobfulano commited on Jan 3, 2024

Change attention_probs_dropout_prob to 0.1 so that triton FlashAttention dependencies are avoided

2e90941

jacobfulano commited on Jan 3, 2024

Update config so that alibi_starting_size is explicitly set to 2048

97f26fe

jacobfulano commited on May 31, 2023

Update README.md

99fe917

jacobfulano commited on May 2, 2023

Update README.md

c3d9ccf

jacobfulano commited on May 2, 2023

Update README.md

3a454d2

jacobfulano commited on May 1, 2023

Create README.md

d9748e0

jacobfulano commited on May 1, 2023

Upload BertForMaskedLM

b7a0389

jacobfulano commited on May 1, 2023

initial commit

2e2799a

jacobfulano commited on May 1, 2023