jacobfulano
commited on
Commit
•
6f75d01
1
Parent(s):
6fccab2
Update README.md
Browse files
README.md
CHANGED
@@ -25,8 +25,9 @@ It is part of the **family of MosaicBERT-Base models** trained using ALiBi on di
|
|
25 |
* mosaic-bert-base-seqlen-256
|
26 |
* [mosaic-bert-base-seqlen-512](https://huggingface.co/mosaicml/mosaic-bert-base-seqlen-512)
|
27 |
* [mosaic-bert-base-seqlen-1024](https://huggingface.co/mosaicml/mosaic-bert-base-seqlen-1024)
|
28 |
-
* [mosaic-bert-base-seqlen-2048](https://huggingface.co/mosaicml/mosaic-bert-base-seqlen-2048)
|
29 |
|
|
|
30 |
|
31 |
|
32 |
## Model Date
|
|
|
25 |
* mosaic-bert-base-seqlen-256
|
26 |
* [mosaic-bert-base-seqlen-512](https://huggingface.co/mosaicml/mosaic-bert-base-seqlen-512)
|
27 |
* [mosaic-bert-base-seqlen-1024](https://huggingface.co/mosaicml/mosaic-bert-base-seqlen-1024)
|
28 |
+
* [mosaic-bert-base-seqlen-2048](https://huggingface.co/mosaicml/mosaic-bert-base-seqlen-2048)
|
29 |
|
30 |
+
The primary use case of these models is for research on efficient pretraining and finetuning for long context embeddings.
|
31 |
|
32 |
|
33 |
## Model Date
|