Commit
•
99fe917
1
Parent(s):
c3d9ccf
Update README.md
Browse files
README.md
CHANGED
|
@@ -27,7 +27,7 @@ It is part of the **family of MosaicBERT-Base models** trained using ALiBi on di
|
|
| 27 |
* [mosaic-bert-base-seqlen-1024](https://huggingface.co/mosaicml/mosaic-bert-base-seqlen-1024)
|
| 28 |
* mosaic-bert-base-seqlen-2048
|
| 29 |
|
| 30 |
-
|
| 31 |
|
| 32 |
## Model Date
|
| 33 |
|
|
|
|
| 27 |
* [mosaic-bert-base-seqlen-1024](https://huggingface.co/mosaicml/mosaic-bert-base-seqlen-1024)
|
| 28 |
* mosaic-bert-base-seqlen-2048
|
| 29 |
|
| 30 |
+
The primary use case of these models is for research on efficient pretraining and finetuning for long context embeddings.
|
| 31 |
|
| 32 |
## Model Date
|
| 33 |
|