Spaces:
Running
Running
readme: extend FineWeb-LMs overview
Browse files
README.md
CHANGED
@@ -22,6 +22,7 @@ The following LMs are currently supported:
|
|
22 |
Following LMs were pretrained on the (10BT subset) of the famous [FineWeb](https://huggingface.co/datasets/HuggingFaceFW/fineweb) and [FineWeb-Edu](https://huggingface.co/datasets/HuggingFaceFW/fineweb-edu) dataset:
|
23 |
|
24 |
* BERT-based - find the [best model checkpoint here](https://huggingface.co/model-garden-lms/bert-base-finewebs-951k)
|
|
|
25 |
|
26 |
# ❤️ Acknowledgements
|
27 |
|
|
|
22 |
Following LMs were pretrained on the (10BT subset) of the famous [FineWeb](https://huggingface.co/datasets/HuggingFaceFW/fineweb) and [FineWeb-Edu](https://huggingface.co/datasets/HuggingFaceFW/fineweb-edu) dataset:
|
23 |
|
24 |
* BERT-based - find the [best model checkpoint here](https://huggingface.co/model-garden-lms/bert-base-finewebs-951k)
|
25 |
+
* Token Dropping BERT-based - find the [best model checkpoint here](https://huggingface.co/model-garden-lms/bert-base-token-dropping-finewebs-901k)
|
26 |
|
27 |
# ❤️ Acknowledgements
|
28 |
|