stefan-it commited on
Commit
d76bda4
·
verified ·
1 Parent(s): ee0de29

readme: extend FineWeb-LMs overview

Browse files
Files changed (1) hide show
  1. README.md +1 -0
README.md CHANGED
@@ -22,6 +22,7 @@ The following LMs are currently supported:
22
  Following LMs were pretrained on the (10BT subset) of the famous [FineWeb](https://huggingface.co/datasets/HuggingFaceFW/fineweb) and [FineWeb-Edu](https://huggingface.co/datasets/HuggingFaceFW/fineweb-edu) dataset:
23
 
24
  * BERT-based - find the [best model checkpoint here](https://huggingface.co/model-garden-lms/bert-base-finewebs-951k)
 
25
 
26
  # ❤️ Acknowledgements
27
 
 
22
  Following LMs were pretrained on the (10BT subset) of the famous [FineWeb](https://huggingface.co/datasets/HuggingFaceFW/fineweb) and [FineWeb-Edu](https://huggingface.co/datasets/HuggingFaceFW/fineweb-edu) dataset:
23
 
24
  * BERT-based - find the [best model checkpoint here](https://huggingface.co/model-garden-lms/bert-base-finewebs-951k)
25
+ * Token Dropping BERT-based - find the [best model checkpoint here](https://huggingface.co/model-garden-lms/bert-base-token-dropping-finewebs-901k)
26
 
27
  # ❤️ Acknowledgements
28