📀 Dataset comparison models - a HuggingFaceFW Collection

HuggingFaceFW 's Collections

🍷 FineWeb datasets

📚 FineWeb-Edu

📀 Dataset comparison models

🧪 FineWeb v1 data experiments

📀 Dataset comparison models

updated Jun 12

1.8B models trained on 350BT to compare different pretraining datasets

HuggingFaceFW/ablation-model-fineweb-edu

Text Generation • Updated Jun 11 • 537 • 11
HuggingFaceFW/ablation-model-fineweb-v1

Text Generation • Updated Apr 25 • 453 • 13
HuggingFaceFW/ablation-model-refinedweb

Text Generation • Updated Apr 25 • 14 • 2
HuggingFaceFW/ablation-model-c4

Text Generation • Updated Apr 25 • 3.98k • 3
HuggingFaceFW/ablation-model-dolma-v1_6

Text Generation • Updated Apr 25 • 17 • 1
HuggingFaceFW/ablation-model-slimpajama

Text Generation • Updated Apr 25 • 14 • 1
HuggingFaceFW/ablation-model-the-pile

Text Generation • Updated Apr 25 • 4.23k • 1
HuggingFaceFW/ablation-model-redpajama2

Text Generation • Updated May 5 • 17