Tom K.'s picture

Tom K.

ToKrCZ

AI & ML interests

None yet

Recent Activity

liked a model about 10 hours ago
tiiuae/Falcon3-Mamba-7B-Base
liked a model 7 days ago
AuraIndustries/Aura-4B
liked a model 9 days ago
deepseek-ai/DeepSeek-V3-Base
View all activity

Organizations

None yet

ToKrCZ's activity

reacted to thomwolf's post with 🚀 25 days ago
view post
Post
4522
We are proud to announce HuggingFaceFW/fineweb-2: A sparkling update to HuggingFaceFW/fineweb with 1000s of 🗣️languages.

We applied the same data-driven approach that led to SOTA English performance in🍷 FineWeb to thousands of languages.

🥂 FineWeb2 has 8TB of compressed text data and outperforms other multilingual datasets in our experiments.

The dataset is released under the permissive 📜 ODC-By 1.0 license, and the 💻 code to reproduce it and our evaluations is public.

We will very soon announce a big community project, and are working on a 📝 blogpost walking you through the entire dataset creation process. Stay tuned!

In the mean time come ask us question on our chat place: HuggingFaceFW/discussion

H/t @guipenedo @hynky @lvwerra as well as @vsabolcec Bettina Messmer @negar-foroutan and @mjaggi
  • 2 replies
·