FineWeb2-C: Help Build Better Language Models in Your Language
•
10
Thomas Wolf PRO
thomwolf
AI & ML interests
NLP and open-source :-)
Recent Activity
upvoted
an
article
1 day ago
FineWeb2-C: Help Build Better Language Models in Your Language
liked
a Space
3 days ago
ECCV/ECCV2024-papers
liked
a model
3 days ago
IamCreateAI/Ruyi-Mini-7B
Articles
Organizations
Posts
12
Post
4322
We are proud to announce
HuggingFaceFW/fineweb-2: A sparkling update to
HuggingFaceFW/fineweb with 1000s of 🗣️languages.
We applied the same data-driven approach that led to SOTA English performance in🍷 FineWeb to thousands of languages.
🥂 FineWeb2 has 8TB of compressed text data and outperforms other multilingual datasets in our experiments.
The dataset is released under the permissive 📜 ODC-By 1.0 license, and the 💻 code to reproduce it and our evaluations is public.
We will very soon announce a big community project, and are working on a 📝 blogpost walking you through the entire dataset creation process. Stay tuned!
In the mean time come ask us question on our chat place: HuggingFaceFW/discussion
H/t @guipenedo @hynky @lvwerra as well as @vsabolcec Bettina Messmer @negar-foroutan and @mjaggi
We applied the same data-driven approach that led to SOTA English performance in🍷 FineWeb to thousands of languages.
🥂 FineWeb2 has 8TB of compressed text data and outperforms other multilingual datasets in our experiments.
The dataset is released under the permissive 📜 ODC-By 1.0 license, and the 💻 code to reproduce it and our evaluations is public.
We will very soon announce a big community project, and are working on a 📝 blogpost walking you through the entire dataset creation process. Stay tuned!
In the mean time come ask us question on our chat place: HuggingFaceFW/discussion
H/t @guipenedo @hynky @lvwerra as well as @vsabolcec Bettina Messmer @negar-foroutan and @mjaggi
Post
880
Exponentially growing number of open-source AI models over the course of the past 30 months – from a few thousands to over 1 million and more
Interactive data viz: huggingface/open-source-ai-year-in-review-2024
Interactive data viz: huggingface/open-source-ai-year-in-review-2024
Collections
1
A collection of papers on GUI agents
-
ShowUI: One Vision-Language-Action Model for GUI Visual Agent
Paper • 2411.17465 • Published • 76 -
Aguvis: Unified Pure Vision Agents for Autonomous GUI Interaction
Paper • 2412.04454 • Published • 48 -
AgentTrek: Agent Trajectory Synthesis via Guiding Replay with Web Tutorials
Paper • 2412.09605 • Published • 25
spaces
10
models
6
datasets
21
thomwolf/my-distiset-88a662c1
Viewer
•
Updated
•
10
•
39
thomwolf/my-distiset-340ae369
Viewer
•
Updated
•
10
•
47
thomwolf/distilabel-example-test
Viewer
•
Updated
•
10
•
34
thomwolf/distilabel-example
Viewer
•
Updated
•
10
•
40
thomwolf/blue_sort
Updated
•
49
thomwolf/data_test
Updated
•
60
thomwolf/cameras_conditions
Viewer
•
Updated
•
214
•
31
thomwolf/lerobot-sort2
Preview
•
Updated
•
92
•
1
thomwolf/lerobot-sort3
Preview
•
Updated
•
6
thomwolf/act-raw-sort3
Updated
•
174