SmolLM - blazingly fast and remarkably powerful
โข
292
Loubna Ben Allal
loubnabnl
AI & ML interests
SmolLMs, ML for code, data
Recent Activity
updated
a dataset
1 day ago
loubnabnl/mmlu-evals-smollm-360m
updated
a dataset
1 day ago
loubnabnl/code_data
updated
a dataset
1 day ago
loubnabnl/english-web-100k
Articles
Organizations
loubnabnl's activity
reacted to
ginipick's
post with ๐ฅ
1 day ago
Post
3773
๐ Digital Odyssey: AI Image & Video Generation Platform ๐จ
Welcome to our all-in-one AI platform for image and video generation! ๐
โจ Key Features
๐จ High-quality image generation from text
๐ฅ Video creation from still images
๐ Multi-language support with automatic translation
๐ ๏ธ Advanced customization options
๐ซ Unique Advantages
โก Fast and accurate results using FLUX.1-dev and Hyper-SD models
๐ Robust content safety filtering system
๐ฏ Intuitive user interface
๐ ๏ธ Extended toolkit including image upscaling and logo generation
๐ฎ How to Use
Enter your image or video description
Adjust settings as needed
Click generate
Save and share your results automatically
๐ง Tech Stack
FluxPipeline
Gradio
PyTorch
OpenCV
link: ginigen/Dokdo
Turn your imagination into reality with AI! โจ
#AI #ImageGeneration #VideoGeneration #MachineLearning #CreativeTech
Welcome to our all-in-one AI platform for image and video generation! ๐
โจ Key Features
๐จ High-quality image generation from text
๐ฅ Video creation from still images
๐ Multi-language support with automatic translation
๐ ๏ธ Advanced customization options
๐ซ Unique Advantages
โก Fast and accurate results using FLUX.1-dev and Hyper-SD models
๐ Robust content safety filtering system
๐ฏ Intuitive user interface
๐ ๏ธ Extended toolkit including image upscaling and logo generation
๐ฎ How to Use
Enter your image or video description
Adjust settings as needed
Click generate
Save and share your results automatically
๐ง Tech Stack
FluxPipeline
Gradio
PyTorch
OpenCV
link: ginigen/Dokdo
Turn your imagination into reality with AI! โจ
#AI #ImageGeneration #VideoGeneration #MachineLearning #CreativeTech
- 6 replies
reacted to
anton-l's
post with ๐๐ฅ
4 days ago
Post
1887
Introducing ๐๐
๐ข๐ง๐๐๐๐ญ๐ก: the best public math pre-training dataset with 50B+ tokens!
HuggingFaceTB/finemath
Math remains challenging for LLMs and by training on FineMath we see considerable gains over other math datasets, especially on GSM8K and MATH.
We build the dataset by:
๐ ๏ธ carefully extracting math data from Common Crawl;
๐ iteratively filtering and recalling high quality math pages using a classifier trained on synthetic annotations to identify math reasoning and deduction.
We conducted a series of ablations comparing the performance of Llama-3.2-3B-Base after continued pre-training on FineMath and observe notable gains compared to the baseline model and other public math datasets.
We hope this helps advance the performance of LLMs on math and reasoning! ๐
Weโre also releasing all the ablation models as well as the evaluation code.
HuggingFaceTB/finemath-6763fb8f71b6439b653482c2
HuggingFaceTB/finemath
Math remains challenging for LLMs and by training on FineMath we see considerable gains over other math datasets, especially on GSM8K and MATH.
We build the dataset by:
๐ ๏ธ carefully extracting math data from Common Crawl;
๐ iteratively filtering and recalling high quality math pages using a classifier trained on synthetic annotations to identify math reasoning and deduction.
We conducted a series of ablations comparing the performance of Llama-3.2-3B-Base after continued pre-training on FineMath and observe notable gains compared to the baseline model and other public math datasets.
We hope this helps advance the performance of LLMs on math and reasoning! ๐
Weโre also releasing all the ablation models as well as the evaluation code.
HuggingFaceTB/finemath-6763fb8f71b6439b653482c2
reacted to
julien-c's
post with ๐ฅโค๏ธ๐ค
12 days ago
Post
7427
After some heated discussion ๐ฅ, we clarify our intent re. storage limits on the Hub
TL;DR:
- public storage is free, and (unless blatant abuse) unlimited. We do ask that you consider upgrading to PRO and/or Enterprise Hub if possible
- private storage is paid above a significant free tier (1TB if you have a paid account, 100GB otherwise)
docs: https://huggingface.co/docs/hub/storage-limits
We optimize our infrastructure continuously to scale our storage for the coming years of growth in Machine learning, to the benefit of the community ๐ฅ
cc: @reach-vb @pierric @victor and the HF team
TL;DR:
- public storage is free, and (unless blatant abuse) unlimited. We do ask that you consider upgrading to PRO and/or Enterprise Hub if possible
- private storage is paid above a significant free tier (1TB if you have a paid account, 100GB otherwise)
docs: https://huggingface.co/docs/hub/storage-limits
We optimize our infrastructure continuously to scale our storage for the coming years of growth in Machine learning, to the benefit of the community ๐ฅ
cc: @reach-vb @pierric @victor and the HF team
- 28 replies
reacted to
clem's
post with ๐ฅโค๏ธ
21 days ago
Post
4342
Hugging Face is becoming the best place to share the most viral AI apps with spaces.
Kolors Virtual Try-on just crossed 6,000,000 unique visitors & is now the #5 most popular space. Congrats to the Kwai Kolors team!
Kwai-Kolors/Kolors-Virtual-Try-On
Kolors Virtual Try-on just crossed 6,000,000 unique visitors & is now the #5 most popular space. Congrats to the Kwai Kolors team!
Kwai-Kolors/Kolors-Virtual-Try-On
- 2 replies
reacted to
merve's
post with ๐ฅ
21 days ago
Post
2853
Last week we were blessed with open-source models! A recap ๐
merve/nov-29-releases-674ccc255a57baf97b1e2d31
๐ผ๏ธ Multimodal
> At Hugging Face we released SmolVLM, a performant and efficient smol vision language model ๐
> Show Lab released ShowUI-2B: new vision-language-action model to build GUI/web automation agents ๐ค
> Rhymes AI has released the base model of Aria: Aria-Base-64K and Aria-Base-8K with their respective context length
> ViDoRe team released ColSmolVLM: A new ColPali-like retrieval model based on SmolVLM
> Dataset: Llava-CoT-o1-Instruct: new dataset labelled using Llava-CoT multimodal reasoning model๐
> Dataset: LLaVA-CoT-100k dataset used to train Llava-CoT released by creators of Llava-CoT ๐
๐ฌ LLMs
> Qwen team released QwQ-32B-Preview, state-of-the-art open-source reasoning model, broke the internet ๐ฅ
> AliBaba has released Marco-o1, a new open-source reasoning model ๐ฅ
> NVIDIA released Hymba 1.5B Base and Instruct, the new state-of-the-art SLMs with hybrid architecture (Mamba + transformer)
โฏ๏ธ Image/Video Generation
> Qwen2VL-Flux: new image generation model based on Qwen2VL image encoder, T5 and Flux for generation
> Lightricks released LTX-Video, a new DiT-based video generation model that can generate 24 FPS videos at 768x512 res โฏ๏ธ
> Dataset: Image Preferences is a new image generation preference dataset made with DIBT community effort of Argilla ๐ท๏ธ
Audio
> OuteAI released OuteTTS-0.2-500M new multilingual text-to-speech model based on Qwen-2.5-0.5B trained on 5B audio prompt tokens
merve/nov-29-releases-674ccc255a57baf97b1e2d31
๐ผ๏ธ Multimodal
> At Hugging Face we released SmolVLM, a performant and efficient smol vision language model ๐
> Show Lab released ShowUI-2B: new vision-language-action model to build GUI/web automation agents ๐ค
> Rhymes AI has released the base model of Aria: Aria-Base-64K and Aria-Base-8K with their respective context length
> ViDoRe team released ColSmolVLM: A new ColPali-like retrieval model based on SmolVLM
> Dataset: Llava-CoT-o1-Instruct: new dataset labelled using Llava-CoT multimodal reasoning model๐
> Dataset: LLaVA-CoT-100k dataset used to train Llava-CoT released by creators of Llava-CoT ๐
๐ฌ LLMs
> Qwen team released QwQ-32B-Preview, state-of-the-art open-source reasoning model, broke the internet ๐ฅ
> AliBaba has released Marco-o1, a new open-source reasoning model ๐ฅ
> NVIDIA released Hymba 1.5B Base and Instruct, the new state-of-the-art SLMs with hybrid architecture (Mamba + transformer)
โฏ๏ธ Image/Video Generation
> Qwen2VL-Flux: new image generation model based on Qwen2VL image encoder, T5 and Flux for generation
> Lightricks released LTX-Video, a new DiT-based video generation model that can generate 24 FPS videos at 768x512 res โฏ๏ธ
> Dataset: Image Preferences is a new image generation preference dataset made with DIBT community effort of Argilla ๐ท๏ธ
Audio
> OuteAI released OuteTTS-0.2-500M new multilingual text-to-speech model based on Qwen-2.5-0.5B trained on 5B audio prompt tokens
reacted to
julien-c's
post with ๐๐ฅ
22 days ago
Post
2163
wow ๐ฎ
INTELLECT-1 is the first collaboratively trained 10 billion parameter language model trained from scratch on 1 trillion tokens of English text and code.
PrimeIntellect/INTELLECT-1-Instruct
INTELLECT-1 is the first collaboratively trained 10 billion parameter language model trained from scratch on 1 trillion tokens of English text and code.
PrimeIntellect/INTELLECT-1-Instruct
reacted to
merve's
post with ๐ฅ
27 days ago
Post
3857
Small yet mighty! ๐ซ
We are releasing SmolVLM: a new 2B small vision language made for on-device use, fine-tunable on consumer GPU, immensely memory efficient ๐ค
We release three checkpoints under Apache 2.0: SmolVLM-Instruct, SmolVLM-Synthetic and SmolVLM-Base HuggingFaceTB/smolvlm-6740bd584b2dcbf51ecb1f39
Learn more from our blog here: huggingface.co/blog/smolvlm
This release comes with a demo, fine-tuning code, MLX integration and TRL integration for DPO ๐
Try the demo: HuggingFaceTB/SmolVLM
Fine-tuning Recipe: https://github.com/huggingface/smollm/blob/main/finetuning/Smol_VLM_FT.ipynb
Also TRL integration for DPO ๐
We are releasing SmolVLM: a new 2B small vision language made for on-device use, fine-tunable on consumer GPU, immensely memory efficient ๐ค
We release three checkpoints under Apache 2.0: SmolVLM-Instruct, SmolVLM-Synthetic and SmolVLM-Base HuggingFaceTB/smolvlm-6740bd584b2dcbf51ecb1f39
Learn more from our blog here: huggingface.co/blog/smolvlm
This release comes with a demo, fine-tuning code, MLX integration and TRL integration for DPO ๐
Try the demo: HuggingFaceTB/SmolVLM
Fine-tuning Recipe: https://github.com/huggingface/smollm/blob/main/finetuning/Smol_VLM_FT.ipynb
Also TRL integration for DPO ๐
reacted to
thomwolf's
post with ๐ฅ
28 days ago
Post
1634
Interesting long read from
@evanmiller-anthropic
on having a better founded statistical approach to Language Model Evaluations:
https://www.anthropic.com/research/statistical-approach-to-model-evals
Worth a read if you're into LLM evaluations!
Cc @clefourrier
https://www.anthropic.com/research/statistical-approach-to-model-evals
Worth a read if you're into LLM evaluations!
Cc @clefourrier
- 1 reply
reacted to
openfree's
post with ๐๐ฅ
28 days ago
Post
3135
๐ค HuggingFace Trending TOP 300 Board - Featuring AI Rating System
๐ Service Introduction
A comprehensive dashboard that provides at-a-glance access to the real-time TOP 300 trending Spaces, Models, and Datasets on HuggingFace.
Our specially developed AI rating system evaluates the practical value and growth potential of each item.
โญ Key Features
1. AI Rising Rate
Growth potential evaluation based on creation date and ranking
5-tier star rating system (โ โ โ โ โ )
Evaluation Criteria:
Recency: Higher relative weights for recently created items
Ranking Impact: Higher relative weights for top rankings
Comprehensive assessment using statistical/analytical models applied to AI
2. AI Popularity Score
Comprehensive evaluation combining objective popularity and Rising Rate
18-tier grading system from AAA+ to B-
Evaluation Elements:
Base Score: Benchmark based on likes, downloads, comments, etc.
Additional Score: Rising Rate applied as a weighted factor
Comprehensive assessment using statistical/analytical models applied to AI
3. Visualization Features
Real-time screenshot capture with caching
Intuitive card-based UI
Responsive grid layout
Pastel gradient design
๐ฏ Applications
AI/ML Project Trend Analysis
Early Discovery of Promising Models/Datasets
Community Activity Monitoring
Research/Development Direction Reference
๐ก Key Advantages
Real-time TOP 300 ranking
AI-based objective evaluation system
Fast loading with caching system
Intuitive and modern UI/UX
Integrated dashboard for 3 categories
๐ Update Cycle
Real-time data reflection
Manual refresh option
Minimized server load through screenshot caching
๐ Future Plans
Addition of detailed analysis report feature
Custom filtering options
Time-series trend analysis
Category-specific detailed statistics
๐ How to Access
openfree/trending-board
#HuggingFace #AI #MachineLearning #TrendingBoard #DataScience #
๐ Service Introduction
A comprehensive dashboard that provides at-a-glance access to the real-time TOP 300 trending Spaces, Models, and Datasets on HuggingFace.
Our specially developed AI rating system evaluates the practical value and growth potential of each item.
โญ Key Features
1. AI Rising Rate
Growth potential evaluation based on creation date and ranking
5-tier star rating system (โ โ โ โ โ )
Evaluation Criteria:
Recency: Higher relative weights for recently created items
Ranking Impact: Higher relative weights for top rankings
Comprehensive assessment using statistical/analytical models applied to AI
2. AI Popularity Score
Comprehensive evaluation combining objective popularity and Rising Rate
18-tier grading system from AAA+ to B-
Evaluation Elements:
Base Score: Benchmark based on likes, downloads, comments, etc.
Additional Score: Rising Rate applied as a weighted factor
Comprehensive assessment using statistical/analytical models applied to AI
3. Visualization Features
Real-time screenshot capture with caching
Intuitive card-based UI
Responsive grid layout
Pastel gradient design
๐ฏ Applications
AI/ML Project Trend Analysis
Early Discovery of Promising Models/Datasets
Community Activity Monitoring
Research/Development Direction Reference
๐ก Key Advantages
Real-time TOP 300 ranking
AI-based objective evaluation system
Fast loading with caching system
Intuitive and modern UI/UX
Integrated dashboard for 3 categories
๐ Update Cycle
Real-time data reflection
Manual refresh option
Minimized server load through screenshot caching
๐ Future Plans
Addition of detailed analysis report feature
Custom filtering options
Time-series trend analysis
Category-specific detailed statistics
๐ How to Access
openfree/trending-board
#HuggingFace #AI #MachineLearning #TrendingBoard #DataScience #
- 3 replies
posted
an
update
29 days ago
Post
1612
Making SmolLM2 reproducible: open-sourcing our training & evaluation toolkit ๐ ๏ธ https://github.com/huggingface/smollm/
- Pre-training code with nanotron
- Evaluation suite with lighteval
- Synthetic data generation using distilabel (powers our new SFT dataset HuggingFaceTB/smoltalk)
- Post-training scripts with TRL & the alignment handbook
- On-device tools with llama.cpp for summarization, rewriting & agents
Apache 2.0 licensed. V2 pre-training data mix coming soon!
Which other tools should we add next?
- Pre-training code with nanotron
- Evaluation suite with lighteval
- Synthetic data generation using distilabel (powers our new SFT dataset HuggingFaceTB/smoltalk)
- Post-training scripts with TRL & the alignment handbook
- On-device tools with llama.cpp for summarization, rewriting & agents
Apache 2.0 licensed. V2 pre-training data mix coming soon!
Which other tools should we add next?
reacted to
prithivMLmods's
post with ๐ฅ
30 days ago
Post
2900
Weekend Dribble ๐ฆ๐บ
Adapters for Product Ad Backdrops, Smooth Polaroids, Minimalist Sketch cards, Super Blends!!
๐คDemo on: prithivMLmods/FLUX-LoRA-DLC
Stranger Zones :
๐๐ผ{ Super Blend } : strangerzonehf/Flux-Super-Blend-LoRA
๐๐ผ{ Product Concept Ad } : prithivMLmods/Flux-Product-Ad-Backdrop
๐๐ผ{ Frosted Mock-ups } : prithivMLmods/Flux.1-Dev-Frosted-Container-LoRA
๐๐ผ{ Polaroid Plus } : prithivMLmods/Flux-Polaroid-Plus
๐๐ผ{Sketch Cards} : prithivMLmods/Flux.1-Dev-Sketch-Card-LoRA
๐Stranger Zone: https://huggingface.co/strangerzonehf
๐Flux LoRA Collections: prithivMLmods/flux-lora-collections-66dd5908be2206cfaa8519be
.
.
.
@prithivMLmods ๐ค
Adapters for Product Ad Backdrops, Smooth Polaroids, Minimalist Sketch cards, Super Blends!!
๐คDemo on: prithivMLmods/FLUX-LoRA-DLC
Stranger Zones :
๐๐ผ{ Super Blend } : strangerzonehf/Flux-Super-Blend-LoRA
๐๐ผ{ Product Concept Ad } : prithivMLmods/Flux-Product-Ad-Backdrop
๐๐ผ{ Frosted Mock-ups } : prithivMLmods/Flux.1-Dev-Frosted-Container-LoRA
๐๐ผ{ Polaroid Plus } : prithivMLmods/Flux-Polaroid-Plus
๐๐ผ{Sketch Cards} : prithivMLmods/Flux.1-Dev-Sketch-Card-LoRA
๐Stranger Zone: https://huggingface.co/strangerzonehf
๐Flux LoRA Collections: prithivMLmods/flux-lora-collections-66dd5908be2206cfaa8519be
.
.
.
@prithivMLmods ๐ค
reacted to
merve's
post with โค๏ธ๐
30 days ago
Post
3091
your hugging face profile now has your recent activities ๐ค
reacted to
merve's
post with ๐ฅ
about 1 month ago
Post
2572
What a week! A recap for everything you missed โ๏ธ
merve/nov-22-releases-673fbbcfc1c97c4f411def07
Multimodal โจ
> Mistral AI
released Pixtral 124B, a gigantic open vision language model
> Llava-CoT (formerly known as Llava-o1) was released, a multimodal reproduction of o1 model by PKU
> OpenGVLab released MMPR: a new multimodal reasoning dataset
> Jina has released Jina-CLIP-v2 0.98B multilingual multimodal embeddings
> Apple released new SotA vision encoders AIMv2
LLMs ๐ฆ
> AllenAI dropped a huge release of models, datasets and scripts for Tรผlu, a family of models based on Llama 3.1 aligned with SFT, DPO and a new technique they have developed called RLVR
> Jina has released embeddings-v3: new multilingual embeddings with longer context
> Hugging Face released SmolTalk: synthetic dataset used to align SmolLM2 using supervised fine-tuning
> Microsoft released orca-agentinstruct-1M-v1: a gigantic instruction dataset of 1M synthetic instruction pairs
Image Generation ๐ผ๏ธ
> Black Forest Labs released Flux 1. tools: four new models for different image modifications and two LoRAs to do image conditioning and better steer generations
Lastly Hugging Face released a new library Observers: a lightweight SDK for monitoring interactions with AI APIs and easily store and browse them ๐
$ pip install observers
merve/nov-22-releases-673fbbcfc1c97c4f411def07
Multimodal โจ
> Mistral AI
released Pixtral 124B, a gigantic open vision language model
> Llava-CoT (formerly known as Llava-o1) was released, a multimodal reproduction of o1 model by PKU
> OpenGVLab released MMPR: a new multimodal reasoning dataset
> Jina has released Jina-CLIP-v2 0.98B multilingual multimodal embeddings
> Apple released new SotA vision encoders AIMv2
LLMs ๐ฆ
> AllenAI dropped a huge release of models, datasets and scripts for Tรผlu, a family of models based on Llama 3.1 aligned with SFT, DPO and a new technique they have developed called RLVR
> Jina has released embeddings-v3: new multilingual embeddings with longer context
> Hugging Face released SmolTalk: synthetic dataset used to align SmolLM2 using supervised fine-tuning
> Microsoft released orca-agentinstruct-1M-v1: a gigantic instruction dataset of 1M synthetic instruction pairs
Image Generation ๐ผ๏ธ
> Black Forest Labs released Flux 1. tools: four new models for different image modifications and two LoRAs to do image conditioning and better steer generations
Lastly Hugging Face released a new library Observers: a lightweight SDK for monitoring interactions with AI APIs and easily store and browse them ๐
$ pip install observers
- 3 replies