4bit Instruct Models - a unsloth Collection

unsloth 's Collections

Unsloth 4-bit Dynamic Quants

DeepSeek R1 (All Versions)

Deepseek V3 (All Versions)

Phi-4 (All Versions)

Mistral-Small-24B-2501 (All Versions)

Llama 3.3 (All Versions)

Qwen2.5-VL (All Versions)

Qwen QVQ + QwQ Collection

Vision/multimodal Models

Llama 3.2 Vision

Llama 3.1 Collection

Load 4bit models 4x faster

4bit Instruct Models

4bit Instruct Models

updated 18 days ago

unsloth/Llama-3.2-3B-Instruct-bnb-4bit

Text Generation • Updated about 1 month ago • 119k • 17
unsloth/Llama-3.2-1B-Instruct-bnb-4bit

Text Generation • Updated about 1 month ago • 52.9k • 14
unsloth/Llama-3.2-11B-Vision-Instruct-bnb-4bit

Image-Text-to-Text • Updated Dec 10, 2024 • 13.3k • 72
unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit

Text Generation • Updated 7 days ago • 767k • 56
unsloth/llama-3-8b-Instruct-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 51.8k • 131
unsloth/Meta-Llama-3.1-70B-Instruct-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 8.34k • 29
unsloth/Phi-3-mini-4k-instruct-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 35.6k • 29
unsloth/Mistral-Nemo-Instruct-2407-bnb-4bit

Text Generation • Updated 21 days ago • 18.8k • 27
unsloth/gemma-2-9b-it-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 38.3k • 23
unsloth/mistral-7b-instruct-v0.2-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 14.3k • 32
unsloth/mistral-7b-instruct-v0.3-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 157k • 21
unsloth/llama-3-70b-Instruct-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 2.79k • 42
unsloth/Phi-3-medium-4k-instruct-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 3.26k • 5
unsloth/gemma-7b-it-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 8.68k • 14
unsloth/gemma-2b-it-bnb-4bit

Text Classification • Updated Sep 3, 2024 • 1.57k • 20
unsloth/Hermes-3-Llama-3.1-8B-bnb-4bit

Text Generation • Updated Sep 4, 2024 • 3.61k • 5
unsloth/Hermes-3-Llama-3.1-70B-bnb-4bit

Text Generation • Updated Sep 4, 2024 • 13 • 1
unsloth/Llama-3.1-Storm-8B-bnb-4bit

Text Generation • Updated Sep 4, 2024 • 1.71k • 6