Smol Quantized - a BjornMelin Collection

BjornMelin 's Collections

Legendary VL Models

Google

Llama

Qwen

LLMs

Smol Quantized

updated Jan 20

My favorite quantized models under 10B parameters.

bartowski/SmallThinker-3B-Preview-GGUF

Text Generation • Updated Dec 30, 2024 • 2.76k • 27
bartowski/Qwen2.5-Coder-7B-Instruct-GGUF

Text Generation • Updated Sep 19, 2024 • 7.41k • 28
bartowski/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Oct 8, 2024 • 91.9k • 115
bartowski/gemma-2-2b-it-GGUF

Text Generation • Updated Aug 5, 2024 • 138k • 53
bartowski/gemma-2-9b-it-GGUF

Text Generation • Updated Jul 15, 2024 • 38.9k • 207
MaziyarPanahi/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 25, 2024 • 1.28M • 11
MaziyarPanahi/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Jul 23, 2024 • 2.18M • 17
bartowski/Qwen2.5-7B-Instruct-GGUF

Text Generation • Updated Sep 19, 2024 • 21.8k • 29
bartowski/Llama-3.2-3B-Instruct-uncensored-GGUF

Text Generation • Updated Oct 26, 2024 • 37.2k • 56
bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF

Text Generation • Updated 2 days ago • 223k • 81
bartowski/DeepSeek-R1-Distill-Llama-8B-GGUF

Text Generation • Updated Jan 22 • 94.9k • 42
bartowski/DeepSeek-R1-Distill-Qwen-14B-GGUF

Text Generation • Updated Jan 22 • 1.43M • 171