Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

17,439

Full-text search

Active filters: 4-bit

Qwen/Qwen2-VL-7B-Instruct-AWQ

Image-Text-to-Text • Updated Sep 25 • 291k • 39

Qwen/Qwen2-VL-7B-Instruct-GPTQ-Int4

Image-Text-to-Text • Updated Sep 21 • 132k • 25

Qwen/Qwen2-VL-2B-Instruct-AWQ

Image-Text-to-Text • Updated Sep 21 • 9.72k • 15

alexwww94/glm-4v-9b-gptq-4bit

Updated Sep 9 • 281 • 6

thesven/Phi-3.5-mini-instruct-awq

Updated Aug 29 • 682 • 1

sayakpaul/flux.1-dev-nf4-with-bnb-integration

Updated Sep 1 • 160 • 12

aixsatoshi/c4ai-command-r-plus-08-2024-awq

Updated Sep 2 • 100 • 3

madroid/flux.1-dev-mflux-4bit

Text-to-Image • Updated Sep 2 • 61 • 6

MaziyarPanahi/Yi-Coder-9B-Chat-GGUF

Text Generation • Updated Sep 4 • 1.84M • 2

unsloth/Reflection-Llama-3.1-70B-bnb-4bit

Text Generation • Updated Sep 8 • 52 • 15

bagwai/fine-tuned-gemma-7b-Hausa

Text Classification • Updated Sep 8 • 2

axolotl-quants/DeepSeek-V2.5-bnb-nf4-bf16

Updated Sep 12 • 58 • 1

MaziyarPanahi/solar-pro-preview-instruct-GGUF

Text Generation • Updated Sep 13 • 1.87M • 18

nicoboss/Meta-Llama-3.1-405B-Instruct-Uncensored-Lora

Updated Sep 14 • 9 • 6

flowaicom/Flow-Judge-v0.1-AWQ

Text Generation • Updated Oct 9 • 1.96k • 6

Qwen/Qwen2-VL-72B-Instruct-GPTQ-Int4

Image-Text-to-Text • Updated Sep 24 • 57k • 12

Qwen/Qwen2.5-0.5B-Instruct-GPTQ-Int4

Text Generation • Updated Sep 19 • 3.32k • 2

Qwen/Qwen2.5-7B-Instruct-GPTQ-Int4

Text Generation • Updated Oct 18 • 51.1k • 9

Qwen/Qwen2.5-14B-Instruct-GPTQ-Int4

Text Generation • Updated Oct 9 • 5.4k • 9

Qwen/Qwen2.5-32B-Instruct-GPTQ-Int4

Text Generation • Updated Oct 9 • 10.1k • 19

Qwen/Qwen2.5-72B-Instruct-GPTQ-Int4

Text Generation • Updated Oct 9 • 21.6k • 23

Qwen/Qwen2.5-0.5B-Instruct-AWQ

Text Generation • Updated Oct 9 • 2.75k • 4

Qwen/Qwen2.5-1.5B-Instruct-AWQ

Text Generation • Updated Oct 9 • 1.69k • 3

Qwen/Qwen2.5-3B-Instruct-AWQ

Text Generation • Updated Oct 9 • 3.36k • 4

Qwen/Qwen2.5-7B-Instruct-AWQ

Text Generation • Updated Oct 9 • 18.1k • 8

Qwen/Qwen2.5-14B-Instruct-AWQ

Text Generation • Updated Oct 9 • 41.8k • 9

unsloth/Mistral-Small-Instruct-2409-bnb-4bit

Updated 9 days ago • 13.2k • 2

MaziyarPanahi/Qwen2.5-7B-Instruct-GGUF

Text Generation • Updated Sep 18 • 1.56M • 8

unsloth/Qwen2.5-7B-Instruct-bnb-4bit

Text Generation • Updated 10 days ago • 63.2k • 6

unsloth/Qwen2.5-3B-Instruct-bnb-4bit

Text Generation • Updated 10 days ago • 5.38k • 3