Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Carbon Emissions

Mixture of Experts

Misc with no match

text-embeddings-inference

Models

2,525

Full-text search

Active filters: chat

Qwen/Qwen2.5-0.5B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 9 • 1.56k • 5

Qwen/Qwen2.5-7B-Instruct-GPTQ-Int4

Text Generation • Updated Oct 18 • 41.3k • 9

Qwen/Qwen2.5-14B-Instruct-GPTQ-Int4

Text Generation • Updated Oct 9 • 5.34k • 9

Qwen/Qwen2.5-14B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 9 • 4.33k • 11

Qwen/Qwen2.5-32B-Instruct-GPTQ-Int4

Text Generation • Updated Oct 9 • 9.67k • 19

Qwen/Qwen2.5-32B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 9 • 15.3k • 8

Qwen/Qwen2.5-72B-Instruct-GPTQ-Int4

Text Generation • Updated Oct 9 • 20.1k • 23

Qwen/Qwen2.5-72B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 9 • 6.75k • 7

Qwen/Qwen2.5-0.5B-Instruct-AWQ

Text Generation • Updated Oct 9 • 3k • 4

Qwen/Qwen2.5-1.5B-Instruct-AWQ

Text Generation • Updated Oct 9 • 1.91k • 3

Qwen/Qwen2.5-3B-Instruct-AWQ

Text Generation • Updated Oct 9 • 3.56k • 5

Qwen/Qwen2.5-14B-Instruct-AWQ

Text Generation • Updated Oct 9 • 41.9k • 9

Qwen/Qwen2.5-72B-Instruct-AWQ

Text Generation • Updated Oct 9 • 29.6k • 40

Qwen/Qwen2.5-7B-Instruct-GGUF

Text Generation • Updated Sep 20 • 20.4k • 36

Qwen/Qwen2.5-14B-Instruct-GGUF

Text Generation • Updated Sep 20 • 8.21k • 19

Qwen/Qwen2.5-32B-Instruct-GGUF

Text Generation • Updated Sep 20 • 7.3k • 21

Qwen/Qwen2.5-72B-Instruct-GGUF

Text Generation • Updated Sep 20 • 14.9k • 29

bartowski/Qwen2.5-32B-Instruct-GGUF

Text Generation • Updated Sep 19 • 29.9k • 45

lmstudio-community/Qwen2.5-32B-Instruct-GGUF

Text Generation • Updated Sep 19 • 1.56k • 3

bartowski/Qwen2.5-72B-Instruct-exl2

Text Generation • Updated Sep 17 • 196 • 10

bartowski/Qwen2.5-14B-Instruct-GGUF

Text Generation • Updated 17 days ago • 16k • 23

lmstudio-community/Qwen2.5-14B-Instruct-GGUF

Text Generation • Updated Sep 19 • 15.2k • 4

bartowski/Qwen2.5-0.5B-Instruct-GGUF

Text Generation • Updated Sep 19 • 3.99k • 4

lmstudio-community/Qwen2.5-Coder-7B-Instruct-GGUF

Text Generation • Updated Sep 19 • 16.6k • 5

bartowski/Qwen2.5-Coder-7B-Instruct-GGUF

Text Generation • Updated Sep 19 • 18.3k • 21

bartowski/Qwen2.5-Math-7B-Instruct-GGUF

Text Generation • Updated Sep 19 • 9.25k • 5

lmstudio-community/Qwen2.5-Math-7B-Instruct-GGUF

Text Generation • Updated Sep 19 • 735 • 2

bartowski/Qwen2.5-Math-72B-Instruct-GGUF

Text Generation • Updated Sep 19 • 3.47k • 2

lmstudio-community/Qwen2.5-Math-72B-Instruct-GGUF

Text Generation • Updated Sep 19 • 348 • 2

mlx-community/Qwen2.5-0.5B-Instruct-4bit

Text Generation • Updated Sep 18 • 416 • 2