Edit Models filters

Inference status

Misc

arxiv: 2309.00071

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

449

Full-text search

Active filters: 2309.00071

LoneStriker/Qwen2.5-14B-Instruct-8.0bpw-h8-exl2

Text Generation • Updated Sep 19 • 11 • 1

LoneStriker/Qwen2.5-32B-Instruct-3.0bpw-h6-exl2

Text Generation • Updated Sep 19 • 7

LoneStriker/Qwen2.5-32B-Instruct-4.0bpw-h6-exl2

Text Generation • Updated Sep 19 • 447

LoneStriker/Qwen2.5-32B-Instruct-4.65bpw-h6-exl2

Text Generation • Updated Sep 19 • 15

LoneStriker/Qwen2.5-32B-Instruct-5.0bpw-h6-exl2

Text Generation • Updated Sep 19 • 26

LoneStriker/Qwen2.5-32B-Instruct-6.0bpw-h6-exl2

Text Generation • Updated Sep 19 • 21 • 1

LoneStriker/Qwen2.5-32B-Instruct-8.0bpw-h8-exl2

Text Generation • Updated Sep 19 • 20 • 1

Zoyd/Qwen_Qwen2.5-14B-Instruct-2_2bpw_exl2

Text Generation • Updated Sep 19 • 12

Zoyd/Qwen_Qwen2.5-14B-Instruct-3_5bpw_exl2

Text Generation • Updated Sep 19 • 10

Zoyd/Qwen_Qwen2.5-14B-Instruct-4_0bpw_exl2

Text Generation • Updated Sep 19 • 11

Zoyd/Qwen_Qwen2.5-14B-Instruct-3_75bpw_exl2

Text Generation • Updated Sep 19 • 6

CISCai/Qwen2.5-Coder-7B-Instruct-SOTA-GGUF

Text Generation • Updated Sep 19 • 97

Zoyd/Qwen_Qwen2.5-14B-Instruct-4_25bpw_exl2

Text Generation • Updated Sep 19 • 10

Zoyd/Qwen_Qwen2.5-14B-Instruct-5_0bpw_exl2

Text Generation • Updated Sep 19 • 15

Zoyd/Qwen_Qwen2.5-14B-Instruct-6_0bpw_exl2

Text Generation • Updated Sep 19 • 4

Zoyd/Qwen_Qwen2.5-14B-Instruct-6_5bpw_exl2

Text Generation • Updated Sep 19 • 10

Zoyd/Qwen_Qwen2.5-14B-Instruct-8_0bpw_exl2

Text Generation • Updated Sep 19 • 20

QuantFactory/Qwen2.5-14B-Instruct-GGUF

Text Generation • Updated Sep 19 • 211 • 2

LoneStriker/Qwen2.5-72B-Instruct-2.4bpw-h6-exl2

Text Generation • Updated Sep 19 • 12

LoneStriker/Qwen2.5-72B-Instruct-3.5bpw-h6-exl2

Text Generation • Updated Sep 19 • 16

LoneStriker/Qwen2.5-72B-Instruct-4.0bpw-h6-exl2

Text Generation • Updated Sep 19 • 15

LoneStriker/Qwen2.5-72B-Instruct-6.0bpw-h6-exl2

Text Generation • Updated Sep 19 • 23 • 3

LoneStriker/Qwen2.5-72B-Instruct-2.25bpw-h6-exl2

Text Generation • Updated Sep 19 • 18 • 1

ThomasBaruzier/Qwen2.5-7B-Instruct-GGUF

Text Generation • Updated Sep 19 • 302

ThomasBaruzier/Qwen2.5-14B-Instruct-GGUF

Text Generation • Updated Sep 20 • 1.41k

ThomasBaruzier/Qwen2.5-72B-Instruct-GGUF

Text Generation • Updated Sep 26 • 509

RichardErkhov/Qwen_-_Qwen2.5-7B-Instruct-gguf

Updated Sep 19 • 123

RichardErkhov/Qwen_-_Qwen2.5-Coder-7B-gguf

Updated Sep 20 • 301

Qwen/Qwen2.5-Coder-7B-Instruct-GPTQ-Int8

Text Generation • Updated Nov 18 • 824 • 2

Orion-zhen/Qwen2.5-Coder-7B-Instruct-AWQ

Text Generation • Updated Oct 9 • 91 • 1