Edit Models filters

Inference status

Misc

arxiv: 2309.00071

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

448

Full-text search

Active filters: 2309.00071

unsloth/Qwen2.5-Coder-1.5B-Instruct-bnb-4bit

Text Generation • Updated Nov 12, 2024 • 2.3k

unsloth/Qwen2.5-Coder-1.5B-Instruct

Text Generation • Updated Nov 12, 2024 • 4.22k • 2

unsloth/Qwen2.5-Coder-7B-Instruct-bnb-4bit

Text Generation • Updated Nov 12, 2024 • 3.78k • 4

unsloth/Qwen2.5-Coder-7B-Instruct

Text Generation • Updated Nov 12, 2024 • 5.12k • 4

pL-Community/Qwen2.5-Coder-7B-Instruct-FP8-Dynamic

Text Generation • Updated Sep 23, 2024 • 12

duyntnet/Qwen2.5-14B-Instruct-imatrix-GGUF

Text Generation • Updated Sep 23, 2024 • 33 • 1

pL-Community/Qwen2.5-72B-Instruct-FP8-Dynamic

Text Generation • Updated Sep 23, 2024 • 745

unsloth/Qwen2.5-72B-Instruct

Text Generation • Updated Sep 23, 2024 • 335

QuantFactory/Josiefied-Qwen2.5-7B-Instruct-abliterated-GGUF

Text Generation • Updated Sep 24, 2024 • 157 • 2

duyntnet/Qwen2.5-32B-Instruct-imatrix-GGUF

Text Generation • Updated Sep 24, 2024 • 44

RichardErkhov/Goekdeniz-Guelmez_-_Josiefied-Qwen2.5-7B-Instruct-abliterated-gguf

Updated Sep 24, 2024 • 17

RichardErkhov/Goekdeniz-Guelmez_-_Josiefied-Qwen2.5-7B-Instruct-abliterated-v2-gguf

Updated Sep 26, 2024 • 16

llmcompressor-quants/Qwen2.5-7B-Instruct-fp8-dynamic

Text Generation • Updated Sep 25, 2024 • 47

billatsectorflow/Qwen2.5-72B-Instruct-GPTQ-Int4-64K

Text Generation • Updated Sep 25, 2024 • 17

Alignment-Lab-AI/Qwen2.5-72b-instruct-128k

Text Generation • Updated Sep 26, 2024 • 18

RichardErkhov/Qwen_-_Qwen2.5-Coder-1.5B-Instruct-gguf

Updated Sep 27, 2024 • 91

RichardErkhov/Qwen_-_Qwen2.5-Coder-1.5B-gguf

Updated Sep 27, 2024 • 56

duyntnet/Qwen2.5-Coder-7B-Instruct-imatrix-GGUF

Text Generation • Updated Sep 27, 2024 • 355

RichardErkhov/Qwen_-_Qwen2.5-32B-Instruct-gguf

Updated Sep 28, 2024 • 151

RichardErkhov/Qwen_-_Qwen2.5-14B-Instruct-gguf

Updated Sep 29, 2024 • 171

RichardErkhov/Qwen_-_Qwen2.5-72B-Instruct-gguf

Updated Sep 29, 2024 • 232

Alignment-Lab-AI/Qwen2.5-Coder-7B-Instruct-132k

Text Generation • Updated Oct 2, 2024 • 12

QuantFactory/Josiefied-Qwen2.5-7B-Instruct-abliterated-v2-GGUF

Text Generation • Updated Oct 3, 2024 • 61 • 1

mav23/Qwen2.5-72B-Instruct-GGUF

Text Generation • Updated Oct 3, 2024 • 27

mav23/Qwen2.5-Coder-7B-Instruct-GGUF

Text Generation • Updated Oct 3, 2024 • 102

RichardErkhov/unsloth_-_Qwen2.5-Coder-1.5B-Instruct-gguf

Updated Oct 3, 2024 • 36

RichardErkhov/unsloth_-_Qwen2.5-Coder-1.5B-gguf

Updated Oct 3, 2024 • 19

mav23/Qwen2.5-7B-Instruct-GGUF

Text Generation • Updated Oct 3, 2024 • 55

Handgun1773/Qwen2.5-Coder-1.5B-BASE-8.0bpw-exl2

Text Generation • Updated Oct 4, 2024 • 5

Handgun1773/Qwen2.5-Coder-7B-BASE-8.0bpw-exl2

Text Generation • Updated Oct 4, 2024 • 8