Edit Models filters

Inference status

Misc

arxiv: 2309.00071

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

449

Full-text search

Active filters: 2309.00071

billatsectorflow/Qwen2-72B-Instruct-GPTQ-Int4-128K

Text Generation • Updated Sep 25 • 20

emplitude/rubywork

Text Generation • Updated Jul 17 • 11

bigstorm/Qwen2-72B-Instruct-7.0bpw-8hb-exl2

Text Generation • Updated Jul 18 • 15

bigstorm/Qwen2-72B-Instruct-8.0bpw-8hb-exl2

Text Generation • Updated Jul 18 • 14

RichardErkhov/RESMPDEV_-_Qwen2-Wukong-5B-Instruct-Sliced-gguf

Updated Jul 22 • 9

pashaprokaz/Qwen2-7B-Instruct

Text Generation • Updated Jul 24 • 17

pashaprokaz/Qwen2-72B-Instruct

Text Generation • Updated Jul 24 • 11

RichardErkhov/MaziyarPanahi_-_Yarn-Mistral-7b-64k-Mistral-7B-Instruct-v0.1-gguf

Updated Jul 25 • 12

SharryOG/llama3-8b-1048k

Text Generation • Updated Jul 29 • 7

GPT4All-Community/Qwen2-7B-Instruct-GGUF

Text Generation • Updated Aug 20 • 1.05k

psyche/Qwen2-72B-Instruct-GPTQ-Int4

Text Generation • Updated Aug 22 • 20

Enfint/Qwen2-72B-Instruct-GPTQ-Int4

Text Generation • Updated Sep 5 • 3

TitanML/Qwen2-7B-Instruct

Text Generation • Updated Sep 11 • 16

TitanML/Qwen2-7B-Instruct-AWQ

Text Generation • Updated Sep 11 • 16 • 1

CalamitousFelicitousness/Qwen2.5-7B-Instruct-fp8-dynamic

Text Generation • Updated Sep 18 • 16

CalamitousFelicitousness/Qwen2.5-14B-Instruct-fp8-dynamic

Text Generation • Updated Sep 18 • 322 • 1

CalamitousFelicitousness/Qwen2.5-32B-Instruct-fp8-dynamic

Text Generation • Updated Sep 18 • 437 • 1

CalamitousFelicitousness/Qwen2.5-72B-Instruct-fp8-dynamic

Text Generation • Updated Sep 18 • 409 • 1

Orion-zhen/Qwen2.5-32B-Instruct-6.5bpw-exl2

Text Generation • Updated Sep 19 • 12

QuantFactory/Qwen2.5-7B-Instruct-GGUF

Text Generation • Updated Sep 19 • 265 • 3

LoneStriker/Qwen2.5-7B-Instruct-3.0bpw-h6-exl2

Text Generation • Updated Sep 19 • 13

LoneStriker/Qwen2.5-7B-Instruct-4.0bpw-h6-exl2

Text Generation • Updated Sep 19 • 24

LoneStriker/Qwen2.5-7B-Instruct-5.0bpw-h6-exl2

Text Generation • Updated Sep 19 • 8

LoneStriker/Qwen2.5-7B-Instruct-6.0bpw-h6-exl2

Text Generation • Updated Sep 19 • 14

LoneStriker/Qwen2.5-7B-Instruct-8.0bpw-h8-exl2

Text Generation • Updated Sep 19 • 11

QuantFactory/Qwen2.5-Coder-1.5B-GGUF

Text Generation • Updated Sep 19 • 348 • 2

LoneStriker/Qwen2.5-14B-Instruct-3.0bpw-h6-exl2

Text Generation • Updated Sep 19 • 16

LoneStriker/Qwen2.5-14B-Instruct-4.0bpw-h6-exl2

Text Generation • Updated Sep 19 • 16

LoneStriker/Qwen2.5-14B-Instruct-5.0bpw-h6-exl2

Text Generation • Updated Sep 19 • 11

LoneStriker/Qwen2.5-14B-Instruct-6.0bpw-h6-exl2

Text Generation • Updated Sep 19 • 16