Edit Models filters

Inference status

Misc

arxiv: 2309.00071

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

448

Full-text search

Active filters: 2309.00071

blockblockblock/Qwen2-72B-Instruct-bpw5.5-exl2

Text Generation • Updated Jun 12, 2024 • 18 • 1

blockblockblock/Qwen2-72B-Instruct-bpw6-exl2

Text Generation • Updated Jun 12, 2024 • 19

erickbp/Qwen2-72B-Instruct-AWQ-GEMM

Text Generation • Updated Jun 14, 2024 • 20

RichardErkhov/Qwen_-_Qwen2-7B-Instruct-gguf

Updated Jun 14, 2024 • 9

RichardErkhov/Qwen_-_Qwen2-72B-Instruct-gguf

Updated Jun 16, 2024 • 41

pankajmathur/orca_mini_v7_7b

Text Generation • Updated 15 days ago • 32 • 2

qwp4w3hyb/Qwen2-72B-Instruct-iMat-GGUF

Text Generation • Updated Jun 27, 2024 • 175

pankajmathur/orca_mini_v7_72b

Text Generation • Updated 15 days ago • 2.56k • 11

nhyha/SFT-7b-lamb-unsloth-merged-16bit

Text Generation • Updated Jul 10, 2024 • 15

RESMPDEV/Qwen2-Wukong-5B-Instruct-Sliced

Text Generation • Updated Jul 6, 2024 • 23 • 1

pankajmathur/orca_mini_v7_7b-AWQ

Text Generation • Updated 15 days ago • 23 • 1

XelotX/Qwen2-72B-Instruct-XelotX-Original

Text Generation • Updated Jul 12, 2024 • 21

XelotX/Qwen2-72B-Instruct-XelotX-iQuants-BF16

Text Generation • Updated Jul 12, 2024 • 20

billatsectorflow/Qwen2-72B-Instruct-GPTQ-Int4-128K

Text Generation • Updated Sep 25, 2024 • 20

emplitude/rubywork

Text Generation • Updated Jul 17, 2024 • 19

bigstorm/Qwen2-72B-Instruct-7.0bpw-8hb-exl2

Text Generation • Updated Jul 18, 2024 • 24

bigstorm/Qwen2-72B-Instruct-8.0bpw-8hb-exl2

Text Generation • Updated Jul 18, 2024 • 22

RichardErkhov/RESMPDEV_-_Qwen2-Wukong-5B-Instruct-Sliced-gguf

Updated Jul 22, 2024 • 11

pashaprokaz/Qwen2-7B-Instruct

Text Generation • Updated Jul 24, 2024 • 11

pashaprokaz/Qwen2-72B-Instruct

Text Generation • Updated Jul 24, 2024 • 7

RichardErkhov/MaziyarPanahi_-_Yarn-Mistral-7b-64k-Mistral-7B-Instruct-v0.1-gguf

Updated Jul 25, 2024 • 6

SharryOG/llama3-8b-1048k

Text Generation • Updated Jul 29, 2024 • 7

GPT4All-Community/Qwen2-7B-Instruct-GGUF

Text Generation • Updated Aug 20, 2024 • 542

psyche/Qwen2-72B-Instruct-GPTQ-Int4

Text Generation • Updated Aug 22, 2024 • 11

Enfint/Qwen2-72B-Instruct-GPTQ-Int4

Text Generation • Updated Sep 5, 2024 • 4

TitanML/Qwen2-7B-Instruct

Text Generation • Updated Sep 11, 2024 • 8

TitanML/Qwen2-7B-Instruct-AWQ

Text Generation • Updated Sep 11, 2024 • 6 • 1

Qwen/Qwen2.5-32B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 9, 2024 • 5.11k • 8

CalamitousFelicitousness/Qwen2.5-7B-Instruct-fp8-dynamic

Text Generation • Updated Sep 18, 2024 • 310

CalamitousFelicitousness/Qwen2.5-14B-Instruct-fp8-dynamic

Text Generation • Updated Sep 18, 2024 • 317 • 1