Edit Models filters

Model Tree

Qwen/Qwen2.5-72B-Instruct

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

52

Full-text search

Active filters: Qwen/Qwen2.5-72B-Instruct

VPTQ-community/Qwen2.5-72B-Instruct-v8-k65536-256-woft

Updated 7 days ago • 20 • 4

VPTQ-community/Qwen2.5-72B-Instruct-v8-k65536-65536-woft

Updated 7 days ago • 21 • 1

gghfez/Magnum-v1-72b-Qwen2.5-exl2-4.5bpw

Updated Oct 2 • 5

gghfez/Magnum-v1-72b-Qwen2.5-exl2-8.0bpw

Updated Oct 2 • 7

mlc-ai/Qwen2.5-72B-Instruct-q4f32_1-MLC

Updated Oct 3 • 3

Kotokin/Magnum-v1-72b-Qwen2.5-5bpw

Updated Oct 4 • 7

mav23/Rombos-LLM-V2.5-Qwen-72b-GGUF

Updated Oct 14 • 32

GGorman/Qwen2.5-72B-Instruct-Q8-mlx

Text Generation • Updated Oct 19 • 11

CED6688/magnum-v4-72b-AWQ

Text Generation • Updated about 1 month ago • 70

async0x42/Rombos-LLM-V2.5-Qwen-72b-exl2_3.5bpw

Text Generation • Updated 23 days ago • 5

async0x42/Rombos-LLM-V2.5-Qwen-72b-exl2_3.25bpw

Text Generation • Updated 23 days ago • 8

async0x42/Magnum-v1-72b-Qwen2.5-exl2_3.50bpw

Updated 22 days ago • 11

async0x42/Magnum-v1-72b-Qwen2.5-exl2_3.25bpw

Updated 22 days ago • 7

tclf90/qwen2.5-72b-instruct-gptq-int4

Text Generation • Updated 21 days ago • 85

tclf90/qwen2.5-72b-instruct-gptq-int3

Text Generation • Updated 21 days ago • 155

XelotX/Qwen2.5-72B-Instruct-GGUF

Text Generation • Updated 19 days ago • 70

LatentWanderer/Rombos-LLM-V2.5-Qwen-72b-6.5bpw-h8-exl2

Text Generation • Updated 13 days ago • 6

bullerwins/Athene-V2-Chat-exl2_4.0bpw

Text Generation • Updated 9 days ago • 26

bullerwins/Athene-V2-Chat-exl2_5.0bpw

Text Generation • Updated 9 days ago • 20

bullerwins/Athene-V2-Chat-exl2_6.0bpw

Text Generation • Updated 8 days ago • 23

mlx-community/Qwen2.5-72B-Instruct-3bit

Text Generation • Updated 1 day ago • 15

mlx-community/Qwen2.5-72B-Instruct-6bit

Text Generation • Updated 1 day ago • 48