Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

Inference Endpoints

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

1,488

Full-text search

Active filters: 6-bit

MaziyarPanahi/calme-3.3-llamaloi-3b-GGUF

Text Generation • Updated 10 days ago • 15k

MarsupialAI/Stellar-Odyssey-12b-adventure-v0.0_EXL2_6bpw_H8

Text Generation • Updated 14 days ago • 15

DrNicefellow/Qwen2.5-Coder-32B-Instruct-6.0bpw-exl2

Updated 13 days ago • 16

bullerwins/Qwen2.5-Coder-32B-exl2_6.0bpw

Text Generation • Updated 13 days ago • 12

Jellon/MSM-MS-Cydrion-22B-exl2-6bpw

Text Generation • Updated 13 days ago • 8

DrNicefellow/Qwen2.5-Coder-14B-Instruct-6.0bpw-exl2

Updated 13 days ago • 13

DrNicefellow/Qwen2.5-7B-O1-Journey-1-6.0bpw-exl2

Updated 8 days ago • 6

bullerwins/Athene-V2-Chat-exl2_6.0bpw

Text Generation • Updated 8 days ago • 23

schnapper79/mistralai_large_instruct_2411-exl2-6.0bpw

Text Generation • Updated 5 days ago • 13

Jellon/MS-Meadowlark-22B-exl2-h8-6bpw

Text Generation • Updated 6 days ago • 7

MikeRoz/mistralai_Mistral-Large-Instruct-2411-6.0bpw-h6-exl2

Updated 5 days ago • 6

BigHuggyD/Mistral-Large-Instruct-2411_exl2_6.0bpw_h6

Updated 5 days ago • 8

bullerwins/Mistral-Large-Instruct-2411-exl2_6.0bpw

Updated 5 days ago • 9

Statuo/MS-Cydonia-v1.3-EXL2-6bpw

Updated 3 days ago • 16

MikeRoz/ArliAI_Llama-3.1-70B-ArliAI-RPMax-v1.3-6.0bpw-h6-exl2

Updated 2 days ago • 5

BigHuggyD/MarsupialAI_Monstral-123B_exl2_6.0bpw_h6

Text Generation • Updated 2 days ago • 27

mlx-community/Qwen2.5-72B-Instruct-6bit

Text Generation • Updated 1 day ago • 48

BigHuggyD/TheDrummer_Behemoth-123B-v2.2_exl2_6.0bpw_h6

Updated 30 minutes ago