Edit Models filters

Inference Providers

HF Inference API

Misc

Inference Endpoints

4-bit precision

8-bit precision

AutoTrain Compatible

text-generation-inference

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

1,830

Full-text search

Active filters: 2-bit

async0x42/Qwen2.5-Coder-0.5B-Instruct-exl2_2.0bpw

Text Generation • Updated Nov 14, 2024 • 9

DrNicefellow/Qwen2.5-7B-O1-Journey-1-2.0bpw-exl2

Updated Nov 17, 2024 • 8

MaziyarPanahi/NuExtract-1.5-smol-GGUF

Text Generation • Updated Nov 15, 2024 • 162 • 7

async0x42/Qwen2.5-0.5B-Instruct-exl2_2.0bpw

Text Generation • Updated Nov 16, 2024 • 4

Xu-Ouyang/FloatLM_99M-int2-GPTQ-wikitext2

Text Generation • Updated Nov 16, 2024 • 81

Xu-Ouyang/FloatLM_190M-int2-GPTQ-wikitext2

Text Generation • Updated Nov 16, 2024 • 80

Xu-Ouyang/FloatLM_390M-int2-GPTQ-wikitext2

Text Generation • Updated Nov 16, 2024 • 78

Xu-Ouyang/FloatLM_560M-int2-GPTQ-wikitext2

Text Generation • Updated Nov 16, 2024 • 78

Xu-Ouyang/FloatLM_830M-int2-GPTQ-wikitext2

Text Generation • Updated Nov 16, 2024 • 80

Xu-Ouyang/FloatLM_1.1B-int2-GPTQ-wikitext2

Text Generation • Updated Nov 16, 2024 • 84

Xu-Ouyang/FloatLM_1.5B-int2-GPTQ-wikitext2

Text Generation • Updated Nov 16, 2024 • 78

Xu-Ouyang/FloatLM_3.9B-int2-GPTQ-wikitext2

Text Generation • Updated Nov 16, 2024 • 102

MaziyarPanahi/Mistral-Large-Instruct-2411-GGUF

Text Generation • Updated Nov 20, 2024 • 859k • 1

zachlandes/Mistral-Large-Instruct-2411-Q2-MLX

Updated Nov 21, 2024 • 17 • 1

HawkonLi/Hunyuan-A52B-Instruct-2bit

Text Generation • Updated Nov 26, 2024 • 9 • 1

DrNicefellow/Qwen-QwQ-32B-Preview-2.0bpw-exl2

Updated Nov 28, 2024 • 6

MaziyarPanahi/Sailor2-1B-Chat-GGUF

Text Generation • Updated Dec 3, 2024 • 506 • 4

MaziyarPanahi/Sailor2-8B-Chat-GGUF

Text Generation • Updated Dec 4, 2024 • 84 • 3

MaziyarPanahi/Sailor2-20B-Chat-GGUF

Text Generation • Updated Dec 4, 2024 • 175 • 2

MaziyarPanahi/magnum-twilight-12b-GGUF

Text Generation • Updated Dec 6, 2024 • 53

MaziyarPanahi/patricide-12B-Unslop-Mell-GGUF

Text Generation • Updated Dec 6, 2024 • 48

MaziyarPanahi/Capt-Dark-Science-12B-GGUF

Text Generation • Updated Dec 6, 2024 • 8

MaziyarPanahi/Ninja-V3-nsfw-enhance-GGUF

Text Generation • Updated Dec 6, 2024 • 69 • 1

MaziyarPanahi/Dark-Science-12B-GGUF

Text Generation • Updated Dec 6, 2024 • 9

MaziyarPanahi/SAINEMO-reMIX-GGUF

Text Generation • Updated Dec 6, 2024 • 26 • 1

DrNicefellow/QwQ-32B-Preview-abliterated-2.0bpw-exl2

Updated Dec 7, 2024 • 6

MaziyarPanahi/RP-SAINEMO-GGUF

Text Generation • Updated Dec 6, 2024 • 1.02k

MaziyarPanahi/UnslopNemo-v4.1-Magnum-v4-12B-GGUF

Text Generation • Updated Dec 6, 2024 • 17

MaziyarPanahi/IceDrunkenCherryRP-7b-GGUF

Text Generation • Updated Dec 6, 2024 • 2

MaziyarPanahi/MN-SlushoMix-GGUF

Text Generation • Updated Dec 6, 2024 • 20