Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

8-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

1,896

Full-text search

Active filters: 5-bit

riveRiPH/MN-12B-Lyra-v4-5bpw-h6-exl2

Updated Sep 9, 2024 • 7 • 1

MaziyarPanahi/ref_70_e3-GGUF

Text Generation • Updated Sep 10, 2024 • 87

schnapper79/lumikabra-123B_v0.1-exl2-5.0bpw

Text Generation • Updated Sep 10, 2024 • 7

schnapper79/lumikabra-123B_v0.3-exl2-5.0bpw

Text Generation • Updated Sep 10, 2024 • 7

async0x42/Merged-RP-Stew-V2-34B-exl2_5bpw

Updated Sep 10, 2024 • 3

MaziyarPanahi/reader-lm-1.5b-GGUF

Text Generation • Updated Sep 11, 2024 • 64 • 1

SicariusSicariiStuff/ZeusLabs_Chronos-Divergence-33B-EXL2-5.0bpw

Updated Sep 11, 2024 • 5

MikeRoz/TheDrummer_Donnager-70B-v1-5.0bpw-h6-exl2

Updated Sep 15, 2024 • 1

LoneStriker/Mistral-Small-Instruct-2409-5.0bpw-h6-exl2

Updated Sep 17, 2024 • 5 • 1

MaziyarPanahi/Mistral-Small-Instruct-2409-GGUF

Text Generation • Updated Jan 1 • 642k • 2

MaziyarPanahi/Qwen2.5-0.5B-Instruct-GGUF

Text Generation • Updated Sep 18, 2024 • 143 • 1

MaziyarPanahi/Qwen2.5-3B-Instruct-GGUF

Text Generation • Updated Sep 18, 2024 • 109 • 1

MaziyarPanahi/Qwen2.5-14B-Instruct-GGUF

Text Generation • Updated Sep 18, 2024 • 186 • 1

MaziyarPanahi/Qwen2.5-32B-Instruct-GGUF

Text Generation • Updated Sep 19, 2024 • 200 • 1

LoneStriker/Qwen2.5-7B-Instruct-5.0bpw-h6-exl2

Text Generation • Updated Sep 19, 2024 • 7

LoneStriker/Qwen2.5-14B-Instruct-5.0bpw-h6-exl2

Text Generation • Updated Sep 19, 2024 • 6

LoneStriker/Qwen2.5-32B-Instruct-5.0bpw-h6-exl2

Text Generation • Updated Sep 19, 2024 • 11

Zoyd/Qwen_Qwen2.5-14B-Instruct-5_0bpw_exl2

Text Generation • Updated Sep 19, 2024 • 9

DrNicefellow/Qwen2.5-32B-Instruct-5.0bpw-exl2

Updated Sep 19, 2024 • 6

LoneStriker/Qwen2.5-72B-Instruct-5.0bpw-h6-exl2

Text Generation • Updated Sep 19, 2024 • 12 • 1

NobodySpecial/Qwen2.5-72B-exl2-5.0bpw

Text Generation • Updated Sep 20, 2024 • 6 • 2

DrNicefellow/Qwen2.5-7B-Instruct-5.0bpw-exl2

Updated Sep 20, 2024 • 4

DrNicefellow/Qwen2.5-14B-Instruct-5.0bpw-exl2

Updated Sep 21, 2024 • 14

DrNicefellow/Qwen2.5-Coder-7B-Instruct-5.0bpw-exl2

Updated Sep 21, 2024 • 3

DrNicefellow/Qwen2.5-Math-7B-Instruct-5.0bpw-exl2

Updated Sep 21, 2024 • 3

MikeRoz/ArliAI_Llama-3.1-70B-ArliAI-RPMax-v1.1-5.0bpw-h6-exl2

Updated Sep 27, 2024 • 2

BigHuggyD/gghfez_SmartMaid-123b_exl2_5.0bpw_h6

Updated Sep 28, 2024 • 3

riveRiPH/Lyra4-Gutenberg2-12B-5bpw-h6-exl2

Text Generation • Updated Sep 30, 2024 • 11

SicariusSicariiStuff/Impish_LLAMA_3B-EXL2-5.0bpw

Updated Oct 1, 2024 • 7

altomek/Llama-3.1-70B-Instruct-5bpw-EXL2

Text Generation • Updated Oct 10, 2024 • 4