Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

8-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

1,896

Full-text search

Active filters: 5-bit

SicariusSicariiStuff/PygmalionAI_pygmalion-7b-EXL2-5.0bpw

Text Generation • Updated Aug 20, 2024 • 7

LoneStriker/Phi-3.5-mini-instruct-5.0bpw-h6-exl2

Text Generation • Updated Aug 20, 2024 • 8

drexample/magnum-v2-123b-exl2-5.0bpw

Text Generation • Updated Aug 21, 2024 • 5 • 1

jburmeister/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Aug 22, 2024 • 63

jburmeister/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • Updated Aug 22, 2024 • 99

jburmeister/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • Updated Aug 22, 2024 • 87

BigHuggyD/anthracite-org_magnum-v2-123b_exl2_5.0bpw_h6

Text Generation • Updated Aug 22, 2024 • 5

SicariusSicariiStuff/Phi-3.5-mini-instruct_Uncensored-EXL2-5.0bpw

Text Generation • Updated Aug 24, 2024 • 4

MaziyarPanahi/calme-2.1-phi3.5-4b-GGUF

Text Generation • Updated Aug 23, 2024 • 293 • 1

bullerwins/Hermes-3-Llama-3.1-8B-exl2_5.0bpw

Updated Aug 23, 2024 • 4

bullerwins/Hermes-3-Llama-3.1-70B-exl2_5.0bpw

Updated Aug 24, 2024 • 6

SicariusSicariiStuff/2B-ad-EXL2-5.0bpw

Updated Aug 26, 2024 • 2

MaziyarPanahi/xLAM-8x22b-r-GGUF

Text Generation • Updated Sep 6, 2024 • 211 • 1

pigfoot/Llama-3-Taiwan-8B-Instruct-V1-5bpw-exl2

Text Generation • Updated Aug 30, 2024 • 10

LoneStriker/LongWriter-llama3.1-8b-5.0bpw-h6-exl2

Text Generation • Updated Aug 30, 2024 • 5

MikeRoz/c4ai-command-r-plus-08-2024-5.0bpw-h8-exl2

Text Generation • Updated Sep 1, 2024 • 4 • 2

bullerwins/c4ai-command-r-08-2024-exl2_5.0bpw

Text Generation • Updated Aug 31, 2024 • 9 • 1

Proverbial1/Luminum-v0.1-123B_exl2_5.0bpw_h8

Text Generation • Updated Sep 1, 2024 • 25

BigHuggyD/c4ai-command-r-plus-08-2024_exl2_5.0bpw_h6

Text Generation • Updated Sep 1, 2024 • 3

bullerwins/c4ai-command-r-plus-08-2024-exl2_5.0bpw

Text Generation • Updated Sep 2, 2024 • 5

bigstorm/Mistral-Large-Instruct-2407-5.0bpw-8hb-exl2

Updated Sep 4, 2024 • 4

BigHuggyD/FluffyKaeloky_Luminum-v0.1-123B_exl2_5.0bpw_h6

Text Generation • Updated Sep 7, 2024 • 9

LoneStriker/Yi-Coder-9B-Chat-5.0bpw-h6-exl2

Text Generation • Updated Sep 4, 2024 • 4

LoneStriker/Yi-Coder-9B-5.0bpw-h6-exl2

Updated Sep 4, 2024 • 3

bullerwins/Reflection-70B-exl2_5.0bpw

Text Generation • Updated Sep 6, 2024 • 5 • 1

LoneStriker/Reflection-Llama-3.1-70B-5.0bpw-h6-exl2

Text Generation • Updated Sep 6, 2024 • 4

MaziyarPanahi/DeepSeek-V2.5-GGUF

Text Generation • Updated Sep 11, 2024 • 97.8k • 4

async0x42/Meta-Llama-3.1-8B-exl2_5bpw

Text Generation • Updated Sep 8, 2024 • 4

schnapper79/lumikabra-123B_v0.4-exl2-5.0bpw

Text Generation • Updated Sep 9, 2024 • 9

MikeRoz/mattshumer_ref_70_e3-5.0bpw-h6-exl2

Text Generation • Updated Sep 9, 2024 • 5