Edit Models filters

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

10,833

Full-text search

Active filters: 4-bit

MaziyarPanahi/firefunction-v2-GGUF

Text Generation • Updated 6 days ago • 47.1k • 13

unsloth/llama-3-8b-Instruct-bnb-4bit

Text Generation • Updated May 16 • 432k • 100

unsloth/llama-3-8b-bnb-4bit

Text Generation • Updated May 25 • 418k • 136

CohereForAI/c4ai-command-r-plus-4bit

Text Generation • Updated Apr 5 • 2.77k • 208

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated May 14 • 58.2k • 146

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22 • 558k • 44

THUDM/cogvlm2-llama3-chat-19B-int4

Text Generation • Updated May 24 • 5.1k • 12

Qwen/Qwen2-72B-Instruct-GPTQ-Int4

Text Generation • Updated 16 days ago • 64.3k • 18

Qwen/Qwen2-0.5B-Instruct-GPTQ-Int4

Text Generation • Updated 16 days ago • 892 • 8

TechxGenus/DeepSeek-Coder-V2-Lite-Instruct-AWQ

Text Generation • Updated 4 days ago • 43 • 3

Qwen/Qwen-VL-Chat-Int4

Text Generation • Updated Jan 25 • 29k • 78

casperhansen/llama-3-70b-instruct-awq

Text Generation • Updated Apr 19 • 70.8k • 59

unsloth/llama-3-70b-Instruct-bnb-4bit

Text Generation • Updated May 16 • 9.25k • 33

openbmb/MiniCPM-Llama3-V-2_5-int4

Visual Question Answering • Updated 20 days ago • 20.6k • 50

unsloth/mistral-7b-instruct-v0.3-bnb-4bit

Text Generation • Updated May 22 • 24k • 13

Rakuto/Phi-3-medium-4k-instruct-gptq-4bit

Text Generation • Updated May 23 • 412 • 2

Qwen/Qwen2-72B-Instruct-AWQ

Text Generation • Updated 20 days ago • 4.58k • 14

LoneStriker/Higgs-Llama-3-70B-4.0bpw-h6-exl2

Text Generation • Updated 20 days ago • 7 • 2

AlyBendo/DPO-DoubleQuant-MCQA-TrueMixin

Text2Text Generation • Updated 15 days ago • 9 • 2

allganize/Llama-3-Alpha-Ko-8B-Instruct-GPTQ

Text Generation • Updated 6 days ago • 79 • 2

IlyaGusev/saiga_aya_23_35b_sft_m1_d5_awq_4bit

Text Generation • Updated 4 days ago • 12 • 2

TheBloke/WizardLM-7B-uncensored-GPTQ

Text Generation • Updated Oct 26, 2023 • 1.92k • 186

TheBloke/Wizard-Vicuna-13B-Uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 6.85k • 309

TheBloke/Manticore-13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 15 • 37

TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 823 • 548

TheBloke/WizardLM-Uncensored-SuperCOT-StoryTelling-30B-GPTQ

Text Generation • Updated Sep 27, 2023 • 387 • 82

TheBloke/WizardCoder-15B-1.0-GPTQ

Text Generation • Updated Aug 21, 2023 • 101 • 176

TheBloke/vicuna-7B-v1.3-GPTQ

Text Generation • Updated Aug 21, 2023 • 79 • 17

TheBloke/Wizard-Vicuna-13B-Uncensored-SuperHOT-8K-GPTQ

Text Generation • Updated Aug 21, 2023 • 327 • 130

TheBloke/LLaMa-7B-GPTQ

Text Generation • Updated Sep 20, 2023 • 211 • 4