Edit Models filters

Inference Providers

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

24,545

Full-text search

Active filters: 4-bit

cecibas/Midnight-Miqu-70B-v1.5-4bit

Text Generation • Updated Jun 7, 2024 • 671k • 3

nikravan/glm-4vq

Document Question Answering • Updated Jun 16, 2024 • 1.03k • 31

kim512/Llama-3-70b-Arimas-story-RP-V1.6-4.0bpw-h6-exl2

Text Generation • Updated Jun 17, 2024 • 89 • 1

MaziyarPanahi/firefunction-v2-GGUF

Text Generation • Updated Jun 20, 2024 • 975k • 16

PrunaAI/GreatCaptainNemo-ProLLaMA-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 173 • 1

PrunaAI/llmware-bling-phi-3-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 120 • 1

PrunaAI/Undi95-Llama-3-LewdPlay-8B-AWQ-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 89 • 1

IntelLabs/sqft-mistral-7b-v0.3-50-base-gptq

Text Generation • Updated 4 days ago • 158 • 2

unsloth/gemma-2-9b-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 28.3k • 27

unsloth/gemma-2-27b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 2.34k • 14

rootxhacker/CodeAstra-7B

Text Generation • Updated Jul 3, 2024 • 636 • 10

unsloth/Phi-3-mini-4k-instruct-v0-bnb-4bit

Text Generation • Updated Aug 20, 2024 • 109 • 3

unsloth/gemma-2-9b-it-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 59.4k • 23

unsloth/gemma-2-27b-it-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 5.18k • 12

casperhansen/deepseek-coder-v2-instruct-awq

Text Generation • Updated Jul 3, 2024 • 265 • 12

TechxGenus/DeepSeek-V2-Lite-Chat-AWQ

Text Generation • Updated Jul 4, 2024 • 53 • 2

TechxGenus/DeepSeek-V2-Lite-AWQ

Text Generation • Updated Jul 4, 2024 • 143 • 1

mac999/Llama3-8B-BIM

Text Generation • Updated Jul 11, 2024 • 13 • 1

pentagoniac/SEMIKONG-8b-GPTQ

Text Generation • Updated Jul 9, 2024 • 828 • 26

PrunaAI/apple-OpenELM-270M-bnb-4bit-smashed

Text Generation • Updated Jul 13, 2024 • 104 • 1

robinhad/UAlpaca-2.0-Mistral-7B

Text Generation • Updated Jul 14, 2024 • 65 • 1

arcee-ai/Arcee-Nova-AWQ

Text Generation • Updated Jul 16, 2024 • 80 • 1

unsloth/Mistral-Nemo-Base-2407-bnb-4bit

Text Generation • Updated 15 days ago • 8.06k • 15

unsloth/Mistral-Nemo-Instruct-2407-bnb-4bit

Text Generation • Updated 15 days ago • 17.5k • 27

hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7, 2024 • 283k • 96

Svngoku/kongostral

Text Generation • Updated Jul 23, 2024 • 86 • 3

casperhansen/mistral-nemo-instruct-2407-awq

Text Generation • Updated Sep 27, 2024 • 47.9k • 9

unsloth/Meta-Llama-3.1-8B-bnb-4bit

Text Generation • Updated 1 day ago • 246k • 94

ModelCloud/Meta-Llama-3.1-8B-Instruct-gptq-4bit

Text Generation • Updated Jul 29, 2024 • 1.33k • 4

unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit

Text Generation • Updated 1 day ago • 753k • 56