Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

16,417

Full-text search

Active filters: 4-bit

unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit

Text Generation • Updated Sep 11 • 340k • 37

unsloth/Meta-Llama-3.1-70B-bnb-4bit

Text Generation • Updated Sep 3 • 13.9k • 23

unsloth/Meta-Llama-3.1-70B-Instruct-bnb-4bit

Text Generation • Updated Sep 3 • 13.2k • 20

shuyuej/Mistral-Nemo-Instruct-2407-GPTQ

Text Generation • Updated Jul 25 • 130k • 4

hugging-quants/Meta-Llama-3.1-70B-Instruct-GPTQ-INT4

Text Generation • Updated Aug 7 • 54.8k • 16

hugging-quants/Meta-Llama-3.1-8B-Instruct-GPTQ-INT4

Text Generation • Updated Aug 7 • 146k • 19

tiiuae/falcon-mamba-7b-4bit

Text Generation • Updated 22 days ago • 168 • 11

unsloth/Mistral-Large-Instruct-2407-bnb-4bit

Text Generation • Updated Sep 11 • 326 • 9

shuyuej/Mistral-Large-Instruct-2407-GPTQ

Text Generation • Updated Jul 25 • 301 • 3

TechxGenus/Mistral-Large-Instruct-2407-AWQ

Text Generation • Updated 21 days ago • 1.78k • 9

casperhansen/mistral-large-instruct-2407-awq

Text Generation • Updated Jul 25 • 570 • 4

dahara1/llama3.1-8b-Instruct-awq

Text Generation • Updated Jul 29 • 273 • 3

neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w4a16

Text Generation • Updated 9 days ago • 27.4k • 21

lucyknada/NeverSleep_Lumimaid-v0.2-12B-exl2-4.0bpw

Text Generation • Updated Jul 26 • 18 • 1

shuyuej/bge-en-icl-GPTQ

Feature Extraction • Updated Jul 29 • 96 • 1

shuyuej/bge-multilingual-gemma2-GPTQ

Feature Extraction • Updated Jul 29 • 3.78k • 4

unsloth/gemma-2-2b-it-bnb-4bit

Text Generation • Updated Sep 3 • 25.6k • 13

neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w4a16

Text Generation • Updated 22 days ago • 76.9k • 24

openbmb/MiniCPM-V-2_6-int4

Image-Text-to-Text • Updated Sep 25 • 56.1k • 62

zero-systems/Artemis-Extactor-70B-4bit-gptq-v1

Updated Sep 6 • 1 • 1

solidrust/dolphin-2.9.4-llama3.1-8b-AWQ

Text Generation • Updated Sep 3 • 234 • 3

PrunaAI/THUDM-LongWriter-glm4-9b-bnb-4bit-smashed

Updated Aug 16 • 10 • 2

MaziyarPanahi/SmolLM-1.7B-Instruct-v0.2-GGUF

Text Generation • Updated Aug 18 • 285k • 6

unsloth/Phi-3.5-mini-instruct-bnb-4bit

Text Generation • Updated Aug 20 • 87.3k • 10

Statuo/NemoMix-Unleashed-EXL2-4bpw

Text Generation • Updated Aug 23 • 155 • 6

pzc163/MiniCPMv2_6-prompt-generator

Updated Aug 24 • 1.56k • 34

team-hatakeyama-phase2/Tanuki-8B-dpo-v1.0-AWQ

Text Generation • Updated Sep 3 • 1.28k • 2

team-hatakeyama-phase2/Tanuki-8x8B-dpo-v1.0-AWQ

Text Generation • Updated Sep 3 • 313 • 3

team-hatakeyama-phase2/Tanuki-8B-dpo-v1.0-GPTQ-4bit

Text Generation • Updated Sep 3 • 312 • 1

team-hatakeyama-phase2/Tanuki-8x8B-dpo-v1.0-GPTQ-4bit

Text Generation • Updated Sep 3 • 287 • 2