Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

17,441

Full-text search

Active filters: 4-bit

ModelCloud/gemma-2-27b-it-gptq-4bit

Text Generation • Updated Jul 23 • 1.07k • 11

shuyuej/gemma-2-27b-it-GPTQ

Text Generation • Updated Sep 28 • 745 • 2

casperhansen/mistral-nemo-instruct-2407-awq

Text Generation • Updated Sep 27 • 228k • 8

shuyuej/Meta-Llama-3.1-70B-Instruct-GPTQ

Text Generation • Updated Sep 28 • 121 • 3

unsloth/Meta-Llama-3.1-70B-bnb-4bit

Text Generation • Updated 7 minutes ago • 9.16k • 28

MaziyarPanahi/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • Updated Jul 29 • 1.85M • 37

unsloth/Meta-Llama-3.1-70B-Instruct-bnb-4bit

Text Generation • Updated 11 minutes ago • 20.4k • 26

hugging-quants/Meta-Llama-3.1-70B-Instruct-GPTQ-INT4

Text Generation • Updated Aug 7 • 57.4k • 18

hugging-quants/Meta-Llama-3.1-8B-Instruct-GPTQ-INT4

Text Generation • Updated Aug 7 • 22.7k • 20

RiversHaveWings/Meta-Llama-3.1-405B-AWQ

Text Generation • Updated Jul 24 • 66 • 6

casperhansen/mistral-large-instruct-2407-awq

Text Generation • Updated Jul 25 • 841 • 4

TechxGenus/Mistral-Large-Instruct-2407-GPTQ

Text Generation • Updated Jul 27 • 641 • 2

SoumilB7/L3_8B_Solana_Smart_Contract_Analyser

Text Generation • Updated Aug 22 • 7 • 1

dahara1/llama3.1-8b-Instruct-awq

Text Generation • Updated Jul 29 • 144 • 3

neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w4a16

Text Generation • Updated 30 days ago • 10.7k • 21

shuyuej/SFR-Embedding-2_R-GPTQ

Feature Extraction • Updated 1 day ago • 274 • 1

neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w4a16

Text Generation • Updated Oct 10 • 21k • 25

MaziyarPanahi/gemma-2-2b-it-GGUF

Text Generation • Updated Aug 1 • 1.84M • 5

openbmb/MiniCPM-V-2_6-int4

Image-Text-to-Text • Updated Sep 25 • 76.7k • 67

SicariusSicariiStuff/Dusk_Rainbow-EXL2-4.0-bpw

Updated Aug 17 • 14 • 1

arcee-ai/deepseek-v2-chat-0628-awq

Updated Aug 17 • 5 • 6

MaziyarPanahi/SmolLM-1.7B-Instruct-v0.2-GGUF

Text Generation • Updated Aug 18 • 1.07M • 7

alicekyting/whisper-large-v3-4bit

Automatic Speech Recognition • Updated Aug 22 • 17 • 1

MaziyarPanahi/Phi-3.5-mini-instruct-GGUF

Text Generation • Updated Aug 20 • 1.84M • 5

alicekyting/Qwen2-Audio-7B-Instruct-4bit

Text2Text Generation • Updated Aug 22 • 179 • 3

pzc163/MiniCPMv2_6-prompt-generator

Updated Aug 24 • 984 • 35

ms57rd/Llama-3.1-8B-quantized-EEG-TimeLLM

Updated Aug 25 • 130 • 7

Qwen/Qwen2-VL-7B-Instruct-AWQ

Image-Text-to-Text • Updated Sep 25 • 291k • 39

Qwen/Qwen2-VL-7B-Instruct-GPTQ-Int4

Image-Text-to-Text • Updated Sep 21 • 132k • 25

Qwen/Qwen2-VL-2B-Instruct-AWQ

Image-Text-to-Text • Updated Sep 21 • 9.72k • 15