Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

15,071

Full-text search

Active filters: 4-bit

pigas/opt-125m-gptq-4bit-128g

Text Generation • Updated Jun 25 • 3

pigas/opt-125m-sym-gptqg-4bit-128g

Text Generation • Updated Jun 24 • 5

pigas/opt-125m-sym-gptq-4bit-128g

Text Generation • Updated Jun 24 • 1

KJR/Mistral-7B-Instruct-v0.2-bnb4

Text Generation • Updated Jun 24 • 2

srbdtwentyfour/paligemma_captioning_merged

Updated Jun 25 • 1

agi-designer/Aspera-SWE-Llama-13b-updated-GPTQ-4bit

Text Generation • Updated Jun 24 • 3

agi-designer/Aspera-SWE-Llama-13b-updated-4bit-awq

Text Generation • Updated Jun 24 • 1

obamaTeo/llama-finetune-16bit-wiki-250-ver2-GPTQ

Text Generation • Updated Jun 24 • 2

agi-designer/Aspera-SWE-Llama-7b-updated-4bit-awq

Text Generation • Updated Jun 24 • 1

Xu-Ouyang/pythia-6.9b-deduped-int4-step71000-GPTQ-wikitext2

Text Generation • Updated Jun 25 • 5

bjaidi/Phi-3-medium-128k-instruct-GPTQ-4-bit

Text Generation • Updated Jun 25 • 85

IntelLabs/sqft-mistral-7b-v0.3-50-base-gptq

Text Generation • Updated 20 days ago • 2

PrunaAI/AdaptLLM-law-chat-bnb-4bit-smashed

Text Generation • Updated Jul 12 • 1 • 1

elyza/Llama-3-ELYZA-JP-8B-AWQ

Text Generation • Updated Jun 26 • 1.49k • 2

bluuwhale/NoromaidxOpenGPT4-1-4.0bpw-h6-exl2-rpcal

Text Generation • Updated Jun 25 • 4 • 1

Xu-Ouyang/pythia-1.4b-deduped-int4-step71000-GPTQ-wikitext2

Text Generation • Updated Jun 25 • 5

Xu-Ouyang/pythia-1.4b-deduped-int4-step110000-GPTQ-wikitext2

Text Generation • Updated Jun 25 • 1

Hongkun0911/model

Text Generation • Updated Jun 26 • 1

Xu-Ouyang/pythia-1.4b-deduped-int4-step143000-GPTQ-wikitext2

Text Generation • Updated Jun 25 • 3

PrunaAI/instruction-pretrain-InstructLM-500M-bnb-4bit-smashed

Text Generation • Updated Jul 12 • 3

PrunaAI/AdaptLLM-finance-LLM-bnb-4bit-smashed

Text Generation • Updated Jul 12 • 3

Xu-Ouyang/pythia-6.9b-deduped-int4-step110000-GPTQ-wikitext2

Text Generation • Updated Jun 25 • 1

Raunak1/EMO-Ai

Text Generation • Updated Jun 25 • 4 • 1

jrahn/llama-3-8b-infinistruct-v1

Sai-Rohith-Bobba/phi-3-128k-quant

Text Generation • Updated Jun 25 • 7

AlekseyElygin/Qwen2-0.5B

Text Generation • Updated Jun 25 • 9

dan-kwiat/DeepSeek-Coder-V2-Lite-Instruct-bnb-4bit

Text Generation • Updated Jun 25 • 19

PrunaAI/MaziyarPanahi-Llama-3-8B-Instruct-v0.9-bnb-4bit-smashed

Text Generation • Updated Jul 12 • 2

PrunaAI/MaziyarPanahi-Llama-3-8B-Instruct-v0.9-AWQ-4bit-smashed

Text Generation • Updated Jul 12 • 2

Weni/ZeroShot-Agents-Llama3-4.0.29-DPO-AWQ

Text Generation • Updated Jun 25 • 1