Edit Models filters

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

11,025

Full-text search

Active filters: 4-bit

Xu-Ouyang/pythia-1.4b-deduped-int4-step143000-GPTQ-wikitext2

Text Generation • Updated 6 days ago • 20

PrunaAI/instruction-pretrain-InstructLM-500M-bnb-4bit-smashed

Text Generation • Updated 6 days ago

PrunaAI/AdaptLLM-finance-LLM-bnb-4bit-smashed

Text Generation • Updated 6 days ago

Xu-Ouyang/pythia-6.9b-deduped-int4-step110000-GPTQ-wikitext2

Text Generation • Updated 6 days ago • 27

kheopss/kheops_fr_en_epoch7_4bit_v2

Text Generation • Updated 6 days ago • 2

kheopss/kheops_fr_en_epoch1_4bit_v3

Text Generation • Updated 3 days ago • 2

jrahn/llama-3-8b-infinistruct-v1

Updated 6 days ago

Sai-Rohith-Bobba/phi-3-128k-quant

Text Generation • Updated 6 days ago • 10

AlekseyElygin/Qwen2-0.5B

Text Generation • Updated 6 days ago

dan-kwiat/DeepSeek-Coder-V2-Lite-Instruct-bnb-4bit

Text Generation • Updated 6 days ago • 2

p11-p11/llama3_4bits_II

Text Generation • Updated 6 days ago

ig1/deepseek-coder-7b-base-v1.5-awq

Text Generation • Updated 6 days ago • 6

PrunaAI/MaziyarPanahi-Llama-3-8B-Instruct-v0.9-bnb-4bit-smashed

Text Generation • Updated 4 days ago • 1

alsokit/eLM-mini-4B-4K-4bit-v01-merged-4bit

Text Generation • Updated 5 days ago • 231

PrunaAI/MaziyarPanahi-Llama-3-8B-Instruct-v0.9-AWQ-4bit-smashed

Text Generation • Updated 6 days ago

Weni/ZeroShot-Agents-Llama3-4.0.29-DPO-AWQ

Text Generation • Updated 6 days ago • 3

QuantiPhy/gpt-neo-2.7B-4bit-quantized

Text Generation • Updated 6 days ago • 2

acl-srw-2024/mistral-7b-unsloth-gptq-4bit

Text Generation • Updated 6 days ago • 3

acbdkk/phi-4k-gsm8k

Text Generation • Updated 6 days ago • 252

ig1/deepseek-coder-6.7b-base-awq

Text Generation • Updated 6 days ago • 9

naimul011/Twi-Senti-llama3

Text Generation • Updated 5 days ago • 2

macadeliccc/dolphin-2.9.2-qwen2-7b-AWQ

Text Generation • Updated 6 days ago • 2

Xu-Ouyang/pythia-6.9b-deduped-int4-step143000-GPTQ-wikitext2

Text Generation • Updated 6 days ago • 37

ugurcelebi/llama3-8b-instruct-tr-qlora

Text Generation • Updated 6 days ago • 33

Weni/ZeroShot-Agents-Llama3-4.0.30-DPO-AWQ

Text Generation • Updated 6 days ago • 3

ugurcelebi/ALMind-1.1

Text Generation • Updated 6 days ago • 1

Weni/ZeroShot-Agents-Llama3-4.0.31-DPO-AWQ

Text Generation • Updated 6 days ago • 2

Weni/ZeroShot-Agents-Llama3-4.0.32-DPO-AWQ

Text Generation • Updated 5 days ago • 2

Weni/ZeroShot-Agents-Llama3-4.0.33-DPO-AWQ

Text Generation • Updated 5 days ago • 3

blehyaric/llama-2-7b-chat-hf-awq-gemm

Text Generation • Updated 5 days ago • 3