Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

15,110

Full-text search

Active filters: 4-bit

hanaearg/Llama3_Ecommerce

karthiksagarn/Mistral-Flan-v2-Q4-submix

Text Generation • Updated Jul 8

Rakuto/Llama3-ChatQA-1.5-8B-GPTQ-4bit

Text Generation • Updated Jul 8 • 24

solidrust/dolphin-2.9.3-mistral-7B-32k-AWQ

Text Generation • Updated 30 days ago • 58

shunran/L3-ChaoticSoliloquy-v1.5-4x8B-awq

Text Generation • Updated Jul 8 • 1

SiddharthShukla48/MindEase_q4b

Text Generation • Updated Jul 8 • 3

nihaomur/Llama-3-Taiwan-8B-Instruct-AWQ-4bit

Text Generation • Updated Jul 19 • 32 • 1

sanjay782/step_1000_tamil

Text Generation • Updated Jul 8 • 3

solidrust/Phi-3-mini-4k-instruct-AWQ

Text Generation • Updated 30 days ago • 66

kshitizgajurel/Gemini-2b-finetuned

Text Generation • Updated Jul 8 • 6

BilalKhan1/gpt2-model

Text Generation • Updated Jul 8 • 7

mkmagee/Meta-Llama-3-8B-GPTQ

Text Generation • Updated Jul 8 • 1

PrunaAI/lllyasviel-omost-dolphin-2.9-llama3-8b-4bits-bnb-8bit-smashed

Text Generation • Updated Jul 12 • 4

PrunaAI/lllyasviel-omost-dolphin-2.9-llama3-8b-4bits-bnb-4bit-smashed

Text Generation • Updated Jul 12 • 2

eatesaam/gemma-2-27b-it-4bit-quantized

Text Generation • Updated Jul 8 • 29

sanchit42/Mistral-7b-4bit-finetune_tally

Text Generation • Updated Jul 9 • 2

ModelCloud/internlm-2.5-7b-gptq-4bit

Feature Extraction • Updated Jul 9 • 5

ModelCloud/internlm-2.5-7b-chat-gptq-4bit

Feature Extraction • Updated Jul 9 • 10

ModelCloud/internlm-2.5-7b-chat-1m-gptq-4bit

Feature Extraction • Updated Jul 9 • 15

elliotthwang/Gemma_tw_adapter

Text Generation • Updated Jul 8 • 4

jbugguys/test-teacher

Text Generation • Updated Jul 10 • 3

sunrisexu233/test

Text Generation • Updated Jul 8 • 14

Weni/ZeroShot-Agents-Llama3-4.0.58-SFT-AWQ

Text Generation • Updated Jul 8 • 3

AryanNsc/Llama-4bit-7b

Text Generation • Updated Jul 8 • 4

Jinendra/phi-qlora

Text Generation • Updated Jul 8 • 6

Weni/ZeroShot-Agents-Llama3-4.0.57-SFT-140-AWQ

Text Generation • Updated Jul 8 • 2

h2oai/llama-3-70b-instruct-awq

Text Generation • Updated Jul 8 • 3

h2oai/llama-3-8b-instruct-awq

Text Generation • Updated Jul 8 • 28

Weni/ZeroShot-Agents-Llama3-4.0.57-SFT-100-AWQ

Text Generation • Updated Jul 8 • 4

Fischerboot/stablelm-zephyr-3b-freedomrp-qlora-adapter-model