Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

3,758

Full-text search

Active filters: awq

Udith-Sandaruwan/Llama-3-8B-AWQ-4bit

Text Generation • Updated Jun 30 • 10

PrunaAI/mrfakename-refusal-AWQ-4bit-smashed

Text Generation • Updated Jul 12 • 16

cc8055/tinyllamafullprecision20k-AWQ

Text Generation • Updated Jul 1 • 11

DavidHuggingFace/Heimer-dpo-TinyLlama-1.1B-AWQ

Text Generation • Updated Jul 1 • 8

davidsvaughn/feedback-wizard-4bit-awq

Text Generation • Updated Jul 1 • 4

internlm/internlm2_5-7b-chat-4bit

Text Generation • Updated Jul 2 • 91 • 5

Weni/ZeroShot-Agents-Llama3-4.0.42-ORPO-AWQ

Text Generation • Updated Jul 2 • 7

Udith-Sandaruwan/opt-125m-AWQ-4bit

Text Generation • Updated Jul 2 • 7

Weni/ZeroShot-Agents-Llama3-4.0.43-ORPO-AWQ

Text Generation • Updated Jul 2 • 10

XavierSpycy/Meta-Llama-3-8B-Instruct-zh-10k-AWQ

Text Generation • Updated Jul 9 • 5

Weni/ZeroShot-Agents-Llama3-4.0.44-ORPO-AWQ

Text Generation • Updated Jul 3 • 13

Weni/ZeroShot-Agents-Llama3-4.0.45-ORPO-AWQ

Text Generation • Updated Jul 3 • 6

Weni/ZeroShot-Agents-Llama3-4.0.46-ORPO-AWQ

Text Generation • Updated Jul 4 • 6

OliP/Phi-3-mini-128k-instruct-awq

Text Generation • Updated Jul 9 • 12 • 2

casperhansen/deepseek-coder-v2-instruct-awq

Text Generation • Updated Jul 3 • 6.42k • 11

typealias/internlm2_5-7b-chat-4bit

Text Generation • Updated Jul 3 • 5

zhiG/Llama-3-Swallow-70B-Instruct-v0.1-awq-4bit

Text Generation • Updated Jul 3 • 17

PrunaAI/Sao10K-L3-8B-Chara-v1-Alpha-AWQ-4bit-smashed

Text Generation • Updated Jul 12 • 10

PrunaAI/eryk-mazus-polka-1.1b-AWQ-4bit-smashed

Text Generation • Updated Jul 12 • 10

bsmit1659/Phi-3-mini-128k-instruct-0.2-awq

Text Generation • Updated Jul 3 • 8

PrunaAI/mistralai-Mistral-7B-v0.1-AWQ-4bit-smashed

Text Generation • Updated Jul 12 • 6

rubra-ai/Meta-Llama-3-70B-Instruct-AWQ

Text Generation • Updated Jul 4 • 5

ravi-wcg/Llama-3-8B-AWQ-4bit

Text Generation • Updated Jul 4 • 10

ravi-wcg/Llama-3-8B-Instruct-AWQ-4bit

Text Generation • Updated Jul 4 • 4

TechxGenus/DeepSeek-V2-Lite-Chat-AWQ

Text Generation • Updated Jul 4 • 40 • 1

TechxGenus/DeepSeek-V2-Lite-AWQ

Text Generation • Updated Jul 4 • 7

Weni/ZeroShot-Agents-Llama3-4.0.47-SFT-AWQ

Text Generation • Updated Jul 4 • 5

Weni/ZeroShot-Agents-Llama3-4.0.48-SFT-AWQ

Text Generation • Updated Jul 5 • 6

Weni/ZeroShot-Agents-Llama3-4.0.49-DPO-AWQ

Text Generation • Updated Jul 5 • 6

ellamind/qwen2-72b-instruct-awq-de

Text Generation • Updated Jul 22 • 4