Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

3,739

Full-text search

Active filters: awq

aryamannningombam/llama-3-awq-4-bit

Text Generation • Updated Jul 17 • 48

PrunaAI/RLHFlow-pair-preference-model-LLaMA3-8B-AWQ-4bit-smashed

Text Generation • Updated Jul 17 • 7

hsan512/vistral_lora_merged_ver2-awq

Text Generation • Updated Jul 17 • 4

PrunaAI/abhishek-autotrain-llama3-no-robots-AWQ-4bit-smashed

Text Generation • Updated Jul 17 • 6

PrunaAI/RLHFlow-LLaMA3-iterative-DPO-final-AWQ-4bit-smashed

Text Generation • Updated Jul 17 • 193

Weni/WeniGPT-Agents-Llama3-5.1.12-DPO-AWQ

Text Generation • Updated Jul 18 • 6

hiuman/Vistral-7B-Chat-quantize

Text Generation • Updated Jul 18 • 4

PrunaAI/ilsp-Meltemi-7B-v1-AWQ-4bit-smashed

Text Generation • Updated Jul 18 • 11

PrunaAI/Rijgersberg-GEITje-7B-AWQ-4bit-smashed

Text Generation • Updated Jul 18 • 9

PrunaAI/mistral-community-Mistral-7B-v0.2-AWQ-4bit-smashed

Text Generation • Updated Jul 18 • 7

PrunaAI/DeepMount00-Minerva-3B-base-RAG-AWQ-4bit-smashed

Text Generation • Updated Jul 18 • 11

PrunaAI/ChaoticNeutrals-Poppy_Porpoise-v0.4-L3-8B-AWQ-4bit-smashed

Text Generation • Updated Jul 18 • 3

PrunaAI/DAMO-NLP-SG-VideoLLaMA2-7B-16F-AWQ-4bit-smashed

Text Generation • Updated Jul 18 • 6

PrunaAI/Muhammad2003-Llama3-8B-OpenHermes-DPO-AWQ-4bit-smashed

Text Generation • Updated Jul 18 • 5

Rui1283/llama3_8b-instruct-w4-g128

Text Generation • Updated Jul 19 • 6

PrunaAI/aloobun-Cypher-7B-AWQ-4bit-smashed

Text Generation • Updated Jul 18 • 9

PrunaAI/Sao10K-L3-8B-Stheno-v3.2-AWQ-4bit-smashed

Text Generation • Updated Jul 18 • 27

infly/INF-34B-Chat-AWQ

Text Generation • Updated Jul 25 • 12 • 3

PrunaAI/AI-MO-NuminaMath-7B-TIR-AWQ-4bit-smashed

Text Generation • Updated Jul 18 • 197

Ichigo2899/mistralai-Mistral-Nemo-Instruct-2407-AWQ

Text Generation • Updated Jul 18 • 89 • 1

PrunaAI/keeeeenw-MicroLlama-AWQ-4bit-smashed

Text Generation • Updated Jul 18 • 5

PrunaAI/unsloth-gemma-7b-it-AWQ-4bit-smashed

Text Generation • Updated Jul 18 • 7

PrunaAI/sethuiyer-Medichat-Llama3-8B-AWQ-4bit-smashed

Text Generation • Updated Jul 19 • 6

hsan512/vistral_lora_merged_ver3-awq

Text Generation • Updated Jul 19 • 4

linl03/Llama-3-8B-AWQ-4bit

Text Generation • Updated Jul 19 • 9

PrunaAI/abacaj-llama-161M-100B-AWQ-4bit-smashed

Text Generation • Updated Jul 19 • 9

PrunaAI/dmis-lab-meerkat-7b-v1.0-AWQ-4bit-smashed

Text Generation • Updated Jul 19 • 6

PrunaAI/h2oai-h2o-danube3-500m-base-AWQ-4bit-smashed

Text Generation • Updated Jul 19 • 11

PrunaAI/amazon-MegaBeam-Mistral-7B-300k-AWQ-4bit-smashed

Text Generation • Updated Jul 19 • 6

PrunaAI/sail-Sailor-0.5B-AWQ-4bit-smashed

Text Generation • Updated Jul 19 • 7