Edit Models filters

Inference Providers

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

5,944

Full-text search

Active filters: awq

PrunaAI/MaziyarPanahi-Llama-3-8B-Instruct-DPO-v0.4-AWQ-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 79

PrunaAI/NurtureAI-Meta-Llama-3-8B-Instruct-32k-AWQ-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 80

PrunaAI/beomi-Llama-3-KoEn-8B-Instruct-preview-AWQ-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 82

PrunaAI/Wanfq-FuseLLM-7B-AWQ-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 81

PrunaAI/codellama-CodeLlama-7b-Python-hf-AWQ-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 82

PrunaAI/openbmb-MiniCPM-2B-sft-bf16-llama-format-AWQ-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 80

PrunaAI/JackFram-llama-68m-AWQ-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 122

PrunaAI/PORTULAN-gervasio-7b-portuguese-ptpt-decoder-AWQ-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 90

PrunaAI/sambanovasystems-SambaLingo-Turkish-Base-AWQ-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 80

PrunaAI/ruslanmv-Medical-Llama3-8B-AWQ-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 107

PrunaAI/rinna-youri-7b-instruction-AWQ-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 82

PrunaAI/amazon-MistralLite-AWQ-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 82

PrunaAI/cognitivecomputations-fc-dolphin-2.6-mistral-7b-dpo-laser-AWQ-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 81

PrunaAI/Magpie-Align-Llama-3-8B-Magpie-Pro-SFT-v0.1-AWQ-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 83

PrunaAI/chargoddard-mistral-11b-slimorca-AWQ-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 81

PrunaAI/tokyotech-llm-Swallow-13b-hf-AWQ-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 87

dan-kwiat/70b-learn-60-epoch-4-awq

Text Generation • Updated Jun 24, 2024 • 13

dan-kwiat/70b-tmp-awq

Text Generation • Updated Jun 24, 2024 • 7

agi-designer/Aspera-SWE-Llama-13b-updated-4bit-awq

Text Generation • Updated Jun 24, 2024 • 80

agi-designer/Aspera-SWE-Llama-7b-updated-4bit-awq

Text Generation • Updated Jun 24, 2024 • 81

elyza/Llama-3-ELYZA-JP-8B-AWQ

Text Generation • Updated Jun 26, 2024 • 2.37k • 3

palisaderesearch/Badllama-3-8B

Text Generation • Updated Nov 20, 2024 • 6 • 1

PrunaAI/MaziyarPanahi-Llama-3-8B-Instruct-v0.9-AWQ-4bit-smashed

Text Generation • Updated Jul 12, 2024 • 80

Weni/ZeroShot-Agents-Llama3-4.0.29-DPO-AWQ

Text Generation • Updated Jun 25, 2024 • 80

macadeliccc/dolphin-2.9.2-qwen2-7b-AWQ

Text Generation • Updated Jun 25, 2024 • 82

Weni/ZeroShot-Agents-Llama3-4.0.30-DPO-AWQ

Text Generation • Updated Jun 25, 2024 • 81

Weni/ZeroShot-Agents-Llama3-4.0.31-DPO-AWQ

Text Generation • Updated Jun 25, 2024 • 78

Weni/ZeroShot-Agents-Llama3-4.0.32-DPO-AWQ

Text Generation • Updated Jun 26, 2024 • 80

Weni/ZeroShot-Agents-Llama3-4.0.33-DPO-AWQ

Text Generation • Updated Jun 26, 2024 • 79

blehyaric/llama-2-7b-chat-hf-awq-gemm

Text Generation • Updated Jun 26, 2024 • 79