Edit Models filters

AutoTrain Compatible

text-generation-inference

4-bit precision

Inference Endpoints

8-bit precision

Mixture of Experts

Other with no match

text-embeddings-inference

Carbon Emissions

Models

2,655

Full-text search

Active filters: gptq

Qwen/Qwen2-72B-Instruct-GPTQ-Int4

Text Generation • Updated 17 days ago • 64.3k • 18

Qwen/Qwen2-0.5B-Instruct-GPTQ-Int4

Text Generation • Updated 17 days ago • 892 • 8

Qwen/Qwen-VL-Chat-Int4

Text Generation • Updated Jan 25 • 29k • 78

Rakuto/Phi-3-medium-4k-instruct-gptq-4bit

Text Generation • Updated May 23 • 412 • 2

Qwen/Qwen2-7B-Instruct-GPTQ-Int4

Text Generation • Updated 17 days ago • 5.4k • 13

allganize/Llama-3-Alpha-Ko-8B-Instruct-GPTQ

Text Generation • Updated 6 days ago • 79 • 2

TheBloke/WizardLM-7B-uncensored-GPTQ

Text Generation • Updated Oct 26, 2023 • 1.92k • 186

TheBloke/Wizard-Vicuna-13B-Uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 6.85k • 309

TheBloke/Manticore-13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 15 • 37

TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 823 • 548

TheBloke/WizardLM-Uncensored-SuperCOT-StoryTelling-30B-GPTQ

Text Generation • Updated Sep 27, 2023 • 387 • 82

TheBloke/WizardCoder-15B-1.0-GPTQ

Text Generation • Updated Aug 21, 2023 • 101 • 176

TheBloke/vicuna-7B-v1.3-GPTQ

Text Generation • Updated Aug 21, 2023 • 79 • 17

TheBloke/Wizard-Vicuna-13B-Uncensored-SuperHOT-8K-GPTQ

Text Generation • Updated Aug 21, 2023 • 327 • 130

TheBloke/LLaMa-7B-GPTQ

Text Generation • Updated Sep 20, 2023 • 211 • 4

TheBloke/Llama-2-7B-Chat-GPTQ

Text Generation • Updated Sep 27, 2023 • 34.6k • 255

TheBloke/Llama-2-13B-chat-GPTQ

Text Generation • Updated Sep 27, 2023 • 24.1k • 358

TheBloke/MythoLogic-Mini-7B-GPTQ

Text Generation • Updated Sep 27, 2023 • 15 • 13

TheBloke/CodeUp-Llama-2-13B-Chat-HF-GPTQ

Text Generation • Updated Sep 27, 2023 • 31 • 16

Trelis/Llama-2-7b-chat-hf-function-calling-GPTQ

Text Generation • Updated Aug 12, 2023 • 33 • 4

TheBloke/MythoMax-L2-13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 3.86k • 166

clibrain/Llama-2-7b-ft-instruct-es-gptq-4bit

Text Generation • Updated Sep 1, 2023 • 72 • 8

TheBloke/Phind-CodeLlama-34B-v2-GPTQ

Text Generation • Updated Sep 27, 2023 • 239 • 87

TheBloke/Pygmalion-2-13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 56 • 42

TheBloke/PuddleJumper-13B-V2-GPTQ

Text Generation • Updated Sep 27, 2023 • 5 • 2

TheBloke/storytime-13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 427 • 19

Qwen/Qwen-14B-Chat-Int4

Text Generation • Updated Dec 13, 2023 • 2.95k • 103

TheBloke/LLaMA2-13B-Tiefighter-GPTQ

Text Generation • Updated Oct 22, 2023 • 122k • 32

squarelike/Gugugo-koen-7B-V1.1-GPTQ

Translation • Updated Nov 19, 2023 • 93 • 2

TheBloke/OpenHermes-2.5-Mistral-7B-GPTQ

Text Generation • Updated Nov 2, 2023 • 6.67k • 26