Edit Models filters

Inference Providers

HF Inference API

Misc

AutoTrain Compatible

text-generation-inference

4-bit precision

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

5,222

Full-text search

Active filters: gptq

TheBloke/Vicuna-7B-v1-3-SuperHOT-8K-GPTQ

Text Generation • Updated Aug 21, 2023 • 82 • 3

TheBloke/Vicuna-7B-CoT-SuperHOT-8K-GPTQ

Text Generation • Updated Aug 21, 2023 • 85 • 6

TheBloke/Wizard-Vicuna-7B-Uncensored-SuperHOT-8K-GPTQ

Text Generation • Updated Aug 21, 2023 • 124 • 16

TheBloke/WizardLM-7B-V1-0-Uncensored-SuperHOT-8K-GPTQ

Text Generation • Updated Aug 21, 2023 • 103 • 16

TheBloke/PMC_LLAMA-7B-10-Epoch-SuperHOT-8K-GPTQ

Text Generation • Updated Aug 21, 2023 • 88 • 5

elinas/chronos-13b-8k-GPTQ

Text Generation • Updated Jul 8, 2023 • 17 • 3

TheBloke/WizardLM-13B-V1.1-GPTQ

Text Generation • Updated Sep 27, 2023 • 45 • 28

TheBloke/WizardLM-13B-V1-1-SuperHOT-8K-GPTQ

Text Generation • Updated Aug 21, 2023 • 1.79k • 46

seonglae/opt-125m-4bit-gptq

Text Generation • Updated Jul 19, 2023 • 12

TheBloke/orca_mini_v2_13b-GPTQ

Text Generation • Updated Aug 21, 2023 • 15 • 19

TheBloke/GodziLLa-30B-GPTQ

Text Generation • Updated Aug 21, 2023 • 17 • 6

TheBloke/openchat_v2-GPTQ

Text Generation • Updated Aug 21, 2023 • 18 • 4

TheBloke/openchat_v2_w-GPTQ

Text Generation • Updated Aug 21, 2023 • 16 • 6

TheBloke/WizardCoder-Guanaco-15B-V1.0-GPTQ

Text Generation • Updated Sep 3, 2023 • 19 • 16

TheBloke/Chronoboros-33B-GPTQ

Text Generation • Updated Sep 27, 2023 • 91 • 28

TheBloke/airochronos-33B-GPTQ

Text Generation • Updated Sep 27, 2023 • 88 • 8

TheBloke/open-llama-7B-v2-open-instruct-GPTQ

Text Generation • Updated Sep 10, 2023 • 20 • 2

TheBloke/Starcoderplus-Guanaco-GPT4-15B-V1.0-GPTQ

Text Generation • Updated Aug 21, 2023 • 12 • 9

TheBloke/OpenOrca-Preview1-13B-GPTQ

Text Generation • Updated Aug 21, 2023 • 14 • 9

TheBloke/openchat_v2_openorca_preview-GPTQ

Text Generation • Updated Aug 21, 2023 • 1.76k • 15

seonglae/wizardlm-7b-uncensored-gptq

Text Generation • Updated Jul 19, 2023 • 17

TheBloke/h2ogpt-gm-oasst1-en-2048-falcon-7b-v3-GPTQ

Text Generation • Updated Aug 21, 2023 • 20 • 4

TheBloke/WizardCoder-Guanaco-15B-V1.1-GPTQ

Text Generation • Updated Aug 21, 2023 • 24 • 13

TheBloke/LLaMa-65B-GPTQ

Text Generation • Updated Sep 20, 2023 • 31 • 5

TheBloke/LLaMa-13B-GPTQ

Text Generation • Updated Sep 20, 2023 • 29 • 5

TheBloke/LLaMa-30B-GPTQ

Text Generation • Updated Sep 20, 2023 • 264 • 5

TheBloke/MythoLogic-13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 16 • 15

TheBloke/Codegen25-7B-mono-GPTQ

Text Generation • Updated Aug 21, 2023 • 33 • 8

TheBloke/Llama-2-7B-GPTQ

Text Generation • Updated Sep 27, 2023 • 22k • 81

TheBloke/Llama-2-13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 710 • 120