GPTQ Quants - a thesven Collection

thesven 's Collections

GPTQ Quants

updated Sep 13, 2024

thesven/Mistral-7B-Instruct-v0.3-GPTQ

Text Generation • Updated Sep 11, 2024 • 6.2k
thesven/Phi-3.5-mini-instruct-GPTQ-4bit

Text Generation • Updated Aug 29, 2024 • 674
thesven/Phi-nut-Butter-Codebagel-v1-GPTQ

Text Generation • Updated May 26, 2024 • 23
thesven/Aether-Qwen2-0.5B-SFT-v0.0.2-GPTQ

Text Generation • Updated Jun 13, 2024 • 33
thesven/microsoft_WizardLM-2-7B-GPTQ

Text Generation • Updated May 25, 2024 • 23
thesven/prometheus-7b-v2.0-GPTQ

Text2Text Generation • Updated May 31, 2024 • 25
thesven/Meta-Llama-3.1-8B-Instruct-GPTQ

Text Generation • Updated Jul 23, 2024 • 19
thesven/gemma-2-9b-it-GPTQ

Text Generation • Updated Jul 16, 2024 • 22
thesven/Mistral-7B-v0.3-GPTQ

Text Generation • Updated May 25, 2024 • 21
thesven/openchat-3.6-8b-20240522-GPTQ

Text Generation • Updated May 25, 2024 • 27
thesven/Llama-3-8B-GPTQ-4bit

Text Generation • Updated May 13, 2024 • 643
thesven/microsoft_WizardLM-2-7B-GPTQ-98k

Text Generation • Updated May 25, 2024 • 24
thesven/Mistral-7B-Instruct-v0.3-GPTQ-4bit

Text Generation • Updated Aug 2, 2024 • 21
thesven/falcon-11B-GPTQ-4bit

Text Generation • Updated May 14, 2024 • 26