Edit Models filters

Inference Providers

HF Inference API

Misc

8-bit precision

AutoTrain Compatible

Inference Endpoints

text-generation-inference

Mixture of Experts

Misc with no match

4-bit precision

text-embeddings-inference

Carbon Emissions

Models

130

Full-text search

Active filters: hqq

mobiuslabsgmbh/Meta-Llama-3-8B-Instruct_4bitgs64_hqq_hf

Text Generation • Updated 10 days ago • 16 • 2

mobiuslabsgmbh/Llama-3.1-8B-Instruct_4bitgs64_hqq_hf

Text Generation • Updated 10 days ago • 43 • 1

mobiuslabsgmbh/Llama-3.2-3B-Instruct_4bitgs64_hqq_hf

Text Generation • Updated 10 days ago • 32 • 1

mobiuslabsgmbh/Qwen2.5-7B-Instruct-1M_4bitgs64_hqq_hf

Text Generation • Updated 10 days ago • 11 • 1

mobiuslabsgmbh/Qwen2.5-14B-Instruct-1M_4bitgs64_hqq_hf

Text Generation • Updated 10 days ago • 14 • 1

mobiuslabsgmbh/Qwen2.5-7B-Instruct_4bitgs64_hqq_hf

Text Generation • Updated 10 days ago • 60 • 1

mlabonne/AlphaMonarch-7B-2bit-HQQ

Text Generation • Updated Mar 28, 2024 • 8 • 7

speakleash/Bielik-7B-Instruct-v0.1-3bit-HQQ

Text Generation • Updated Apr 4, 2024 • 14 • 1

mayflowergmbh/occiglot-7b-de-en-instruct-HQQ

Text Generation • Updated Apr 7, 2024 • 5

mayflowergmbh/occiglot-7b-es-en-instruct-HQQ

Text Generation • Updated Apr 7, 2024 • 5

mayflowergmbh/occiglot-7b-eu5-instruct-HQQ

Text Generation • Updated Apr 7, 2024 • 6

mayflowergmbh/occiglot-7b-fr-en-instruct-HQQ

Text Generation • Updated Apr 7, 2024 • 5

mayflowergmbh/occiglot-7b-it-en-instruct-HQQ

Text Generation • Updated Apr 7, 2024 • 4

Chronal/Noromaid-v0.4-Mixtral-Instruct-8x7b-Zloss_attn-4bit-moe-2bit-metaoffload-HQQ

Text Generation • Updated Apr 15, 2024 • 3 • 1

mayflowergmbh/SauerkrautLM-7b-LaserChat-HQQ

Text Generation • Updated Apr 19, 2024 • 3

mayflowergmbh/Llama-3-SauerkrautLM-8b-Instruct-HQQ

Text Generation • Updated Apr 26, 2024 • 4

mayflowergmbh/Llama3_DiscoLM_German_8b_v0.1_experimental-HQQ

Text Generation • Updated Apr 26, 2024 • 7

webbigdata/C3TR-Adapter_hqq

Translation • Updated May 24, 2024 • 21

aspirina765/Daredevil-8B-abliterated-2bit-HQQ

Text Generation • Updated Jun 9, 2024 • 8 • 3

nm-testing/Llama-3.2-1B-Instruct-HQQ

Updated Oct 30, 2024 • 62

alpindale/magnum-v4-123b-hqq-4bit

Updated Nov 3, 2024 • 10 • 1

PyrTools/Cydonia-22B-v1.2-HQQ-4bit

Updated Nov 3, 2024 • 3

fayez-siddiqui/Llama3_8b_HQQ-1bit

Text Generation • Updated Nov 6, 2024 • 76

fayez-siddiqui/Llama3_8b_HQQ-4bit

Text Generation • Updated Nov 6, 2024 • 77

fayez-siddiqui/Llama3_8b_HQQ-2bit

Text Generation • Updated Nov 6, 2024 • 78

gurro/Llama-3.1-8B_hqq_4bit

Updated Nov 29, 2024 • 3

gurro/llama-3.1-8B-hqq-int3-g64

Updated Dec 1, 2024 • 3

gurro/llama-3.1-8B-hqq-int2-g32

Updated Dec 1, 2024 • 4

gurro/llama-3.1-8B-hqq-int3-g32

Updated Dec 1, 2024 • 7

domlc/llava-11b-cot-hqq

Updated Dec 3, 2024 • 10