Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

8-bit precision

AutoTrain Compatible

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

13,305

Full-text search

Active filters: imatrix

DavidAU/TinyLlama-1.1B-Chat-v1.0-Ultra-NEO-V1-Imatrix-GGUF

Text Generation • Updated Nov 14, 2024 • 3.57k • 1

mradermacher/L3-8B-Lunaris-v1-i1-GGUF

Updated Aug 2, 2024 • 1.97k • 14

Undi95/MG-FinalMix-72B-GGUF

Updated Jun 26, 2024 • 12 • 2

mradermacher/Chocolatine-8B-Instruct-DPO-v1.0-i1-GGUF

Updated Feb 3 • 184 • 1

bartowski/L3-Aethora-15B-V2-GGUF

Text Generation • Updated Jun 27, 2024 • 209 • 5

mradermacher/Llama-3-Mopeyfied-Psychology-v2-i1-GGUF

Updated Feb 7 • 1.76k • 2

mradermacher/Llama-3-LewdPlay-8B-evo-i1-GGUF

Updated Aug 2, 2024 • 458 • 1

mradermacher/llama3-8B-DarkIdol-2.1-Uncensored-1048K-i1-GGUF

Updated Aug 2, 2024 • 890 • 3

bartowski/gemma-2-27b-it-GGUF

Text Generation • Updated Aug 3, 2024 • 14.3k • 168

mradermacher/dolphin-2.9.3-llama-3-8b-i1-GGUF

Updated Feb 14 • 337 • 1

lmstudio-community/gemma-2-9b-it-GGUF

Text Generation • Updated Jul 16, 2024 • 10.1k • 27

lmstudio-community/gemma-2-27b-it-GGUF

Text Generation • Updated Jul 2, 2024 • 12k • 13

grapevine-AI/gemma-2-27b-it-gguf

Updated Oct 26, 2024 • 282 • 13

mradermacher/QuartetAnemoi-70B-t0.0001-i1-GGUF

Updated Aug 2, 2024 • 1.58k • 11

NorwAI/NorwAI-Mistral-7B-instruct

Text Generation • Updated Jul 8, 2024 • 284 • 9

mradermacher/Hathor_Aleph-L3-8B-v0.72-i1-GGUF

Updated Feb 5 • 29 • 1

DavidAU/Psyonic-Cetacean-MythoMax-ED2-Prose-Crazy-Ultra-Quality-29B-GGUF

Text Generation • Updated Nov 22, 2024 • 149 • 2

mradermacher/L3-8B-Everything-COT-i1-GGUF

Updated Aug 2, 2024 • 119 • 2

backyardai/Midnight-Miqu-70B-v1.5-GGUF

Updated Jul 3, 2024 • 1.05k • 5

mradermacher/Meta-Llama-3-8B-Instruct-i1-GGUF

Updated Jul 5, 2024 • 1.46k • 2

mradermacher/granite-8b-code-instruct-i1-GGUF

Updated Dec 16, 2024 • 394 • 1

mradermacher/L3-Umbral-Mind-RP-v3.0-8B-i1-GGUF

Updated Aug 2, 2024 • 858 • 7

mradermacher/stable-code-instruct-3b-i1-GGUF

Updated Aug 2, 2024 • 217 • 1

THUDM/codegeex4-all-9b-GGUF

Text Generation • Updated Jul 15, 2024 • 501 • 12

bartowski/Big-Tiger-Gemma-27B-v1-GGUF

Text Generation • Updated Jul 14, 2024 • 666 • 13

mradermacher/Big-Tiger-Gemma-27B-v1-i1-GGUF

Updated Aug 2, 2024 • 484 • 2

lmstudio-community/mathstral-7B-v0.1-GGUF

Text Generation • Updated Jul 16, 2024 • 6.27k • 9

nisten/llamagnific-3-87b-gguf

Updated Jul 17, 2024 • 63 • 11

mradermacher/gemma-2-9b-it-SimPO-i1-GGUF

Updated Aug 2, 2024 • 1.2k • 8

mradermacher/llama3-8B-DarkIdol-2.3-Uncensored-32K-i1-GGUF

Updated Aug 2, 2024 • 2.11k • 7