Edit Models filters

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

8-bit precision

AutoTrain Compatible

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

10,987

Full-text search

Active filters: imatrix

legraphista/glm-4-9b-chat-IMat-GGUF

Text Generation • Updated Jun 20, 2024 • 458 • 5

bartowski/DeepSeek-Coder-V2-Instruct-GGUF

Text Generation • Updated Jun 23, 2024 • 1.64k • 29

mradermacher/llama3-turbcat-instruct-8b-i1-GGUF

Updated Aug 2, 2024 • 332 • 1

legraphista/RoLlama3-8b-Instruct-IMat-GGUF

Text Generation • Updated Jun 23, 2024 • 864 • 3

DavidAU/Command-R-01-Ultra-NEO-V1-35B-IMATRIX-GGUF

Text Generation • Updated Nov 14, 2024 • 916 • 16

mradermacher/Hathor_Fractionate-L3-8B-v.05-i1-GGUF

Updated 12 days ago • 270 • 1

mradermacher/Qwen2-7B-Multilingual-RP-i1-GGUF

Updated Aug 2, 2024 • 2.31k • 2

DavidAU/TinyLlama-1.1B-Chat-v1.0-Ultra-NEO-V1-Imatrix-GGUF

Text Generation • Updated Nov 14, 2024 • 735 • 1

Undi95/MG-FinalMix-72B-GGUF

Updated Jun 26, 2024 • 22 • 2

mradermacher/Chocolatine-8B-Instruct-DPO-v1.0-i1-GGUF

Updated 13 days ago • 108 • 1

bartowski/L3-Aethora-15B-V2-GGUF

Text Generation • Updated Jun 27, 2024 • 377 • 5

mradermacher/Llama-3-Mopeyfied-Psychology-v2-i1-GGUF

Updated 10 days ago • 231 • 1

mradermacher/Llama-3-LewdPlay-8B-evo-i1-GGUF

Updated Aug 2, 2024 • 314 • 1

mradermacher/llama3-8B-DarkIdol-2.1-Uncensored-1048K-i1-GGUF

Updated Aug 2, 2024 • 521 • 3

bartowski/gemma-2-27b-it-GGUF

Text Generation • Updated Aug 3, 2024 • 25.1k • 165

mradermacher/dolphin-2.9.3-llama-3-8b-i1-GGUF

Updated 2 days ago • 585 • 1

grapevine-AI/gemma-2-27b-it-gguf

Updated Oct 26, 2024 • 581 • 13

mradermacher/QuartetAnemoi-70B-t0.0001-i1-GGUF

Updated Aug 2, 2024 • 377 • 10

NorwAI/NorwAI-Mistral-7B-instruct

Text Generation • Updated Jul 8, 2024 • 74 • 8

mradermacher/Hathor_Aleph-L3-8B-v0.72-i1-GGUF

Updated 12 days ago • 416 • 1

DavidAU/Psyonic-Cetacean-MythoMax-ED2-Prose-Crazy-Ultra-Quality-29B-GGUF

Text Generation • Updated Nov 22, 2024 • 63 • 2

backyardai/Midnight-Miqu-70B-v1.5-GGUF

Updated Jul 3, 2024 • 1.69k • 4

mradermacher/Meta-Llama-3-8B-Instruct-i1-GGUF

Updated Jul 5, 2024 • 383 • 2

mradermacher/granite-3b-code-instruct-i1-GGUF

Updated Dec 16, 2024 • 356 • 1

mradermacher/granite-8b-code-instruct-i1-GGUF

Updated Dec 16, 2024 • 274 • 1

THUDM/codegeex4-all-9b-GGUF

Text Generation • Updated Jul 15, 2024 • 420 • 10

bartowski/Big-Tiger-Gemma-27B-v1-GGUF

Text Generation • Updated Jul 14, 2024 • 3.39k • 13

mradermacher/Big-Tiger-Gemma-27B-v1-i1-GGUF

Updated Aug 2, 2024 • 545 • 1

nisten/llamagnific-3-87b-gguf

Updated Jul 17, 2024 • 90 • 11

mradermacher/gemma-2-9b-it-SimPO-i1-GGUF

Updated Aug 2, 2024 • 2.93k • 8