Edit Models filters

Inference status

Misc

Inference Endpoints

4-bit precision

8-bit precision

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

847

Full-text search

Active filters: imatrix

bartowski/Big-Tiger-Gemma-27B-v1-GGUF

Text Generation • Updated Jul 14 • 1.83k • 11

lmstudio-community/mathstral-7B-v0.1-GGUF

Text Generation • Updated Jul 16 • 2.9k • 8

arcee-ai/Arcee-Scribe-GGUF

Updated Jul 17 • 220 • 11

MaziyarPanahi/Llama-3-Groq-8B-Tool-Use-GGUF

Text Generation • Updated Jul 17 • 1.83M • 5

bartowski/Mistral-Nemo-Instruct-2407-GGUF

Text Generation • Updated 20 days ago • 21.3k • 48

bartowski/Arcee-Nova-GGUF

Text Generation • Updated Jul 19 • 336 • 4

bartowski/turbcat-instruct-72b-GGUF

Text Generation • Updated Jul 22 • 214 • 2

bartowski/gemma-2-9b-it-abliterated-GGUF

Text Generation • Updated Oct 7 • 7.97k • 21

mradermacher/llama3-8B-DarkIdol-2.3-Uncensored-32K-i1-GGUF

Updated Aug 2 • 7.3k • 6

legraphista/Meta-Llama-3.1-8B-Instruct-IMat-GGUF

Text Generation • Updated Jul 27 • 944 • 5

MaziyarPanahi/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • Updated Jul 29 • 1.84M • 37

legraphista/Meta-Llama-3.1-70B-Instruct-IMat-GGUF

Text Generation • Updated Jul 27 • 1.18k • 11

legraphista/Mistral-Large-Instruct-2407-IMat-GGUF

Text Generation • Updated Jul 25 • 1.19k • 29

lmstudio-community/Mistral-Large-Instruct-2407-GGUF

Text Generation • Updated Aug 29 • 690 • 13

bartowski/Meta-Llama-3.1-8B-Instruct-abliterated-GGUF

Text Generation • Updated Jul 28 • 16.8k • 6

lmstudio-community/Phi-3.1-mini-128k-instruct-GGUF

Text Generation • Updated Jul 25 • 4.23k • 3

Reiterate3680/Sekhmet_Bet-L3.1-8B-v0.2-GGUF

Text Generation • Updated Aug 6 • 103 • 1

mradermacher/Meta-Llama-3.1-8B-Instruct-i1-GGUF

Updated Aug 2 • 574 • 3

mradermacher/Meta-Llama-3.1-Chat-Uncensored-i1-GGUF

Updated Aug 2 • 861 • 2

mradermacher/Meta-Llama-3.1-70B-Instruct-i1-GGUF

Updated Aug 2 • 906 • 2

mradermacher/Nemomix-v4.0-12B-i1-GGUF

Updated Jul 31 • 262 • 6

lmstudio-community/gemma-2-2b-it-GGUF

Text Generation • Updated Jul 31 • 12.2k • 17

ThomasBaruzier/gemma-2-2b-it-GGUF

Text Generation • Updated Aug 17 • 508 • 1

legraphista/Palmyra-Fin-70B-32K-IMat-GGUF

Text Generation • Updated Aug 2 • 1.61k • 7

bartowski/MN-12B-Lyra-v1-GGUF

Text Generation • Updated 25 days ago • 2.54k • 4

mradermacher/MN-12B-Starcannon-v3-i1-GGUF

Updated Aug 6 • 3.54k • 4

mradermacher/Llama-3.1-11b-pretrained-i1-GGUF

Updated Aug 6 • 130 • 1

mradermacher/calme-2.3-legalkit-8b-i1-GGUF

Updated Sep 8 • 210 • 1

bartowski/dolphin-2.9.4-llama3.1-8b-GGUF

Text Generation • Updated Aug 9 • 2.28k • 9

bartowski/NemoReRemix-12B-GGUF

Text Generation • Updated Aug 14 • 528 • 7