Edit Models filters

Inference status

Misc

Inference Endpoints

4-bit precision

8-bit precision

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

847

Full-text search

Active filters: imatrix

bartowski/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Aug 3 • 10.5M • 131

DavidAU/Maximizing-Model-Performance-All-Quants-Types-And-Full-Precision-by-Samplers_Parameters

Updated about 7 hours ago • 11

bartowski/Qwen2.5.1-Coder-7B-Instruct-GGUF

Text Generation • Updated 19 days ago • 65.2k • 62

bartowski/Llama-3.2-1B-Instruct-GGUF

Text Generation • Updated Oct 8 • 126k • 65

bartowski/Ministral-8B-Instruct-2410-GGUF

Text Generation • Updated Oct 21 • 21.1k • 22

bartowski/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Oct 8 • 121k • 78

MaziyarPanahi/Qwen2-7B-Instruct-GGUF

Text Generation • Updated Jun 6 • 2.12M • 10

MaziyarPanahi/Mistral-Nemo-Instruct-2407-GGUF

Text Generation • Updated Jul 22 • 1.84M • 33

bartowski/Phi-3.5-mini-instruct-GGUF

Text Generation • Updated Sep 15 • 17.3k • 52

bartowski/Mistral-Small-Instruct-2409-GGUF

Text Generation • Updated Sep 19 • 14k • 46

bartowski/Qwen2.5-32B-AGI-GGUF

Text Generation • Updated Sep 22 • 19.5k • 20

bartowski/Llama-3.1-8B-Stheno-v3.4-GGUF

Text Generation • Updated Sep 30 • 1.29k • 4

arcee-ai/SuperNova-Medius-GGUF

Updated Oct 17 • 23.4k • 50

bartowski/Pantheon-RP-Pure-1.6.2-22b-Small-GGUF

Text Generation • Updated Oct 13 • 2.6k • 11

bartowski/Llama-3.1-Nemotron-70B-Instruct-HF-GGUF

Text Generation • Updated Oct 16 • 111k • 87

bartowski/SmolLM2-135M-Instruct-GGUF

Text Generation • Updated 25 days ago • 1.73k • 3

telosnex/fllama

Updated Sep 25 • 559 • 6

Nexesenex/MIstral-QUantized-70b_Miqu-1-70b-iMat.GGUF

Updated Oct 12 • 2.67k • 69

Lewdiculous/BuRP_7B-GGUF-IQ-Imatrix

Updated May 4 • 559 • 25

bartowski/codegemma-1.1-7b-it-GGUF

Text Generation • Updated May 10 • 2.7k • 5

dddump/Japanese-TextGen-Kage-v0.1-2x7B-gguf

Text Generation • Updated May 19 • 67 • 6

bartowski/Code-Llama-3-8B-GGUF

Text Generation • Updated May 7 • 512 • 8

backyardai/Fimbulvetr-11B-v2-GGUF

Updated May 22 • 1.94k • 6

bartowski/Nxcode-CQ-7B-orpo-GGUF

Text Generation • Updated May 11 • 414 • 6

bartowski/Yi-1.5-34B-Chat-GGUF

Text Generation • Updated May 12 • 1.45k • 20

lmstudio-community/Yi-1.5-34B-Chat-GGUF

Text Generation • Updated May 13 • 350 • 9

bartowski/dolphin-2.9.1-qwen-110b-GGUF

Text Generation • Updated May 15 • 213 • 2

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22 • 1.96M • 63

lmstudio-community/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22 • 8.73k • 25

bartowski/aya-23-8B-GGUF

Text Generation • Updated May 23 • 2.74k • 42