Edit Models filters

Inference status

Misc

Inference Endpoints

4-bit precision

8-bit precision

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

848

Full-text search

Active filters: imatrix

legraphista/datagemma-rig-27b-it-IMat-GGUF

Text Generation • Updated Sep 13 • 334

duyntnet/EvolCodeLlama-7b-imatrix-GGUF

Text Generation • Updated Sep 16 • 1

legraphista/Mistral-Small-Instruct-2409-IMat-GGUF

Text Generation • Updated Sep 18 • 365

legraphista/Qwen2.5-0.5B-Instruct-IMat-GGUF

Text Generation • Updated Sep 19 • 149

legraphista/Qwen2.5-1.5B-Instruct-IMat-GGUF

Text Generation • Updated Sep 19 • 843

legraphista/Qwen2.5-3B-Instruct-IMat-GGUF

Text Generation • Updated Sep 19 • 309

legraphista/Qwen2.5-7B-Instruct-IMat-GGUF

Text Generation • Updated Sep 19 • 196

legraphista/Qwen2.5-14B-Instruct-IMat-GGUF

Text Generation • Updated Sep 19 • 438

duyntnet/Mistral-Small-Instruct-2409-imatrix-GGUF

Text Generation • Updated Sep 19 • 45

legraphista/Qwen2.5-32B-Instruct-IMat-GGUF

Text Generation • Updated Sep 19 • 466

legraphista/Qwen2.5-Coder-1.5B-Instruct-IMat-GGUF

Text Generation • Updated Sep 19 • 1.16k

legraphista/Qwen2.5-Math-1.5B-Instruct-IMat-GGUF

Text Generation • Updated Sep 19 • 673

legraphista/Qwen2.5-Coder-7B-Instruct-IMat-GGUF

Text Generation • Updated Sep 19 • 358

legraphista/Qwen2.5-Math-7B-Instruct-IMat-GGUF

Text Generation • Updated Sep 19 • 693

legraphista/Qwen2.5-72B-Instruct-IMat-GGUF

Text Generation • Updated Sep 20 • 320

duyntnet/Qwen2.5-3B-Instruct-imatrix-GGUF

Text Generation • Updated Sep 20 • 85

duyntnet/Qwen2.5-7B-Instruct-imatrix-GGUF

Text Generation • Updated Sep 21 • 129

duyntnet/Qwen2.5-14B-Instruct-imatrix-GGUF

Text Generation • Updated Sep 23 • 231 • 1

duyntnet/Qwen2.5-32B-Instruct-imatrix-GGUF

Text Generation • Updated Sep 24 • 84

duyntnet/Llama-3.2-3B-Instruct-imatrix-GGUF

Text Generation • Updated Sep 25 • 92

duyntnet/Llama-3.2-1B-Instruct-imatrix-GGUF

Text Generation • Updated Sep 25 • 89

legraphista/Llama-3.2-1B-Instruct-IMat-GGUF

Text Generation • Updated Sep 25 • 1.03k

legraphista/Llama-3.2-3B-Instruct-IMat-GGUF

Text Generation • Updated Sep 25 • 763 • 1

legraphista/Llama-Guard-3-1B-IMat-GGUF

Text Generation • Updated Sep 25 • 493

v000000/Typhon-Mixtral-v1-imatrix-v2.Q6_K-GGUF

Updated Sep 26 • 9 • 1

bartowski/Mistral-Small-22B-ArliAI-RPMax-v1.1-GGUF

Text Generation • Updated Sep 26 • 5.57k • 9

LPN64/LongCite-llama3.1-8b-GGUF

Text Generation • Updated Oct 1 • 329 • 5

duyntnet/Qwen2.5-Coder-7B-Instruct-imatrix-GGUF

Text Generation • Updated Sep 27 • 173

duyntnet/Llama-3.2-1B-imatrix-GGUF

Text Generation • Updated Sep 29 • 437

duyntnet/Llama-3.2-3B-imatrix-GGUF

Text Generation • Updated Sep 29 • 436