Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

8-bit precision

AutoTrain Compatible

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

13,318

Full-text search

Active filters: imatrix

Lewdiculous/llama-3-Stheno-Mahou-8B-GGUF-IQ-Imatrix

Updated Dec 12, 2024 • 829 • 23

qwp4w3hyb/Codestral-22B-v0.1-iMat-GGUF

Text Generation • Updated Jun 1, 2024 • 192 • 3

Lewdiculous/Fimbulvetr-11B-v2-GGUF-IQ-Imatrix

Updated Oct 2, 2024 • 1.47k • 25

Lewdiculous/L3-8B-Stheno-v3.2-GGUF-IQ-Imatrix

Updated Feb 2 • 16.9k • 154

Qwen/Qwen2-72B-Instruct-GGUF

Text Generation • Updated Jun 17, 2024 • 700 • 31

Lewdiculous/Hathor-L3-8B-v.01-GGUF-IQ-Imatrix

Updated Jun 7, 2024 • 104 • 8

mradermacher/Llama-3-Luminurse-v0.2-OAS-8B-i1-GGUF

Updated Feb 7 • 911 • 1

bartowski/Codestral-RAG-19B-Pruned-GGUF

Text Generation • Updated Jun 10, 2024 • 256 • 1

mradermacher/Writing_Partner_Mistral_7B-i1-GGUF

Updated Aug 2, 2024 • 77 • 1

Lewdiculous/llama3-8B-aifeifei-1.3-GGUF-IQ-Imatrix

Updated Jun 12, 2024 • 1.41k • 4

bartowski/L3-70B-Euryale-v2.1-GGUF

Text Generation • Updated Jun 13, 2024 • 214 • 15

DavidAU/Psyonic-Cetacean-Ultra-Quality-20b-GGUF-imat-plus2

Text Generation • Updated Nov 14, 2024 • 3.31k • 7

mradermacher/Hathor_RP-v.01-L3-8B-i1-GGUF

Updated Dec 16, 2024 • 426 • 3

mradermacher/Eurstoria-106B-i1-GGUF

Updated 22 days ago • 361 • 1

bartowski/DeepSeek-Coder-V2-Lite-Instruct-GGUF

Text Generation • Updated Jun 20, 2024 • 13.8k • 100

CISCai/DeepSeek-Coder-V2-Lite-Instruct-SOTA-GGUF

Updated Jun 17, 2024 • 536 • 2

mradermacher/DeepSeek-Coder-V2-Lite-Base-i1-GGUF

Updated Aug 2, 2024 • 247 • 2

mradermacher/SuperQwen2-7B-Chat-i1-GGUF

Updated Aug 2, 2024 • 145 • 1

mradermacher/Tess-v2.5-Phi-3-medium-128k-14B-i1-GGUF

Updated Feb 21 • 205 • 3

bartowski/magnum-72b-v1-GGUF

Text Generation • Updated Jun 23, 2024 • 247 • 11

legraphista/glm-4-9b-chat-IMat-GGUF

Text Generation • Updated Jun 20, 2024 • 1.66k • 5

bartowski/DeepSeek-Coder-V2-Instruct-GGUF

Text Generation • Updated Jun 23, 2024 • 1.08k • 31

legraphista/RoLlama3-8b-Instruct-IMat-GGUF

Text Generation • Updated Jun 23, 2024 • 1.15k • 3

DavidAU/Command-R-01-Ultra-NEO-V1-35B-IMATRIX-GGUF

Text Generation • Updated Nov 14, 2024 • 2.85k • 17

bartowski/dolphin-2.9.3-Yi-1.5-34B-32k-GGUF

Text Generation • Updated Jun 24, 2024 • 771 • 24

mradermacher/Hathor_Fractionate-L3-8B-v.05-i1-GGUF

Updated Feb 5 • 71 • 1

mradermacher/Qwen2-7B-Multilingual-RP-i1-GGUF

Updated Aug 2, 2024 • 367 • 2

DavidAU/TinyLlama-1.1B-Chat-v1.0-Ultra-NEO-V1-Imatrix-GGUF

Text Generation • Updated Nov 14, 2024 • 3.56k • 1

mradermacher/L3-8B-Lunaris-v1-i1-GGUF

Updated Aug 2, 2024 • 1.98k • 14

Undi95/MG-FinalMix-72B-GGUF

Updated Jun 26, 2024 • 12 • 2