Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

8-bit precision

Misc with no match

4-bit precision

Models

9,117

Full-text search

Active filters: llama-cpp

NikolayKozloff/Mistral-Nemo-Instruct-bellman-12b-Q6_K-GGUF

Updated about 1 month ago • 34 • 1

NikolayKozloff/Mistral-Nemo-Instruct-bellman-12b-Q5_K_M-GGUF

Updated about 1 month ago • 25 • 1

NikolayKozloff/Mistral-Nemo-Instruct-bellman-12b-Q5_K_S-GGUF

Updated about 1 month ago • 26 • 1

harkov000/hermes-stheno-8B-v0.1-Q5_K_M-GGUF

Updated 30 days ago • 41 • 1

NikolayKozloff/FastApply-7B-v1.0-Q6_K-GGUF

Updated 30 days ago • 27 • 1

NikolayKozloff/FastApply-1.5B-v1.0-Q6_K-GGUF

Updated 30 days ago • 35 • 1

ZeroXClem/L3.1-Pneuma-Allades-8B-Q4_K_M-GGUF

Text Generation • Updated 30 days ago • 38 • 1

ZeroXClem/L3.1-Pneuma-Allades-8B-Q4_0-GGUF

Text Generation • Updated 30 days ago • 49 • 1

ZeroXClem/Llama3.1-8B-Titanium-Forge-Q8_0-GGUF

Updated 29 days ago • 38 • 1

ZeroXClem/Llama3.1-8B-Titanium-Forge-Q6_K-GGUF

Updated 29 days ago • 27 • 1

ZeroXClem/Llama3.1-8B-Titanium-Forge-Q5_K_M-GGUF

Updated 29 days ago • 24 • 1

ZeroXClem/Llama3.1-8B-Titanium-Forge-Q5_K_S-GGUF

Updated 29 days ago • 26 • 1

ZeroXClem/Llama3.1-8B-Titanium-Forge-Q5_0-GGUF

Updated 29 days ago • 34 • 1

ZeroXClem/Llama3.1-8B-Titanium-Forge-Q4_K_M-GGUF

Updated 29 days ago • 29 • 1

ZeroXClem/Llama3.1-8B-Titanium-Forge-Q4_K_S-GGUF

Updated 29 days ago • 33 • 1

ZeroXClem/Llama3.1-8B-Titanium-Forge-Q4_0-GGUF

Updated 29 days ago • 86 • 1

win10/aya-expanse-32b-Q5_K_M-GGUF

Updated 29 days ago • 131 • 1

win10/aya-expanse-32b-Q4_K_M-GGUF

Updated 29 days ago • 669 • 1

NikolayKozloff/aya-expanse-8b-Q8_0-GGUF

Updated 29 days ago • 103 • 1

Triangle104/DigitalSoul-4B-Q6_K-GGUF

Updated 29 days ago • 26 • 1

ZeroXClem/Llama3.1-DarkStorm-Aspire-8B-Q8_0-GGUF

Text Generation • Updated 29 days ago • 80 • 2

ZeroXClem/Llama3.1-DarkStorm-Aspire-8B-Q6_K-GGUF

Text Generation • Updated 29 days ago • 50 • 2

ZeroXClem/Llama3.1-DarkStorm-Aspire-8B-Q5_K_M-GGUF

Text Generation • Updated 29 days ago • 34 • 2

ZeroXClem/Llama3.1-DarkStorm-Aspire-8B-Q5_K_S-GGUF

Text Generation • Updated 29 days ago • 33 • 2

ZeroXClem/Llama3.1-DarkStorm-Aspire-8B-Q5_0-GGUF

Text Generation • Updated 29 days ago • 59 • 2

ZeroXClem/Llama3.1-DarkStorm-Aspire-8B-Q4_K_M-GGUF

Text Generation • Updated 29 days ago • 49 • 2

ZeroXClem/Llama3.1-DarkStorm-Aspire-8B-Q4_K_S-GGUF

Text Generation • Updated 28 days ago • 33 • 2

bunnycore/Llama-3.2-3B-Prodigy-IQ4_NL-GGUF

Updated 28 days ago • 43 • 1

bunnycore/Llama-3.2-3B-Sci-Think-IQ4_NL-GGUF

Updated 28 days ago • 44 • 1

zelk12/MT3-Gen1-gemma-2-9B-Q6_K-GGUF

Text Generation • Updated 28 days ago • 89 • 1