Edit Models filters

Inference status

Misc

8-bit precision

4-bit precision

Inference Endpoints

Mixture of Experts

AutoTrain Compatible

Misc with no match

text-generation-inference

text-embeddings-inference

Carbon Emissions

Models

20

Full-text search

Active filters: 16-bit

prithivMLmods/Llama-3.2-3B-GGUF

Text Generation • Updated 3 days ago • 785 • 8

prithivMLmods/Qwen2.5-Coder-1.5B-Instruct-GGUF

Text Generation • Updated 3 days ago • 379 • 8

prithivMLmods/Qwen2.5-Coder-3B-Instruct-GGUF

Text Generation • Updated 8 days ago • 418 • 8

prithivMLmods/Qwen2.5-Coder-7B-Instruct-GGUF

Text Generation • Updated 10 days ago • 472 • 8

prithivMLmods/Qwen2.5-Coder-7B-GGUF

Text Generation • Updated 10 days ago • 308 • 8

prithivMLmods/Qwen2.5-Coder-3B-GGUF

Text Generation • Updated 10 days ago • 460 • 8

prithivMLmods/Qwen2.5-Coder-1.5B-GGUF

Text Generation • Updated 10 days ago • 365 • 8

MaziyarPanahi/Mixtral-8x22B-Instruct-v0.1-GGUF

Text Generation • Updated Apr 18 • 66.7k • 32

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated May 14 • 130k • 164

MaziyarPanahi/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • Updated Apr 23 • 1.97M • 77

MaziyarPanahi/Mixtral-8x22B-v0.1-GGUF

Text Generation • Updated Apr 15 • 65.2k • 73

Green-Sky/bark-ggml

Updated Apr 22 • 6

ChristianAzinn/mixtral-8x22b-v0.1-imatrix

Text Generation • Updated Apr 12 • 137

MaziyarPanahi/zephyr-orpo-141b-A35b-v0.1-GGUF

Text Generation • Updated Apr 12 • 64.2k • 28

impactframes/Mixtral-8x22B-Instruct-v0.1-GGUF

Text Generation • Updated Apr 18 • 104 • 1

jburmeister/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated May 30 • 111

MaziyarPanahi/calme-2.1-qwen2-72b-GGUF

Text Generation • Updated Aug 2 • 1.42k • 12

ruslanmv/instructLab-granite-7b-lab-text-to-sql

Updated Jul 19 • 74

MaziyarPanahi/calme-2.2-qwen2-72b-GGUF

Text Generation • Updated Aug 6 • 1.85k • 2

jburmeister/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • Updated Aug 22 • 103