Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

8-bit precision

Misc with no match

4-bit precision

Models

9,347

Full-text search

Active filters: llama-cpp

saurabhraj115/Meta-Llama-3-8B-Instruct-Q4_K_S-GGUF

Text Generation • Updated Jun 28 • 12

bunnycore/SparrowMind-8B-Q5_K_M-GGUF

Updated Jun 28 • 4

BLURPLETESTS/L3-15B-Stheno-v3.3-32K-exp-Q5_K_M-GGUF

Updated Jun 28 • 6

BLURPLETESTS/LLaMa-3-Stheno-v3.2-15B-Q5_K_M-GGUF

Updated Jun 28 • 6

Goekdeniz-Guelmez/J.O.S.I.E.v4o-8b-stage1-beta2.2-Q4_K_S-GGUF

Updated Jun 28 • 3 • 1

gate369/Bitnet-Mistral.0.2-v6.8-Q8_0-GGUF

Updated Jun 28 • 292

YorkieOH10/Qwen2-7B-Multilingual-RP-Q8_0-GGUF

Updated Jun 28 • 14 • 2

Pekarnick/e5-large-v2-Q4_K_M-GGUF

Sentence Similarity • Updated Jun 28 • 8

YorkieOH10/Qwen2-7B-Multilingual-RP-Q5_K_M-GGUF

Updated Jun 28 • 6

YorkieOH10/Qwen2-7B-Multilingual-RP-Q4_K_M-GGUF

Updated Jun 28 • 1.11k • 1

Leths/gpt2-Q4_K_M-GGUF

Updated Jun 28 • 8

Kurgan1138/L3-8B-Instruct-Abliterated-DWP-Q5_K_M-GGUF

Updated Jun 28 • 5

NikolayKozloff/L3-8B-Lunaris-v1-Q4_0-GGUF

Updated Jun 28 • 40 • 1

NikolayKozloff/L3-8B-Lunaris-v1-Q5_0-GGUF

Updated Jun 28 • 2 • 1

NikolayKozloff/L3-8B-Lunaris-v1-IQ4_NL-GGUF

Updated Jun 28 • 5 • 1

fusi0n/llm-compiler-13b-ftd-Q6_K-GGUF

Updated Jun 28 • 2

Kurgan1138/L3-8B-Stheno-Horny-v3.3-32K-Q5_K_M-GGUF

Updated Jun 28 • 52

naverick/L3-8B-Lunaris-v1-Q4_K_M-GGUF

Updated Jun 28 • 4.42k • 2

skratos115/DeepSeek-Coder-V2-Lite-Instruct-Q4_K_M-GGUF

Updated Jun 28 • 7

markhneedham/dolphin-2.9-llama3-8b-Q2_K-GGUF

Updated Jun 28 • 40

jeiku/qwen2base-Q4_K_M-GGUF

Updated Jun 28 • 5

AaronVB/L3-8B-Lunaris-v1-Q5_K_M-GGUF

Updated about 1 month ago • 46

jeiku/Very_Berry_Qwen2_7B-Q4_K_M-GGUF

BenevolenceMessiah/gemma-2-9b-it-Q8_0-GGUF

Text Generation • Updated Jun 29 • 5

Azazelle/L3-Persephone-8B-v1.0-Q8_0-GGUF

Updated Jun 29 • 2

cansa/Turkish-Llama-8b-Instruct-v0.1-Q5_K_S-GGUF

Text Generation • Updated Jun 29 • 16

cansa/Turkish-Llama-8b-Instruct-v0.1-Q8_0-GGUF

Text Generation • Updated Jun 29 • 6

NikolayKozloff/Turkish-Llama-8b-Instruct-v0.1-IQ4_NL-GGUF

Text Generation • Updated Jun 29 • 6 • 1

NikolayKozloff/Trendyol-LLM-7b-chat-v1.8-Q4_0-GGUF

Text Generation • Updated Jun 29 • 15 • 1

NikolayKozloff/Trendyol-LLM-7b-chat-v1.8-Q5_0-GGUF

Text Generation • Updated Jun 29 • 3 • 1