Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Misc with no match

4-bit precision

8-bit precision

Models

6,689

Full-text search

Active filters: gguf-my-repo

ClaudioItaly/internlm2_5-7b-Q5_K_M-GGUF

notjjustnumbers/gemma-2b-Q4_K_M-GGUF

Updated Jul 7 • 11

Ransss/gemma2-9B-sunfall-v0.5.2-Q8_0-GGUF

Updated Jul 7 • 1

aifeifei798/gemma2-9B-sunfall-v0.5.2-Q5_K_M-GGUF

Updated Jul 7 • 8

QGH/Meta-Llama-3-8B-Q4_K_M-GGUF

Text Generation • Updated Jul 7

herrkobold/Wiedervereinigung-7b-dpo-laser-Q5_K_M-GGUF

Updated Jul 7 • 10

mmazeem/Mistral-7B-v0.3-Q4_K_M-GGUF

Updated Jul 7 • 5

herrkobold/TinyLlama-1.1B-Chat-v1.0-german-Q5_K_M-GGUF

Updated Jul 7 • 7

pedro0058/Llamma-3-aya-23-8B-Q4_K_M-GGUF

Updated Jul 7 • 5

mrgxxer/L3-8B-Stheno-v3.2-Q4_K_M-GGUF

Updated Jul 7 • 2

yoeldcd/leniachat-qwen2-1.5B-v0-Q4_K_M-GGUF

Updated Jul 8 • 4

zachaman/chpr3019-Q8_0-GGUF

Question Answering • Updated Jul 21 • 7

NewEden/LumiHathor-Q3_K_M-GGUF

Updated Jul 8 • 1

zhezhe/gemma-2-9b-it-Q4_K_M-GGUF

Text Generation • Updated Jul 8 • 14

tinyrao/Hermes-2-Pro-Llama-3-8B-Q4_K_M-GGUF

Updated Jul 8 • 12

saejoon/gemma-2-27b-it-Q4_K_M-GGUF

Text Generation • Updated Jul 8 • 2 • 2

Rivaidan/Smegmma-9B-v1-Q8_0-GGUF

Updated Jul 8 • 2

notjjustnumbers/madlad400-3b-mt-Q4_K_M-GGUF

Translation • Updated Jul 8 • 59

ethangoh/granite-8b-code-instruct-Q4_K_M-GGUF

Text Generation • Updated Jul 8 • 10

HenryyTwitchyfinger/L3-8B-Stheno-v3.2-Q4_K_M-GGUF

Updated Jul 8 • 14

utterlygreat/omost-llama-3-8b-IQ4_NL-GGUF

Updated Jul 8 • 3

teemperor/Phi-3-medium-128k-instruct-Q6_K-GGUF

Text Generation • Updated Jul 8 • 9

zhezhe/Gemma-2-9B-Chinese-Chat-Q4_K_M-GGUF

Text Generation • Updated Jul 8 • 11

NikolayKozloff/madlad400-3b-mt-Q8_0-GGUF

Translation • Updated Jul 8 • 13 • 1

NikolayKozloff/madlad400-10b-mt-Q8_0-GGUF

Translation • Updated Jul 8 • 46 • 2

NikolayKozloff/madlad400-10b-mt-Q6_K-GGUF

Translation • Updated Jul 8 • 21 • 1

Cran-May/internlm2_5-7b-chat-Q4_K_M-GGUF

Text Generation • Updated Jul 8 • 12

NikolayKozloff/sqt5-xl-Albanian-shqip-llama.cpp-compatible-Q8_0-GGUF

Updated Jul 8 • 13 • 1

dimcha/mxbai-embed-large-v1-Q4_K_M-GGUF

Feature Extraction • Updated Jul 8 • 16

bmi-labmedinfo/Igea-3B-v0.1-GGUF