Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Misc with no match

4-bit precision

8-bit precision

Models

6,699

Full-text search

Active filters: gguf-my-repo

carterprince/google-gemma-2-27b-it-ortho-Q4_K_S-GGUF

Updated Jul 8 • 7 • 1

avemio-digital/arcee-spark_entity_Model_2500_steps_merge-Q4_K_M-GGUF

mrmage/Qwen2-0.5B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Jul 8 • 3 • 1

mrmage/Qwen2-0.5B-Instruct-Q3_K_M-GGUF

Text Generation • Updated Jul 8 • 2

ZappY-AI/medllama3-v20-Q4_K_M-GGUF

Updated Jul 8 • 8

pedro0058/mistral-hermes-merge-7B-Q4_K_M-GGUF

Updated Jul 8 • 2

martintomov/gemma-2-27b-it-Q8_0-GGUF

Text Generation • Updated Jul 8 • 4

jorismathijssen/t5-base-Q4_K_M-GGUF

Translation • Updated Jul 8 • 14

faceradix/Daredevil-8B-abliterated-Q4_K_M-GGUF

Updated Jul 8 • 14

martintomov/gemma-2-9b-it-Q8_0-GGUF

Text Generation • Updated Jul 8 • 1

Nialixus/Meta-Llama-3-8B-Q4_K_M-GGUF

Text Generation • Updated Jul 8 • 2

saejoon/SOLAR-10.7B-Instruct-v1.0-Q4_K_M-GGUF

Updated Jul 9 • 2

aifeifei798/Meta-Llama-3-8B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Jul 9 • 4

NikolayKozloff/bella-2-8b-Q8_0-GGUF

Text Generation • Updated Jul 9 • 4 • 1

NikolayKozloff/Storm-7B-Q8_0-GGUF

Updated Jul 9 • 5 • 2

NikolayKozloff/Einstein-v7-Qwen2-7B-Q8_0-GGUF

Updated Jul 9 • 2 • 1

jeiku/qwen2-7b-magpie300k_filtered_epoch2-Q4_K_M-GGUF

Updated Jul 9 • 1

zhentaoyu/Llama-2-13b-chat-hf-Q4_0-GGUF

Text Generation • Updated Jul 9 • 32

yoeldcd/leniachat-qwen2-1.5B-v0-Q4_0-GGUF

Updated Jul 9 • 19

dspasyuk/Meta-Llama-3-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Jul 9 • 3

DreadPoor/ONeil-model_stock-8B-Q4_K_M-GGUF

dspasyuk/Meta-Llama-3-8B-Instruct-Q5_K_S-GGUF

Text Generation • Updated Jul 9 • 7

timmyd69/Lama2-7b-chat-hf-oslo-merged-model-Q2_K-GGUF

Updated Jul 9 • 20

fanrey/Meta-Llama-3-8B-Q4_K_M-GGUF

Text Generation • Updated Jul 9 • 2

martintomov/falcon-7b-instruct-Q8_0-GGUF

Updated Jul 9 • 11

fernandovmacedo/portuguese-Phi3-Tom-Cat-128k-instruct-Q4_K_S-GGUF

Text Generation • Updated Jul 9 • 2

apoleo/Meta-Llama-3-8B-Q4_K_M-GGUF

Text Generation • Updated Jul 9

NikolayKozloff/SeaLLM3-7B-Chat-Q8_0-GGUF

Updated Jul 9 • 6 • 1

NikolayKozloff/GreekLlama-1.1B-it-Q8_0-GGUF

Text Generation • Updated Jul 9 • 5 • 1

NikolayKozloff/GreekLlama-1.1B-base-Q8_0-GGUF

Updated Jul 9 • 8 • 1