Edit Models filters

Inference Endpoints

text-generation-inference

Mixture of Experts

AutoTrain Compatible

Carbon Emissions

8-bit precision

Other with no match

4-bit precision

text-embeddings-inference

Models

2,801

Full-text search

Active filters: llama-cpp

ssmits/Phi-3-medium-128k-instruct-Q8_0-GGUF

Text Generation • Updated May 21 • 124 • 3

Ransss/Noromaid-13B-0.4-DPO-Q8_0-GGUF

Updated May 21 • 284 • 1

xativive/L3-RP_io-Q5_K_M-GGUF

Updated May 23 • 48 • 1

mudler/llama-3-Stheno-Mahou-8B-Q4_K_M-GGUF

Updated May 26 • 557 • 2

Ransss/llama-3-Stheno-Mahou-8B-Q8_0-GGUF

Updated May 26 • 174 • 2

NovNovikov/SOLAR-10.7B-Instruct-v1.0-uncensored-Q6_K-GGUF

Updated May 27 • 205 • 2

NovNovikov/aya-23-8B-Q6_K-GGUF

Updated about 1 month ago • 165 • 1

Julia-Kovacs/SambaLingo-Hungarian-Base-70B-Q4_K_M-GGUF

Updated 30 days ago • 45 • 3

VlSav/saiga_phi3_medium_sft_m1_d2-Q4_K_M-GGUF

Updated 29 days ago • 42 • 1

Gapsar/Phi-3-mini-128k-instruct-abliterated-v3-Q4_K_M-GGUF

Text Generation • Updated 28 days ago • 276 • 1

waltervix/Llama-3-8B-Dolphin-Portuguese-v0.3-Q4_K_M-GGUF

Updated 28 days ago • 80 • 1

NikolayKozloff/DiscoLM_German_7b_v1-Q8_0-GGUF

Updated 24 days ago • 108 • 1

newsletter/Mixtral-8x7B-Instruct-v0.1-Q6_K-GGUF

Updated 24 days ago • 60 • 1

newsletter/dolphin-2.7-mixtral-8x7b-Q6_K-GGUF

Updated 24 days ago • 65 • 1

Ransss/L3-8B-Stheno-v3.2-Q8_0-GGUF

Updated 24 days ago • 64 • 1

NikolayKozloff/Llama-2-7b-Ukrainian-Q8_0-GGUF

Text Generation • Updated 24 days ago • 37 • 1

v8karlo/UNCENSORED-TinyDolphin-2.8.1-1.1b-Q4_K_M-GGUF

Updated 23 days ago • 174 • 3

v8karlo/UNCENSORED-Phi-3-mini-4k-geminified-Q4_K_M-GGUF

Text Generation • Updated 23 days ago • 354 • 2

v8karlo/UNCENSORED-TinyDolphin-3x-MoE-Q4_K_M-GGUF

Updated 23 days ago • 118 • 1

v8karlo/UNCENSORED-TinyLlama-1.1B-intermediate-step-1431k-3T-Q4_K_M-GGUF

Updated 23 days ago • 15 • 1

SteelQuants/L3-Aethora-15B-Q4_K_M-GGUF

Updated 23 days ago • 308 • 3

v8karlo/UNCENSORED-TinyDolphin-2.8-1.1b-Q5_K_M-GGUF

Updated 23 days ago • 16 • 2

v8karlo/UNCENSORED-TinyLlama-1.1B-intermediate-step-1431k-3T-Q5_K_M-GGUF

Updated 23 days ago • 119 • 1

NikolayKozloff/Qwen2-7B-Q8_0-GGUF

Text Generation • Updated 23 days ago • 160 • 2

NikolayKozloff/Qwen2-7B-Instruct-Q4_K_M-GGUF

Text Generation • Updated 23 days ago • 219 • 3

NikolayKozloff/Qwen2-7B-Instruct-Q5_K_S-GGUF

Text Generation • Updated 23 days ago • 45 • 1

NikolayKozloff/Qwen2-7B-Instruct-Q4_0-GGUF

Text Generation • Updated 23 days ago • 155 • 1

NikolayKozloff/Qwen2-7B-Q6_K-GGUF

Text Generation • Updated 23 days ago • 50 • 1

NikolayKozloff/Qwen2-7B-Q5_K_M-GGUF

Text Generation • Updated 23 days ago • 61 • 1

NikolayKozloff/Qwen2-7B-Q5_K_S-GGUF

Text Generation • Updated 23 days ago • 36 • 1