Edit Models filters

Inference Endpoints

text-generation-inference

Mixture of Experts

AutoTrain Compatible

Carbon Emissions

8-bit precision

Other with no match

4-bit precision

text-embeddings-inference

Models

2,952

Full-text search

Active filters: llama-cpp

Tanvir1337/BanglaLLama-3-8b-BnWiki-Base-IQ4_XS-GGUF

Updated 6 days ago • 419

Hiddengamer007/Qwen2-0.5B-Instruct-Q4_K_M-GGUF

Text Generation • Updated 6 days ago • 15

oriyaho/Meta-Llama-3-8B-Instruct-Q8_0-GGUF

Text Generation • Updated 5 days ago • 781

Ammartatox/llamared8b64-Q4_K_M-GGUF

Updated 5 days ago • 472

win10/DeepSeek-Coder-V2-Lite-Instruct-Q6_K-GGUF

Updated 5 days ago • 3.5k

win10/DeepSeek-Coder-V2-Lite-Instruct-Q8_0-GGUF

Updated 5 days ago • 27

win10/Breeze-13B-32k-Instruct-v1_0-Q8_0-GGUF

Updated 2 days ago • 857

cptnemo-pata/Meta-Llama-3-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated 5 days ago • 20

icycodes/deepseek-coder-6.7b-base-Q8_0-GGUF

Updated 5 days ago • 2.02k

kairos1024/full-phi-3-oasis-Q5_K_M-GGUF

Updated 5 days ago • 597

Klevin/EMO-Ai-7b-Q2_K-GGUF

Updated 5 days ago • 478

Klevin/EMO-Ai-7b-Q8_0-GGUF

Updated 5 days ago • 1.38k

Fulcrum-AI/Ryze-Q4_K_M-GGUF

Updated 5 days ago • 1.11k

phillip888/Llama3-TAIDE-LX-8B-Chat-Alpha1-Q4_K_M-GGUF

Updated 5 days ago • 928

phillip888/Llama3-TAIDE-LX-8B-Chat-Alpha1-Q8_0-GGUF

Updated 5 days ago • 687

Tanvir1337/BanglaLLama-3-8b-BnWiki-Base-IQ3_XXS-GGUF

Updated 5 days ago • 1.01k

Tanvir1337/Mistral-v0.2-Nexus-Internal-Knowledge-Map-7B-Q5_K_M-GGUF

Text Generation • Updated 5 days ago • 419

Tanvir1337/Mistral-v0.2-Nexus-Internal-Knowledge-Map-7B-Q4_K_M-GGUF

Text Generation • Updated 5 days ago • 363

Tanvir1337/Mistral-v0.2-Nexus-Internal-Knowledge-Map-7B-Q6_K-GGUF

Text Generation • Updated 5 days ago • 468

Tanvir1337/Mistral-v0.2-Nexus-Internal-Knowledge-Map-7B-Q4_0-GGUF

Text Generation • Updated 5 days ago • 946

Tanvir1337/Mistral-v0.2-Nexus-Internal-Knowledge-Map-7B-IQ4_XS-GGUF

Text Generation • Updated 5 days ago • 343

Tanvir1337/Mistral-v0.2-Nexus-Internal-Knowledge-Map-7B-IQ3_XXS-GGUF

Text Generation • Updated 5 days ago • 522

icycodes/deepseek-coder-1.3b-base-Q8_0-GGUF

Updated 5 days ago • 248

Fulcrum-AI/Ryze-Q8_0-GGUF

Updated 5 days ago • 2.61k

jerrykim9981/no-robots-y34b-lora-Q8_0-GGUF

Updated 5 days ago • 20

nalf3in2/Llama-3-Instruct-8B-SPPO-Iter3-Q5_K_S-GGUF

Text Generation • Updated 5 days ago • 488

Trisert/Llama-3-Instruct-8B-SPPO-Iter3-Q5_K_S-GGUF

Text Generation • Updated 5 days ago • 548

PkmX/Llama-3-Instruct-8B-SPPO-Iter3-Q8_0-GGUF

Text Generation • Updated 5 days ago • 830

nalf3in2/Llama-3-Instruct-8B-SPPO-Iter3-Q6_K-GGUF

Text Generation • Updated 5 days ago • 649

Trisert/Llama-3-Instruct-8B-SPPO-Iter3-Q6_K-GGUF

Text Generation • Updated 5 days ago • 640