Edit Models filters

Inference Providers

HF Inference API

Misc

Inference Endpoints

4-bit precision

text-generation-inference

AutoTrain Compatible

Misc with no match

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

107

Full-text search

Active filters: llama.cpp

Atotti/RakutenAI-2.0-mini-instruct-gguf

Updated 4 days ago • 364 • 2

google/gemma-7b-it-GGUF

Updated Aug 14, 2024 • 14 • 41

google/gemma-2b-it-GGUF

Updated Jun 27, 2024 • 45 • 13

google/codegemma-2b-GGUF

Text Generation • Updated Jun 27, 2024 • 13 • 25

google/codegemma-7b-GGUF

Text Generation • Updated Jun 27, 2024 • 4 • 18

google/codegemma-7b-it-GGUF

Text Generation • Updated Jun 27, 2024 • 39 • 55

dumb-dev/flan-t5-xxl-gguf

Updated Oct 29, 2024 • 747 • 10

dwikitheduck/gen-sql-1-Q4_K_M-GGUF

Updated Nov 18, 2024 • 3 • 1

JackCloudman/QwQ-32B-Preview-jackterated-GGUF

Text Generation • Updated Dec 3, 2024 • 77 • 6

lianghsun/Llama-3.2-Taiwan-3B-Instruct-GGUF

Text Generation • Updated Jan 15 • 1.91k • 6

carsenk/llama3.2_3b_122824_uncensored

Text Generation • Updated Dec 31, 2024 • 336 • 2

carsenk/llama3.2_1b_2025_uncensored

Text Generation • Updated Jan 1 • 266 • 2

carsenk/llama3.2_1b_2025_uncensored_v2

Text Generation • Updated about 1 month ago • 1.22k • 4

mradermacher/llama3.2_3b_122824_uncensored-GGUF

Updated 26 days ago • 929 • 1

mradermacher/llama3.2_3b_122824_uncensored-i1-GGUF

Updated 8 days ago • 1.8k • 2

DavidLanz/Llama-3.2-Taiwan-3B-Instruct-GGUF

Text Generation • Updated 25 days ago • 92 • 1

nvjob/Drugban-7B-it-ru-gguf

Updated 22 days ago • 40 • 1

XeTute/Intellect_V0.1-1.8B-GGUF

Text Generation • Updated 12 days ago • 26 • 1

Novaciano/L3.2-2025_SuperUncensored_Q5-GGUF

Text Generation • Updated Jan 12 • 30 • 1

Novaciano/L3.2-1b-SuperUncensored_V2-IQ3_XXS-GGUF

Text Generation • Updated 27 days ago • 66 • 1

Mozzipa/ko_vicuna_7b_ggml_q4

Updated Apr 20, 2023 • 4

ManthanKulakarni/JQL_LLaMa_GGML

Text Generation • Updated Jun 26, 2023 • 2

mys/ggml_llava-v1.5-7b

Updated Oct 9, 2023 • 2.25k • 108

mys/ggml_llava-v1.5-13b

Updated Oct 10, 2023 • 1.1k • 53

mys/ggml_bakllava-1

Updated Oct 19, 2023 • 16.4k • 75

wasmedge/llama2

Text Generation • Updated Nov 11, 2023 • 79 • 8

alvarobartt/lince-zero-7b-GGUF

Text Generation • Updated Nov 1, 2023 • 22

vietgpt/dama-2-7b-chat-gguf

Text Generation • Updated Nov 17, 2023 • 32 • 1

FlexingD/yarn-mistral-7B-64k-instruct-alpaca-cleaned-GGUF

Updated Dec 4, 2023 • 185 • 5

jdluzen/Mistral-7B-Instruct-v0.2-GGUF

Updated Dec 24, 2023 • 12