Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

4-bit precision

Misc with no match

8-bit precision

Models

13,746

Full-text search

Active filters: gguf-my-repo

Triangle104/Cydonia-v1.3-Magnum-v4-22B-Q5_K_M-GGUF

Updated Nov 26, 2024 • 17 • 1

cnmoro/Tucano-2b4-Instruct-Q4_K_M-GGUF

Text Generation • Updated Nov 30, 2024 • 13 • 1

Triangle104/OLMo-2-1124-13B-Q6_K-GGUF

Updated Dec 1, 2024 • 6 • 2

Lyte/LLaMA-O1-Supervised-1129-Q4_K_M-GGUF

Updated Dec 2, 2024 • 27 • 4

YATIDE/gemma-2-9b-it-Q8_0-GGUF

Text Generation • Updated Dec 2, 2024 • 1.35k • 1

matrixportal/Llama-3.2-3B-Instruct-uncensored-Q4_K_M-GGUF

Updated Dec 3, 2024 • 51 • 1

Triangle104/Mistral-Nemo-12B-ArliAI-RPMax-v1.3-Q4_K_M-GGUF

Updated Dec 6, 2024 • 180 • 1

ehristoforu/Llama-TI-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Dec 8, 2024 • 11 • 2

puettmann/LlaMaestra-3.2-1B-Translation-Q8_0-GGUF

Translation • Updated Dec 8, 2024 • 53 • 1

SYNERDATA/SYNERDATA-Hermes-3-LLaMA-3.1-8b-Q8_0.GGUF

Updated Dec 9, 2024 • 12 • 1

aovchinnikov/T-lite-it-1.0-Q4_K_M-GGUF

Updated Dec 11, 2024 • 180 • 6

Triangle104/Hermes-3-Llama-3.2-3B-Q4_K_S-GGUF

Updated Dec 11, 2024 • 16 • 1

Triangle104/Hermes-3-Llama-3.2-3B-Q4_K_M-GGUF

Updated Dec 11, 2024 • 21 • 1

Triangle104/Hermes-3-Llama-3.2-3B-Q5_K_S-GGUF

Updated Dec 11, 2024 • 7 • 1

Triangle104/Hermes-3-Llama-3.2-3B-Q5_K_M-GGUF

Updated Dec 12, 2024 • 11 • 1

Triangle104/Hermes-3-Llama-3.2-3B-Q6_K-GGUF

Updated Dec 12, 2024 • 16 • 1

Triangle104/Hermes-3-Llama-3.2-3B-Q8_0-GGUF

Updated Dec 12, 2024 • 9 • 1

NikolayKozloff/Hermes-3-Llama-3.2-3B-Q8_0-GGUF

Updated Dec 12, 2024 • 14 • 2

Ransss/Nemo-12b-Humanize-KTO-Experimental-Latest-Q8_0-GGUF

Updated Dec 19, 2024 • 102 • 1

ggml-org/jina-embeddings-v2-base-en-Q8_0-GGUF

Feature Extraction • Updated Dec 12, 2024 • 50 • 1

ggml-org/jina-embeddings-v2-base-code-Q8_0-GGUF

Feature Extraction • Updated Dec 12, 2024 • 30 • 1

G17c21ds/Qwen2.5-14B-Instruct-Uncensored-Q8_0-GGUF

Updated Dec 13, 2024 • 2k • 5

bunnycore/Llama-3.2-1B-Creative-RP-Q8_0-GGUF

Updated Dec 13, 2024 • 27 • 1

NikolayKozloff/FuseChat-Llama-3.2-1B-Instruct-Q8_0-GGUF

Updated Dec 13, 2024 • 7 • 2

jacobcarajo/Ministral-8B-Instruct-2410-Q5_K_M-GGUF

Updated Dec 14, 2024 • 1.03k • 1

kainatq/Kpt-7b-v-0.2-Q6_K-GGUF

Updated Dec 15, 2024 • 7 • 1

kainatq/KPT-7b-v0.2_stock-Q6_K-GGUF

Updated Dec 16, 2024 • 5 • 1

kainatq/Kpt-7b_test-Q6_K-GGUF

Updated Dec 16, 2024 • 9 • 1

matrixportal/Llama-3-Instruct-8B-SimPO-v0.2-Q4_K_M-GGUF

Updated Dec 16, 2024 • 22 • 1

kainatq/KPT-7b-v0.3-Q4_K_M-GGUF

Updated Dec 16, 2024 • 5 • 1