Edit Models filters

Inference Endpoints

text-generation-inference

Mixture of Experts

AutoTrain Compatible

Carbon Emissions

Other with no match

4-bit precision

text-embeddings-inference

8-bit precision

Models

2,670

Full-text search

Active filters: gguf-my-repo

Bllossom/llama-3-Korean-Bllossom-70B-gguf-Q4_K_M

Updated May 14 • 816 • 34

MLP-KTLim/llama-3-Korean-Bllossom-8B-gguf-Q4_K_M

Updated May 14 • 2.38k • 29

zhaijunxiao/omost-llama-3-8b-Q8_0-GGUF

Updated 14 days ago • 497 • 3

sunzx0810/gte-Qwen2-7B-instruct-Q5_K_M-GGUF

Sentence Similarity • Updated 1 day ago • 690 • 3

kpkiosk66/LLaMa-3-Stheno-v3.2-15B-Q4_K_S-GGUF

Updated 18 days ago • 160 • 3

Oblivionus/LLaMa-3-Stheno-v3.2-15B-Q6_K-GGUF

Updated 16 days ago • 280 • 4

raincandy-u/TinyStories-656K-Q8_0-GGUF

Updated 14 days ago • 6 • 2

Klevin/J.A.R.V.I.S-v2.0-Q4_K_M-GGUF

Updated 6 days ago • 435 • 2

Klevin/J.A.R.V.I.S-v2.0-Q4_0-GGUF

Updated 6 days ago • 875 • 2

NikolayKozloff/bella-1-8b-Q8_0-GGUF

Text Generation • Updated 2 days ago • 792 • 2

NikolayKozloff/MKLLM-7B-Translate-Q8_0-GGUF

Updated 2 days ago • 682 • 2

NikolayKozloff/Llama-3SOME-8B-v2-Q5_K_S-GGUF

Updated 5 days ago • 540 • 2

DavidAU/MPT-7b-WizardLM_Uncensored-Storywriter-Merge-Q6_K-GGUF

Updated Apr 11 • 239 • 4

DavidAU/MPT-7b-WizardLM_Uncensored-Storywriter-Merge-Q4_K_M-GGUF

Updated Apr 12 • 153 • 2

DavidAU/Lelantos-Noro-Lamia-Maid-7B-Slerp-Q6_K-GGUF

Updated Apr 12 • 22 • 1

DavidAU/EEM-Noro-Lamia-Maid-7B-Slerp-Q6_K-GGUF

Updated Apr 12 • 24 • 1

DavidAU/EE-Silicon-Maid-7B-Q6_K-GGUF

Updated Apr 12 • 20 • 1

DavidAU/SOLAR_Uncensored_Luna_10.7B-Q6_K-GGUF

Updated Apr 13 • 28 • 1

DavidAU/SOLAR_Uncensored_LimaRP_10.7B-Q6_K-GGUF

Updated Apr 13 • 34 • 1

DavidAU/solarized-18B-dpo-Q6_K-GGUF

Updated Apr 13 • 15 • 1

DavidAU/solarized-13B-dpo-Q6_K-GGUF

Updated Apr 13 • 19 • 1

DavidAU/Noromaid-10.7B-0.4-DPO-Q6_K-GGUF

Text Generation • Updated Apr 14 • 33 • 1

boxomcfoxo/YiffyEstopianMaid-13B-GGUF

Updated Apr 19 • 214 • 2

DavidAU/Chat-Stheno-L2-13B-Q6_K-GGUF

Updated Apr 15 • 16 • 1

DavidAU/Stheno-1.8-L2-13B-Q6_K-GGUF

Updated Apr 15 • 18 • 1

DavidAU/Stheno-Inverted-1.2-L2-13B-Q6_K-GGUF

Updated Apr 15 • 17 • 1

DavidAU/Stheno-L2-13B-Q6_K-GGUF

Updated Apr 15 • 24 • 1

DavidAU/Stheno-v2-Delta-fp16-Q6_K-GGUF

Updated Apr 15 • 18 • 1

DavidAU/Kunoichi-DPO-v2-Instruct-32k-7B-Q6_K-GGUF

Updated Apr 16 • 20 • 1

DavidAU/SthenoWriter-L2-13B-Q6_K-GGUF

Updated Apr 16 • 18 • 1