Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Misc with no match

4-bit precision

8-bit precision

Models

6,475

Full-text search

Active filters: gguf-my-repo

Triangle104/L3.1-Niitorm-8B-DPO-t0.0001-Q8_0-GGUF

Updated 6 days ago • 1 • 1

Triangle104/Qwen2.5-14B-Gutenberg-1e-Delta-Q4_0-GGUF

Updated 6 days ago • 10 • 1

Triangle104/Qwen2.5-14B-Gutenberg-1e-Delta-Q4_K_S-GGUF

Updated 6 days ago • 2 • 1

Triangle104/Qwen2.5-14B-Gutenberg-1e-Delta-Q4_K_M-GGUF

Updated 6 days ago • 2 • 1

Triangle104/Qwen2.5-14B-Gutenberg-1e-Delta-Q5_0-GGUF

Updated 6 days ago • 1 • 1

Triangle104/Qwen2.5-14B-Gutenberg-1e-Delta-Q5_K_S-GGUF

Updated 6 days ago • 2 • 1

Triangle104/Qwen2.5-14B-Gutenberg-1e-Delta-Q5_K_M-GGUF

Updated 6 days ago • 9 • 1

Triangle104/Qwen2.5-14B-Gutenberg-1e-Delta-Q6_K-GGUF

Updated 6 days ago • 5 • 1

Triangle104/Qwen2.5-14B-Gutenberg-1e-Delta-Q8_0-GGUF

Updated 6 days ago • 5 • 1

ClaudioItaly/Vikhr-Nemo-12B-Instruct-R-21-09-24-Q4_K_M-GGUF

Updated 5 days ago • 15 • 1

bunnycore/Qwen2.5-7B-TitanFusion-IQ4_XS-GGUF

Updated 5 days ago • 4 • 1

WSDW/Hermes-3-Llama-3.1-8B-Q4_K_M-GGUF

Updated 5 days ago • 347 • 1

NikolayKozloff/Vikhr-Nemo-12B-Instruct-R-21-09-24-Q8_0-GGUF

Updated 5 days ago • 11 • 1

Etherll/Qwen2.5-14b-web-Q6_K-GGUF

Updated 5 days ago • 12 • 1

NikolayKozloff/Vikhr-Llama3.1-8B-Instruct-R-21-09-24-Q8_0-GGUF

Updated 5 days ago • 27 • 1

Lambent/qwen2.5-reinstruct-alternate-lumen-14B-Q4_K_M-GGUF

Updated 5 days ago • 24 • 1

Elfrino/XwinXtended-20B-Q4_K_M-GGUF

Updated 2 days ago • 14 • 1

NikolayKozloff/EuroLLM-1.7B-Q8_0-GGUF

Updated 4 days ago • 385 • 1

Elfrino/XwinXtended-20B-Q8_0-GGUF

Updated 2 days ago • 12 • 1

samurai-zero/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated 3 days ago • 15 • 1

aashish1904/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • Updated 3 days ago • 8 • 1

jxtngx/Meta-Llama-3.2-1B-Q4_K_M-GGUF

Text Generation • Updated 3 days ago • 105 • 1

aashish1904/Llama-3.2-3B-Q4_K_M-GGUF

Text Generation • Updated 3 days ago • 57 • 1

polyverse/Llama-3.2-3B-Q5_K_M-GGUF

Text Generation • Updated 3 days ago • 22 • 1

Elfrino/LiquidCrystal_V3-20B-Q5_K_M-GGUF

Updated 3 days ago • 6 • 1

Solshine/Llama-3.2-1B-Q4_K_M-GGUF

Text Generation • Updated 3 days ago • 41 • 1

Solshine/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated 3 days ago • 31 • 1

Orion-zhen/Qwen2.5-7B-Instruct-Uncensored-Q5_K_M-GGUF

Text Generation • Updated 3 days ago • 34 • 1

NikolayKozloff/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated 2 days ago • 26 • 1

NikolayKozloff/Llama-3.2-1B-Q8_0-GGUF

Text Generation • Updated 2 days ago • 17 • 1