Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

8-bit precision

AutoTrain Compatible

text-generation-inference

4-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

8,924

Full-text search

Active filters: pruna-ai

PrunaAI/mosaicml-mpt-7b-chat-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 18 • 1

PrunaAI/mosaicml-mpt-7b-storywriter-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 42 • 1

PrunaAI/Writer-palmyra-small-bnb-8bit-smashed

Text Generation • Updated Aug 2, 2024 • 20 • 1

PrunaAI/Universal-NER-UniNER-7B-all-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 6 • 1

PrunaAI/codegemma-2b-GGUF-smashed

Updated Aug 2, 2024 • 435 • 2

PrunaAI/Phi-3-mini-4k-instruct-GGUF-Imatrix-smashed

Updated Aug 2, 2024 • 1.97k • 5

PrunaAI/google-gemma-2b-AWQ-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 49 • 1

PrunaAI/GreatCaptainNemo-ProLLaMA-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 22 • 1

PrunaAI/llmware-bling-phi-3-bnb-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 19 • 1

PrunaAI/Undi95-Llama-3-LewdPlay-8B-AWQ-4bit-smashed

Text Generation • Updated Aug 2, 2024 • 17 • 1

PrunaAI/Undi95-Llama-3-LewdPlay-8B-GGUF-smashed

Updated Jul 12, 2024 • 895 • 1

PrunaAI/yodayo-ai-nephra_v1.0-GGUF-smashed

Updated Jul 12, 2024 • 944 • 10

PrunaAI/BAAI-Bunny-v1_0-3B-HQQ-4bit-smashed

Text Generation • Updated Jul 13, 2024 • 15 • 1

PrunaAI/apple-OpenELM-270M-bnb-4bit-smashed

Text Generation • Updated Jul 13, 2024 • 118 • 1

PrunaAI/TheDrummer-Smegmma-9B-v1-HQQ-2bit-smashed

Updated Jul 21, 2024 • 9 • 1

PrunaAI/TheDrummer-Smegmma-9B-v1-bnb-8bit-smashed

Updated Jul 21, 2024 • 14 • 1

PrunaAI/BramVanroy-GEITje-7B-ultra-HQQ-1bit-smashed

Text Generation • Updated Jul 21, 2024 • 24 • 1

PrunaAI/Aratako-Oumuamua-7b-RP-bnb-4bit-smashed

Text Generation • Updated Jul 24, 2024 • 11 • 1

PrunaAI/ClosedCharacter-Peach-9B-8k-Roleplay-HQQ-1bit-smashed

Updated Aug 14, 2024 • 15 • 1

PrunaAI/IlyaGusev-gemma-2-2b-it-abliterated-bnb-4bit-smashed

Updated Aug 14, 2024 • 13 • 1

PrunaAI/OuteAI-Lite-Oute-1-65M-Instruct-QUANTO-int4bit-smashed

Updated Aug 15, 2024 • 12 • 1

PrunaAI/OuteAI-Lite-Oute-1-300M-Instruct-bnb-4bit-smashed

Updated Aug 16, 2024 • 10 • 1

PrunaAI/FLUX.1-dev-4bit

Updated Oct 30, 2024 • 10 • 3

PrunaAI/Writer-palmyra-base-bnb-4bit-smashed

Updated Aug 20, 2024 • 12 • 1

PrunaAI/suriya7-conversational-gpt-1-bnb-8bit-smashed

Updated Nov 18, 2024 • 15 • 1

PrunaAI/bunnycore-Llama-3.2-3B-RP-DeepThink-bnb-8bit-smashed

Updated Dec 27, 2024 • 19 • 1

PrunaAI/codenamics-Llama-3.2-3B-Instruct-Finance-RAG-bnb-8bit-smashed

Updated Dec 28, 2024 • 22 • 1

PrunaAI/Sakalti-tara-3.8B-bnb-8bit-smashed

Updated Jan 10 • 12 • 1

PrunaAI/djuna-Q2.5-Veltha-14B-0.5-AWQ-4bit-smashed

Updated Jan 21 • 22 • 1

PrunaAI/deepseek-ai-DeepSeek-R1-Distill-Qwen-1.5B-GGUF-smashed

Updated 9 days ago • 1.8k • 1