Edit Models filters

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Mixture of Experts

Other with no match

Carbon Emissions

Models

6,065

Full-text search

Active filters: bitsandbytes

CohereForAI/c4ai-command-r-plus-4bit

Text Generation • Updated Apr 5 • 2.77k • 208

THUDM/cogvlm2-llama3-chat-19B-int4

Text Generation • Updated May 24 • 5.1k • 12

OpenGVLab/InternVL-Chat-V1-5-Int8

Visual Question Answering • Updated 28 days ago • 12.5k • 58

openbmb/MiniCPM-Llama3-V-2_5-int4

Visual Question Answering • Updated 20 days ago • 20.6k • 50

AlyBendo/DPO-DoubleQuant-MCQA-TrueMixin

Text2Text Generation • Updated 15 days ago • 9 • 2

Duxiaoman-DI/XuanYuan-70B-Chat-8bit

Text Generation • Updated Nov 2, 2023 • 6 • 3

Undi95/Llama2-13B-no_robots-alpaca-lora

Text Generation • Updated Nov 17, 2023 • 2.02k • 9

Undi95/Leyley-13B-Lora

Text Generation • Updated Nov 26, 2023 • 2 • 4

unsloth/llama-2-7b-bnb-4bit

Text Generation • Updated Mar 22 • 12k • 6

dvijay/mistral-alpaca2k-3e-lora

Text Generation • Updated Dec 16, 2023 • 4 • 1

Neurai/NeuraLlama7b

Text Generation • Updated Jan 1 • 68 • 2

pandasai/bamboo-llm

Text Generation • Updated Jan 17 • 81 • 8

parlance-labs/hc-mistral-alpaca

Updated Feb 14 • 313 • 13

erfanvaredi/jais-7b-chat

Text Generation • Updated Feb 22 • 1.24k • 2

robinsmits/Mistral-Instruct-7B-v0.2-ChatAlpacaV2-4bit

Text Generation • Updated Feb 13 • 1.51k • 5

Tann-dev/sex-chat-dirty-girlfriend

Text Generation • Updated Feb 17 • 3.9k • 11

unsloth/gemma-7b-it-bnb-4bit

Text Generation • Updated Apr 18 • 6.76k • 13

Shashwath01/Idefic_medical_VQA_merged_4bit

Updated 2 days ago • 397 • 3

dyang415/mixtral-lora-v0

Updated Feb 28 • 1

Animesh001/mistral-7b-instruct-4bit

Text Generation • Updated Mar 12 • 2 • 1

CohereForAI/c4ai-command-r-v01-4bit

Text Generation • Updated Apr 4 • 2.08k • 162

PrunaAI/mosaicml-mpt-7b-storywriter-bnb-8bit-smashed

Text Generation • Updated Apr 11 • 3 • 1

Weyaxi/Einstein-v4-Qwen-1.5-32B-adapter-checkpoints

Text Generation • Updated 8 days ago • 1 • 1

DevsDoCode/LLama-3-8b-Uncensored-4bit

Text Generation • Updated Apr 25 • 605 • 19

Rorical/0-roleplay

Text Generation • Updated 15 days ago • 871 • 4

RichardErkhov/EleutherAI_-_polyglot-ko-12.8b-4bits

Text Generation • Updated Apr 23 • 2 • 1

screevoai/llama3-70b-instruct-4bit

Text Generation • Updated Apr 23 • 672 • 1

leliuga/Phi-3-mini-4k-instruct-bnb-4bit

Text Generation • Updated 18 days ago • 254 • 2

Adityyaa/Mistral-7b_finetuned_mental_health

Text Generation • Updated Apr 24 • 18 • 3

santoshsto/mistral-4x7b-codegen-MOE-4bit

Text Generation • Updated Apr 24 • 3 • 1