Edit Models filters

Inference status

Misc

4-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

8-bit precision

text-embeddings-inference

Mixture of Experts

Misc with no match

Carbon Emissions

Models

11,969

Full-text search

Active filters: bitsandbytes

saheedniyi/Llama3-8b-Naija_v1

Text Generation • Updated Jun 4 • 47 • 8

shaheerzk/text_to_sql

Text Generation • Updated 27 days ago • 157 • 1

rubenamtz0/llama-3-8b-lora-law2entity

Updated Jun 4 • 72 • 1

jihadzakki/idefics2-8b-vqarad-delta

Visual Question Answering • Updated Jun 13 • 29 • 3

unsloth/Qwen2-72B-Instruct-bnb-4bit

Text Generation • Updated Sep 3 • 82 • 7

nikravan/glm-4vq

Document Question Answering • Updated Jun 16 • 1.72k • 23

unclecode/folrence-2-large-4bit

Text Generation • Updated Jun 26 • 678 • 3

unsloth/gemma-2-9b-bnb-4bit

Text Generation • Updated Sep 3 • 31.7k • 24

lakkeo/stable-cypher-instruct-3b

Text Generation • Updated Oct 3 • 1.98k • 21

rootxhacker/CodeAstra-7B

Text Generation • Updated Jul 3 • 571 • 8

unsloth/gemma-2-9b-it-bnb-4bit

Text Generation • Updated Sep 3 • 28k • 20

unsloth/gemma-2-27b-it-bnb-4bit

Text Generation • Updated Sep 3 • 6.57k • 8

unsloth/Mistral-Nemo-Base-2407-bnb-4bit

Text Generation • Updated Sep 11 • 6.93k • 11

unsloth/Mistral-Nemo-Instruct-2407-bnb-4bit

Text Generation • Updated Sep 11 • 19.3k • 24

unsloth/Meta-Llama-3.1-8B-bnb-4bit

Text Generation • Updated Sep 3 • 313k • 80

unsloth/Meta-Llama-3.1-70B-bnb-4bit

Text Generation • Updated Sep 3 • 9.16k • 28

unsloth/Meta-Llama-3.1-70B-Instruct-bnb-4bit

Text Generation • Updated Sep 3 • 20.4k • 26

SoumilB7/L3_8B_Solana_Smart_Contract_Analyser

Text Generation • Updated Aug 22 • 7 • 1

openbmb/MiniCPM-V-2_6-int4

Image-Text-to-Text • Updated Sep 25 • 76.7k • 67

alicekyting/whisper-large-v3-4bit

Automatic Speech Recognition • Updated Aug 22 • 17 • 1

unsloth/Phi-3.5-mini-instruct-bnb-4bit

Text Generation • Updated Aug 20 • 73.7k • 10

alicekyting/Qwen2-Audio-7B-Instruct-4bit

Text2Text Generation • Updated Aug 22 • 179 • 3

pzc163/MiniCPMv2_6-prompt-generator

Updated Aug 24 • 984 • 35

ms57rd/Llama-3.1-8B-quantized-EEG-TimeLLM

Updated Aug 25 • 130 • 7

sayakpaul/flux.1-dev-nf4-with-bnb-integration

Updated Sep 1 • 160 • 12

unsloth/Reflection-Llama-3.1-70B-bnb-4bit

Text Generation • Updated Sep 8 • 52 • 15

bagwai/fine-tuned-gemma-7b-Hausa

Text Classification • Updated Sep 8 • 2

axolotl-quants/DeepSeek-V2.5-bnb-nf4-bf16

Updated Sep 12 • 58 • 1

nicoboss/Meta-Llama-3.1-405B-Instruct-Uncensored-Lora

Updated Sep 14 • 9 • 6

unsloth/Mistral-Small-Instruct-2409-bnb-4bit

Updated 9 days ago • 13.2k • 2