Edit Models filters

Inference status

Misc

4-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

8-bit precision

text-embeddings-inference

Mixture of Experts

Misc with no match

Carbon Emissions

Models

12,111

Full-text search

Active filters: bitsandbytes

RichardErkhov/EleutherAI_-_gpt-neo-2.7B-8bits

Text Generation • Updated Apr 23 • 6

RichardErkhov/GroNLP_-_gpt2-small-dutch-4bits

Text Generation • Updated Apr 17 • 7

RichardErkhov/GroNLP_-_gpt2-small-dutch-8bits

Text Generation • Updated Apr 17 • 15

lilyyellow/unsloth-mistral-7b-bnb-4bit-sft-merged-add-start-end-index

Text Generation • Updated Apr 17 • 5

RichardErkhov/GroNLP_-_gpt2-small-italian-embeddings-4bits

Text Generation • Updated Apr 17 • 8

RichardErkhov/GroNLP_-_gpt2-small-italian-embeddings-8bits

Text Generation • Updated Apr 17 • 6

RichardErkhov/GroNLP_-_gpt2-small-italian-4bits

Text Generation • Updated Apr 17 • 10

RichardErkhov/GroNLP_-_gpt2-small-italian-8bits

Text Generation • Updated Apr 17 • 6

RichardErkhov/Kirili4ik_-_ruDialoGpt3-medium-finetuned-telegram-4bits

Text Generation • Updated Apr 17 • 6

RichardErkhov/Kirili4ik_-_ruDialoGpt3-medium-finetuned-telegram-8bits

Text Generation • Updated Apr 17 • 7

RichardErkhov/KoboldAI_-_fairseq-dense-1.3B-4bits

Text Generation • Updated Apr 17 • 9

RichardErkhov/KoboldAI_-_fairseq-dense-1.3B-8bits

Text Generation • Updated Apr 17 • 6

RichardErkhov/KoboldAI_-_GPT-Neo-2.7B-Picard-4bits

Text Generation • Updated Apr 17 • 6

RichardErkhov/KoboldAI_-_fairseq-dense-125M-4bits

Text Generation • Updated Apr 17 • 10

RichardErkhov/KoboldAI_-_fairseq-dense-125M-8bits

Text Generation • Updated Apr 17 • 6

RichardErkhov/KoboldAI_-_GPT-Neo-2.7B-Picard-8bits

Text Generation • Updated Apr 17 • 9

RichardErkhov/KoboldAI_-_fairseq-dense-2.7B-4bits

Text Generation • Updated Apr 17 • 10

RichardErkhov/KoboldAI_-_fairseq-dense-355M-4bits

Text Generation • Updated Apr 17 • 9

RichardErkhov/KoboldAI_-_fairseq-dense-355M-8bits

Text Generation • Updated Apr 17 • 7

RichardErkhov/LorenzoDeMattei_-_GePpeTto-4bits

Text Generation • Updated Apr 17 • 6

RichardErkhov/LorenzoDeMattei_-_GePpeTto-8bits

Text Generation • Updated Apr 17 • 6

RichardErkhov/KoboldAI_-_fairseq-dense-2.7B-8bits

Text Generation • Updated Apr 17 • 6

RichardErkhov/Norod78_-_distilgpt2-base-pretrained-he-4bits

Text Generation • Updated Apr 17 • 6

RichardErkhov/Norod78_-_hebrew-bad_wiki-gpt_neo-tiny-4bits

Text Generation • Updated Apr 17 • 8

RichardErkhov/Norod78_-_distilgpt2-base-pretrained-he-8bits

Text Generation • Updated Apr 17 • 8

RichardErkhov/Norod78_-_hebrew-bad_wiki-gpt_neo-tiny-8bits

Text Generation • Updated Apr 17 • 6

RichardErkhov/abhiramtirumala_-_DialoGPT-sarcastic-medium-4bits

Text Generation • Updated Apr 17 • 6

RichardErkhov/abinayam_-_gpt-2-tamil-4bits

Text Generation • Updated Apr 17 • 6

RichardErkhov/abinayam_-_gpt-2-tamil-8bits

Text Generation • Updated Apr 17 • 8

RichardErkhov/abhiramtirumala_-_DialoGPT-sarcastic-medium-8bits

Text Generation • Updated Apr 17 • 7