Edit Models filters

Inference status

Misc

8-bit precision

AutoTrain Compatible

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

5,759

Full-text search

Active filters: 8-bit

lmstudio-community/Qwen2.5-Coder-1.5B-Instruct-MLX-8bit

Text Generation • Updated 9 days ago • 32 • 1

crce9598/Llama3.2-Code-Instruct-Finetune-IPAM

Text Generation • Updated 6 days ago • 23 • 1

mlx-community/Athene-V2-Chat-8bit

Text Generation • Updated 5 days ago • 28 • 1

bullerwins/Athene-V2-Chat-exl2_8.0bpw

Text Generation • Updated 5 days ago • 8 • 1

MaziyarPanahi/Mistral-Large-Instruct-2411-GGUF

Text Generation • Updated 1 day ago • 358 • 1

mlx-community/Lumimaid-v0.2-70B

Updated Oct 13 • 7 • 1

echarlaix/distilbert-base-uncased-finetuned-sst-2-english-int8-dynamic

Text Classification • Updated Jun 13, 2023 • 3.13k • 1

Intel/distilbert-base-uncased-finetuned-sst-2-english-int8-dynamic-inc

Text Classification • Updated Mar 21 • 16 • 1

Intel/distilbert-base-uncased-distilled-squad-int8-static-inc

Question Answering • Updated Mar 29 • 3.1k • 4

ethzanalytics/gpt-j-6B-8bit-sharded

Text Generation • Updated Nov 27, 2022 • 12 • 7

ethzanalytics/gpt-j-8bit-daily_dialogues

Text Generation • Updated Nov 27, 2022 • 29 • 4

ethzanalytics/gpt-j-8bit-KILT_WoW_10k_steps

Text Generation • Updated Nov 27, 2022 • 28

ybelkada/bloom-560m-8bit

Text Generation • Updated Apr 12, 2023 • 17

ybelkada/bloom-1b7-8bit

Text Generation • Updated Apr 17, 2023 • 548 • 6

thes41d/fr-boris-8bit

Text Generation • Updated May 20, 2023 • 12

RajuKandasamy/dolly-v2-3b-8bit

Text Generation • Updated Apr 15, 2023 • 15

RajuKandasamy/dolly-v2-7b-8bit

Text Generation • Updated Apr 15, 2023 • 14

seongcho/GenerAd-AI

Text Generation • Updated Apr 21, 2023

Linus4Lyf/Llama-1epoch-Plato

Text Generation • Updated Apr 21, 2023 • 16

Linus4Lyf/Llama-5epoch-Plato

Text Generation • Updated Apr 22, 2023 • 11

Linus4Lyf/Llama-10epoch-Plato

Text Generation • Updated Apr 22, 2023 • 24

ethzanalytics/dolly-v2-12b-sharded-8bit

Text Generation • Updated Apr 29, 2023 • 15 • 4

ethzanalytics/dolly-v2-7b-sharded-8bit

Text Generation • Updated Jun 28, 2023 • 18 • 1

Linus4Lyf/Llama-10epoch-Plato-3epoch-Beauvoir_The_Second_Sex

Text Generation • Updated Apr 25, 2023 • 16

vvsotnikov/stablelm-7b-sft-v7-epoch-3-8bit

Text Generation • Updated Apr 25, 2023 • 104

Linus4Lyf/Llama-10epoch-Plato-3epoch-Hume_A_Treatise_Of_Human_Nature

Text Generation • Updated Apr 26, 2023 • 12

Linus4Lyf/Llama-10epoch-Plato-3epoch-Kant_Metaphysics_Of_Morals

Text Generation • Updated Apr 26, 2023 • 23 • 1

emrik/bloom7b-vigogne

Text Generation • Updated Apr 26, 2023 • 12

Linus4Lyf/Llama-10epoch-Plato-3epoch-Rousseau_Emile

Text Generation • Updated Apr 27, 2023 • 11

Linus4Lyf/Llama-10epoch-Plato-3epoch-Sina_A_Compendium_On_The_Soul

Text Generation • Updated Apr 27, 2023 • 11