Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

Inference Endpoints

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

1,656

Full-text search

Active filters: 3-bit

Xu-Ouyang/pythia-70m-deduped-int3-step93000-GPTQ-wikitext2

Text Generation • Updated Sep 4 • 10

Xu-Ouyang/pythia-12b-deduped-int3-step93000-GPTQ-wikitext2

Text Generation • Updated Sep 3 • 10

Xu-Ouyang/pythia-6.9b-deduped-int3-step93000-GPTQ-wikitext2

Text Generation • Updated Sep 4 • 10

Xu-Ouyang/pythia-2.8b-deduped-int3-step93000-GPTQ-wikitext2

Text Generation • Updated Sep 4 • 10

Xu-Ouyang/pythia-1.4b-deduped-int3-step93000-GPTQ-wikitext2

Text Generation • Updated Sep 4 • 10

Xu-Ouyang/pythia-1b-deduped-int3-step93000-GPTQ-wikitext2

Text Generation • Updated Sep 4 • 11

Xu-Ouyang/pythia-410m-deduped-int3-step93000-GPTQ-wikitext2

Text Generation • Updated Sep 4 • 10

Xu-Ouyang/pythia-160m-deduped-int3-step93000-GPTQ-wikitext2

Text Generation • Updated Sep 4 • 10

BigHuggyD/FluffyKaeloky_Luminum-v0.1-123B_exl2_3.0bpw_h6

Text Generation • Updated Sep 7 • 18

MaziyarPanahi/Yi-Coder-1.5B-Chat-GGUF

Text Generation • Updated Sep 4 • 234k • 4

MaziyarPanahi/Yi-Coder-9B-Chat-GGUF

Text Generation • Updated Sep 4 • 234k • 1

LoneStriker/Yi-Coder-9B-Chat-3.0bpw-h6-exl2

Text Generation • Updated Sep 4 • 10

LoneStriker/Yi-Coder-9B-3.0bpw-h6-exl2

Updated Sep 4 • 5

bullerwins/Reflection-70B-exl2_3.0bpw

Text Generation • Updated Sep 7 • 15

MaziyarPanahi/DeepSeek-V2.5-GGUF

Text Generation • Updated Sep 11 • 352 • 3

MaziyarPanahi/ref_70_e3-GGUF

Text Generation • Updated Sep 10 • 285

async0x42/L3.1-70B-Hanami-x1-exl2_3bpw

Updated Sep 11 • 30

SicariusSicariiStuff/ZeusLabs_Chronos-Divergence-33B-EXL2-3.0bpw

MaziyarPanahi/reader-lm-0.5b-GGUF

Text Generation • Updated Sep 11 • 425 • 2

MaziyarPanahi/reader-lm-1.5b-GGUF

Text Generation • Updated Sep 11 • 762 • 1

Xu-Ouyang/pythia-70m-deduped-int3-step13000-GPTQ-wikitext2

Text Generation • Updated Sep 11 • 10

Xu-Ouyang/pythia-70m-deduped-int3-step15000-GPTQ-wikitext2

Text Generation • Updated Sep 11 • 11

Xu-Ouyang/pythia-70m-deduped-int3-step28000-GPTQ-wikitext2

Text Generation • Updated Sep 11 • 10

Xu-Ouyang/pythia-70m-deduped-int3-step30000-GPTQ-wikitext2

Text Generation • Updated Sep 11 • 10

Xu-Ouyang/pythia-70m-deduped-int3-step42000-GPTQ-wikitext2

Text Generation • Updated Sep 11 • 10

Xu-Ouyang/pythia-70m-deduped-int3-step44000-GPTQ-wikitext2

Text Generation • Updated Sep 11 • 13

Xu-Ouyang/pythia-12b-deduped-int3-step13000-GPTQ-wikitext2

Text Generation • Updated Sep 11 • 12

Xu-Ouyang/pythia-12b-deduped-int3-step15000-GPTQ-wikitext2

Text Generation • Updated Sep 11 • 13

Xu-Ouyang/pythia-12b-deduped-int3-step28000-GPTQ-wikitext2

Text Generation • Updated Sep 12 • 10

Xu-Ouyang/pythia-12b-deduped-int3-step30000-GPTQ-wikitext2

Text Generation • Updated Sep 12 • 12