Edit Models filters

Inference status

Misc

8-bit precision

AutoTrain Compatible

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

5,750

Full-text search

Active filters: 8-bit

neuralmagic/Meta-Llama-3-70B-Instruct-quantized.w8a16

Text Generation • Updated Jul 18 • 458 • 3

model-scope/glm-4-9b-chat-GPTQ-Int8

Text Generation • Updated Jul 23 • 45 • 2

MaziyarPanahi/Llama-3-Groq-8B-Tool-Use-GGUF

Text Generation • Updated Jul 17 • 1.83M • 5

MaziyarPanahi/Mistral-Nemo-Instruct-2407-GGUF

Text Generation • Updated Jul 22 • 1.85M • 32

MaziyarPanahi/Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation • Updated Jul 29 • 1.85M • 37

neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w8a8

Text Generation • Updated 29 days ago • 8.6k • 12

Slvcxc/L3-Super-Nova-RP-8B-8.0bpw-h8-exl2

Text Generation • Updated Jul 24 • 21 • 3

neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w8a8

Text Generation • Updated Oct 10 • 6.25k • 13

ParasiticRogue/Lumimaid-Magnum-12B-exl2-8.0

Text Generation • Updated Aug 3 • 20 • 4

MaziyarPanahi/gemma-2-2b-it-GGUF

Text Generation • Updated Aug 1 • 1.84M • 5

anokimchen/sd-turbo-openvino-8bit-no-calibration

Text-to-Image • Updated Aug 7 • 1

anokimchen/sd-turbo-openvino-8bit-GPT4vision-calibrated

Text-to-Image • Updated Aug 7 • 1

shuyuej/Mistral-Nemo-Instruct-2407-GPTQ-INT8

Updated Aug 7 • 53 • 1

alpindale/Meta-Llama-3.1-70B-Instruct-GPTQ-INT8

Updated Aug 13 • 2.24k • 2

FuturisticVibes/Rocinante-12B-v1.1-8.0bpw-h8-exl2

Updated Aug 23 • 6 • 1

FuturisticVibes/MN-12B-Celeste-V1.9-8.0bpw-h8-exl2

Text Generation • Updated Aug 23 • 15 • 1

MaziyarPanahi/SmolLM-1.7B-Instruct-v0.2-GGUF

Text Generation • Updated Aug 18 • 1.07M • 7

neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w8a8

Text Generation • Updated Oct 10 • 567 • 2

MaziyarPanahi/Phi-3.5-mini-instruct-GGUF

Text Generation • Updated Aug 20 • 1.84M • 5

Qwen/Qwen2-VL-7B-Instruct-GPTQ-Int8

Image-Text-to-Text • Updated Sep 21 • 51.7k • 13

Qwen/Qwen2-VL-2B-Instruct-GPTQ-Int8

Image-Text-to-Text • Updated Sep 21 • 6.34k • 9

jadechoghari/aya-23-8B-quantized

Text Generation • Updated Sep 1 • 35 • 3

MaziyarPanahi/Yi-Coder-9B-Chat-GGUF

Text Generation • Updated Sep 4 • 1.84M • 2

MaziyarPanahi/solar-pro-preview-instruct-GGUF

Text Generation • Updated Sep 13 • 1.87M • 18

Qwen/Qwen2-VL-72B-Instruct-GPTQ-Int8

Image-Text-to-Text • Updated Sep 24 • 3.19k • 7

Qwen/Qwen2.5-0.5B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 9 • 1.76k • 5

Qwen/Qwen2.5-14B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 9 • 4.29k • 11

Qwen/Qwen2.5-32B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 9 • 15.9k • 8

Qwen/Qwen2.5-72B-Instruct-GPTQ-Int8

Text Generation • Updated Oct 9 • 7.21k • 7

MaziyarPanahi/Qwen2.5-7B-Instruct-GGUF

Text Generation • Updated Sep 18 • 1.56M • 8