Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

17,416

Full-text search

Active filters: 4-bit

nm-testing/Llama-2-7b-pruned2.4-Marlin_24

Text Generation • Updated May 15 • 1.27k • 1

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22 • 1.97M • 63

unsloth/mistral-7b-instruct-v0.3-bnb-4bit

Text Generation • Updated Sep 11 • 137k • 15

neuralmagic/Mistral-7B-Instruct-v0.3-GPTQ-4bit

Text Generation • Updated Jun 10 • 2.59k • 15

cookey39/Five_Phases_Mindset

Text Generation • Updated May 27 • 26 • 1

THUDM/cogvlm2-llama3-chat-19B-int4

Text Generation • Updated May 24 • 3.05k • 26

saheedniyi/Llama3-8b-Naija_v1

Text Generation • Updated Jun 4 • 47 • 8

solidrust/Llama-3-Lumimaid-8B-v0.1-OAS-AWQ

Text Generation • Updated Sep 3 • 5 • 1

jihadzakki/idefics2-8b-vqarad-delta

Visual Question Answering • Updated Jun 13 • 29 • 3

Qwen/Qwen2-7B-Instruct-GPTQ-Int4

Text Generation • Updated Aug 21 • 4.8k • 23

MaziyarPanahi/Qwen2-7B-Instruct-GGUF

Text Generation • Updated Jun 6 • 2.13M • 9

unsloth/Qwen2-72B-Instruct-bnb-4bit

Text Generation • Updated Sep 3 • 82 • 7

MaziyarPanahi/Qwen2-1.5B-Instruct-GGUF

Text Generation • Updated Jun 6 • 2.12M • 8

nikravan/glm-4vq

Document Question Answering • Updated Jun 16 • 1.72k • 23

unclecode/folrence-2-large-4bit

Text Generation • Updated Jun 26 • 678 • 3

dan-kwiat/Codestral-22B-v0.1-hf-FIM-fix-awq

Text Generation • Updated Jun 27 • 11 • 1

unsloth/gemma-2-9b-bnb-4bit

Text Generation • Updated Sep 3 • 31.7k • 24

rootxhacker/CodeAstra-7B

Text Generation • Updated Jul 3 • 571 • 8

unsloth/gemma-2-9b-it-bnb-4bit

Text Generation • Updated Sep 3 • 28k • 20

unsloth/gemma-2-27b-it-bnb-4bit

Text Generation • Updated Sep 3 • 6.57k • 8

marcsun13/gemma-2-9b-it-GPTQ

Text Generation • Updated Jul 3 • 10.5k • 3

neuralmagic/Mistral-7B-Instruct-v0.3-quantized.w4a16

Text Generation • Updated Jul 18 • 377 • 1

MaziyarPanahi/Llama-3-Groq-8B-Tool-Use-GGUF

Text Generation • Updated Jul 17 • 1.83M • 5

hugging-quants/Meta-Llama-3.1-405B-Instruct-AWQ-INT4

Text Generation • Updated Sep 13 • 123k • 37

MaziyarPanahi/Mistral-Nemo-Instruct-2407-GGUF

Text Generation • Updated Jul 22 • 1.85M • 32

unsloth/Mistral-Nemo-Base-2407-bnb-4bit

Text Generation • Updated Sep 11 • 6.93k • 11

unsloth/Mistral-Nemo-Instruct-2407-bnb-4bit

Text Generation • Updated Sep 11 • 19.3k • 24

ModelCloud/Mistral-Nemo-Instruct-2407-gptq-4bit

Text Generation • Updated Jul 23 • 4.74k • 4

hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7 • 407k • 60

hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7 • 250k • 90