Edit Models filters

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

10,937

Full-text search

Active filters: 4-bit

TheBloke/openchat_3.5-16k-AWQ

Text Generation • Updated Nov 11, 2023 • 3.51k • 2

unsloth/llama-2-7b-bnb-4bit

Text Generation • Updated Mar 22 • 12.2k • 6

TheBloke/Mistral-7B-Instruct-v0.2-GPTQ

Text Generation • Updated Dec 11, 2023 • 18.3k • 41

TheBloke/Mistral-7B-Instruct-v0.2-AWQ

Text Generation • Updated Dec 11, 2023 • 59.2k • 38

TheBloke/Mythalion-Kimiko-v2-GPTQ

Text Generation • Updated Dec 14, 2023 • 39 • 4

dvijay/mistral-alpaca2k-3e-lora

Text Generation • Updated Dec 16, 2023 • 4 • 1

TheBloke/orangetin-OpenHermes-Mixtral-8x7B-GPTQ

Text Generation • Updated Dec 21, 2023 • 529 • 3

TheBloke/dolphin-2.7-mixtral-8x7b-GPTQ

Text Generation • Updated Jan 1 • 348 • 18

TheBloke/dolphin-2.7-mixtral-8x7b-AWQ

Text Generation • Updated Jan 1 • 4.02k • 19

internlm/internlm2-chat-7b-4bits

Text Generation • Updated Apr 24 • 121 • 3

allennghayoui/code-assistant-AWQ

Text Generation • Updated Jan 15 • 8 • 1

pandasai/bamboo-llm

Text Generation • Updated Jan 17 • 54 • 8

MaziyarPanahi/em_german_leo_mistral-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • Updated Jan 26 • 191 • 2

MaziyarPanahi/sqlcoder-7b-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • Updated Jan 26 • 206 • 7

MaziyarPanahi/Noromaid-7b-v0.1.1-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • Updated Jan 26 • 168 • 1

TheBloke/EstopianMaid-13B-GPTQ

Text Generation • Updated Jan 26 • 34 • 17

MaziyarPanahi/Noromaid-7b-v0.2-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • Updated Jan 29 • 172 • 1

MaziyarPanahi/Noromaid-7b-v0.1.1-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • Updated Jan 29 • 163 • 1

TheBloke/CodeLlama-70B-Python-GPTQ

Text Generation • Updated Jan 31 • 34 • 19

TheBloke/CapybaraHermes-2.5-Mistral-7B-AWQ

Updated Jan 31 • 6.9k • 15

TheBloke/CapybaraHermes-2.5-Mistral-7B-GPTQ

Updated Jan 31 • 1.34k • 46

MaziyarPanahi/Kunoichi-7B-GGUF

Text Generation • Updated Feb 4 • 257 • 1

Qwen/Qwen1.5-72B-Chat-GPTQ-Int4

Text Generation • Updated Apr 30 • 3.65k • 35

Qwen/Qwen1.5-14B-Chat-GPTQ-Int4

Text Generation • Updated Apr 30 • 1.09k • 19

Qwen/Qwen1.5-0.5B-Chat-GPTQ-Int4

Text Generation • Updated Apr 30 • 808 • 11

parlance-labs/hc-mistral-alpaca

Updated Feb 14 • 263 • 13

erfanvaredi/jais-7b-chat

Text Generation • Updated Feb 22 • 1.42k • 2

robinsmits/Mistral-Instruct-7B-v0.2-ChatAlpacaV2-4bit

Text Generation • Updated Feb 13 • 1.36k • 5

Tann-dev/sex-chat-dirty-girlfriend

Text Generation • Updated Feb 17 • 3.78k • 11

MaziyarPanahi/BioMistral-7B-GGUF

Text Generation • Updated Feb 19 • 739 • 38