Edit Models filters

Inference status

Misc

arxiv: 2306.00978

AutoTrain Compatible

4-bit precision

text-generation-inference

Inference Endpoints

Misc with no match

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

34

Full-text search

Active filters: 2306.00978

microsoft/Phi-3.5-mini-instruct-onnx

Text Generation • Updated Sep 12 • 532 • 13

microsoft/Phi-3-mini-4k-instruct-onnx

Text Generation • Updated May 22 • 831 • 126

microsoft/Phi-3-mini-128k-instruct-onnx

Text Generation • Updated May 22 • 426 • 184

OpenGVLab/InternVL2-2B-AWQ

Image-Text-to-Text • Updated Sep 24 • 9.74k • 14

OpenGVLab/InternVL2-40B-AWQ

Image-Text-to-Text • Updated Sep 24 • 606 • 17

OpenGVLab/InternVL2-26B-AWQ

Image-Text-to-Text • Updated Sep 24 • 473 • 18

OpenGVLab/InternVL2-Llama3-76B-AWQ

Image-Text-to-Text • Updated Sep 24 • 1.11k • 24

dahara1/ELYZA-japanese-Llama-2-7b-instruct-AWQ

Text Generation • Updated Sep 17, 2023 • 38

mmnga/Xwin-LM-7B-AWQ-calib-ja-100k

Text Generation • Updated Sep 26, 2023 • 16 • 2

mmnga/ELYZA-japanese-Llama-2-7b-fast-instruct-AWQ-calib-ja-100k

Text Generation • Updated Sep 26, 2023 • 73 • 1

TRAC-MTRY/traclm-v2-7b-instruct-AWQ

Text Generation • Updated Dec 22, 2023

mmnga/japanese-stablelm-instruct-gamma-7b-AWQ-calib-ja-1k

Text Generation • Updated Oct 27, 2023 • 15 • 1

mmnga/japanese-stablelm-base-gamma-7b-AWQ-calib-ja-1k

Text Generation • Updated Oct 27, 2023 • 11

internlm/internlm2-chat-7b-4bits

Text Generation • Updated Apr 24 • 100 • 4

internlm/internlm2-chat-20b-4bits

Text Generation • Updated Apr 24 • 953 • 6

disi-unibo-nlp/pmc-llama-13b-awq

Text Generation • Updated Feb 28 • 18

TRAC-MTRY/traclm-v3-7b-instruct-AWQ

Text Generation • Updated May 2

renwoshin/Phi-3-mini-128k-instruct-onnx-tf

Text Generation • Updated Apr 26 • 645k • 1

FusionQuill/Phi-3-mini-128k-instruct-onnx

Text Generation • Updated May 17 • 17

microsoft/Phi-3-medium-4k-instruct-onnx-directml

Text Generation • Updated May 23 • 370 • 8

microsoft/Phi-3-medium-128k-instruct-onnx-directml

Text Generation • Updated May 22 • 33 • 5

amazon/MistralLite-AWQ

Text Generation • Updated May 20 • 226 • 3

microsoft/mistral-7b-instruct-v0.2-ONNX

Text Generation • Updated May 21 • 55 • 6

OpenGVLab/InternVL-Chat-V1-5-AWQ

Image-Text-to-Text • Updated Sep 24 • 576 • 10

internlm/internlm2_5-7b-chat-4bit

Text Generation • Updated Jul 2 • 123 • 6

typealias/internlm2_5-7b-chat-4bit

Text Generation • Updated Jul 3 • 7

elysiantech/gemma-2b-awq-4bit

Text Generation • Updated Jul 5 • 4

elysiantech/phi-3-mini-4k-instruct-awq-4bit

Text Generation • Updated Jul 6 • 7

aws-prototyping/MegaBeam-Mistral-7B-300k-AWQ

Text Generation • Updated Jul 16 • 14 • 1

OpenGVLab/InternVL2-8B-AWQ

Image-Text-to-Text • Updated Sep 24 • 2.25k • 12