Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

3,578

Full-text search

Active filters: awq

kaitchup/Phi-3-medium-128k-instruct-awq-4bit

Text Generation • Updated Jun 21

Narednra/Meditron_llama2_7b_58k-AWQ

Text Generation • Updated Jun 11 • 6

solidrust/Average_Normie_v3.69_8B-AWQ

Text Generation • Updated Sep 3 • 12

civoai/Meta-Llama-3-8B-awq

Text Generation • Updated Jun 11 • 8

solidrust/dolphin-2.9.2-qwen2-7b-AWQ

Text Generation • Updated Sep 3 • 11

changchuntzu/project-m2-2024-dreamteam-awq_full

Text Generation • Updated Jun 11 • 9

amir-ma71/Dorna-Llama3-8B-Instruct-AWQ

Text Generation • Updated Jun 27 • 396 • 1

civoai/Meta-Llama-3-8B-Instruct-awq

Text Generation • Updated Jun 11 • 10

solidrust/Ayam-2x8B-AWQ

Text Generation • Updated Sep 3 • 12

NghiemAbe/SeaLLM-v2.5-Legal-v4-AWQ

Text Generation • Updated Jul 18 • 14

solidrust/Hathor-L3-8B-v.01-AWQ

Text Generation • Updated Sep 3 • 12

solidrust/Inixion-2x8B-AWQ

Text Generation • Updated Sep 3 • 10

solidrust/Llama-3-NeuralHercules-5.0-8B-AWQ

Text Generation • Updated Sep 3 • 17

OriDragon2000/Qwen2-0.5B-awq-w4-g128

Text Generation • Updated Jun 12 • 5

solidrust/Llama-3-8B-AWQ

Text Generation • Updated Sep 3 • 13

OriDragon2000/Qwen1.5-7B-awq-w4-g128

Text Generation • Updated Jun 12 • 11

solidrust/Hathor-L3-8B-v.02-AWQ

Text Generation • Updated Sep 3 • 13

OriDragon2000/Qwen1.5-1.8B-awq-w4-g128

Text Generation • Updated Jun 12 • 9

zaddyzaddy/Soro-GPT-4bit

Text Generation • Updated Jun 12 • 4

attention-avengers/Qwen1.5-0.5B-Chat-SFT-MCQA-AWQ

Text Generation • Updated Jun 12 • 4

Weni/WeniGPT-Agents-Llama3-5.0.90-DPO-AWQ

Text Generation • Updated Jun 13 • 2

Bharanidharan07/idefics_2_finetuned_copy

Image-Text-to-Text • Updated Jun 13 • 6

mimimamalah/EPFL-TA-Meister-AWQ-4bit-V1

Text Generation • Updated Jun 12 • 10

PeterAM4/EPFL-TA-Meister-AWQ-4bit

Text Generation • Updated Jun 12 • 12

solidrust/MadWizardOrpoMistral-7b-v0.3-AWQ

Text Generation • Updated Sep 3 • 10

changchuntzu/mcqa_model_full_only_mcqa-awq

Text Generation • Updated Jun 12 • 11

changchuntzu/mcqa_model_full_only_mcqa-awq_v2

Text Generation • Updated Jun 12 • 5

Weni/ZeroShot-Agents-Llama3-4.0.1-SFT-AWQ

Text Generation • Updated Jun 13 • 2

Weni/ZeroShot-Agents-Llama3-4.0.3-SFT-AWQ

Text Generation • Updated Jun 13 • 5

statezeropy/POLAR-14B-v0.2-awq

Text Generation • Updated Jun 13 • 8