Edit Models filters

Inference status

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

3,452

Full-text search

Active filters: awq

PrunaAI/TheDrummer-Llama-3SOME-8B-v1-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 3

PrunaAI/cognitivecomputations-samantha-mistral-7b-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 8

PrunaAI/PipableAI-pip-sql-1.3b-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 8

PrunaAI/BatsResearch-bonito-v1-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 4

PrunaAI/lightblue-suzume-llama-3-8B-japanese-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 3

PrunaAI/codellama-CodeLlama-13b-Instruct-hf-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 6

PrunaAI/codellama-CodeLlama-13b-Python-hf-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 16

PrunaAI/Chat2DB-Chat2DB-SQL-7B-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 2

PrunaAI/ajibawa-2023-Young-Children-Storyteller-Mistral-7B-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 8

PrunaAI/openbmb-MiniCPM-2B-dpo-bf16-llama-format-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 2

PrunaAI/Sao10K-Solstice-11B-v1-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 3

PrunaAI/raincandy-u-Llama-3-8b.UNLEASHED-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 3

PrunaAI/croissantllm-CroissantLLMBase-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 3

PrunaAI/codellama-CodeLlama-7b-hf-AWQ-4bit-smashed

Text Generation • Updated Aug 2 • 2

Weni/WeniGPT-Agents-Llama3-5.0.93-DPO-AWQ

Text Generation • Updated Jun 18 • 4

TechxGenus/DeepSeek-Coder-V2-Lite-Instruct-AWQ

Text Generation • Updated Jun 22 • 453 • 6

TechxGenus/DeepSeek-Coder-V2-Lite-Base-AWQ

Text Generation • Updated Jun 22 • 276 • 1

IlyaGusev/saiga_llama3_70b_sft_m1_d5_abliterated_kto_m1_d2_awq_4bit

Text Generation • Updated Jun 18 • 236 • 2

Weni/ZeroShot-Agents-Llama3-4.0.17-DPO-AWQ

Text Generation • Updated Jun 22 • 3

Weni/ZeroShot-Agents-Llama3-4.0.18-DPO-AWQ

Text Generation • Updated Jun 19 • 4

Weni/ZeroShot-Agents-Llama3-4.0.19-DPO-AWQ

Text Generation • Updated Jun 19 • 2

bjaidi/Phi-3-medium-128k-instruct-awq

Text Generation • Updated Jun 20 • 62 • 1

guialfaro/llama3qa-awq

Text Generation • Updated Jun 20 • 3

Weni/WeniGPT-Agents-Llama3-5.0.95-DPO-AWQ

Text Generation • Updated Jun 20 • 4

EditorZ/medllm

Text Generation • Updated Jun 20 • 4

guialfaro/llama3-awq-hermes-2-theta

Text Generation • Updated Jun 20 • 6

guialfaro/openchat-awq-3.6

Text Generation • Updated Jun 20 • 5

Weni/ZeroShot-Agents-Llama3-4.0.20-DPO-AWQ

Text Generation • Updated Jun 20 • 3

Weni/ZeroShot-Agents-Llama3-4.0.test-DPO-AWQ

Text Generation • Updated Jun 21 • 3

samim2024/Llama-3-8B-AWQ-4bit

Text Generation • Updated Jun 21 • 2