Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

6,496

Full-text search

Active filters: awq

PrunaAI/llmware-slim-sql-1b-v0-AWQ-4bit-smashed

Text Generation • Updated Jul 12, 2024 • 81

shunran/dolphin-2.9.3-yi-1.5-34b-32k-awq

Text Generation • Updated Jun 28, 2024 • 4

dan-kwiat/Codestral-22B-v0.1-hf-FIM-fix-awq

Text Generation • Updated Jun 27, 2024 • 95 • 1

Weni/ZeroShot-Agents-Llama3-4.0.37-DPO-480-AWQ

Text Generation • Updated Jun 27, 2024 • 4

dan-kwiat/codestral-learn-60-epoch-4-f-awq

Text Generation • Updated Jun 27, 2024 • 4

Weni/ZeroShot-Agents-Llama3-4.0.39-DPO-AWQ

Text Generation • Updated Jun 27, 2024 • 4

Weni/ZeroShot-Agents-Llama3-4.0.40-DPO-AWQ

Text Generation • Updated Jun 27, 2024 • 5

Ichigo2899/arcee-ai-Arcee-Spark-AWQ

Text Generation • Updated Jun 27, 2024 • 4

VincentChoi00/STOCK_SOLAR-10.7B-AWQ

Text Generation • Updated Jul 1, 2024 • 2

cc8055/4bitfinetunnedtinyllamagroq-AWQ

Text Generation • Updated Jun 28, 2024 • 5

Weni/ZeroShot-Agents-Llama3-4.0.41-DPO-AWQ

Text Generation • Updated Jun 28, 2024 • 4

PrunaAI/victunes-TherapyLlama-8B-v1-AWQ-4bit-smashed

Text Generation • Updated Jul 12, 2024 • 79

QFactor/Hermes-2-Theta-Llama-3-70B-AWQ

Text Generation • Updated Jun 28, 2024 • 26

PrunaAI/readomni-dao-9b-AWQ-4bit-smashed

Text Generation • Updated Jul 12, 2024 • 79

macadeliccc/Qwen2-7B-AWQ

Text Generation • Updated Jun 28, 2024 • 4

PrunaAI/Symbol-LLM-Symbol-LLM-13B-Instruct-AWQ-4bit-smashed

Text Generation • Updated Jul 12, 2024 • 79

PrunaAI/victunes-TherapyBeagle-11B-v1-AWQ-4bit-smashed

Text Generation • Updated Jul 12, 2024 • 79

PrunaAI/internlm-AlchemistCoder-DS-6.7B-AWQ-4bit-smashed

Text Generation • Updated Jul 12, 2024 • 80

PrunaAI/winglian-llama-3-8b-256k-PoSE-AWQ-4bit-smashed

Text Generation • Updated Jul 12, 2024 • 83

PrunaAI/llmware-slim-sentiment-AWQ-4bit-smashed

Text Generation • Updated Jul 12, 2024 • 80

PrunaAI/mayflowergmbh-Wiedervereinigung-7b-dpo-laser-AWQ-4bit-smashed

Text Generation • Updated Jul 12, 2024 • 83

PrunaAI/sambanovasystems-SambaLingo-Japanese-Base-AWQ-4bit-smashed

Text Generation • Updated Jul 12, 2024 • 80

PrunaAI/sambanovasystems-SambaLingo-Russian-Base-AWQ-4bit-smashed

Text Generation • Updated Jul 12, 2024 • 83

Udith-Sandaruwan/Llama-3-8B-AWQ-4bit

Text Generation • Updated Jun 30, 2024 • 4

PrunaAI/mrfakename-refusal-AWQ-4bit-smashed

Text Generation • Updated Jul 12, 2024 • 81

cc8055/tinyllamafullprecision20k-AWQ

Text Generation • Updated Jul 1, 2024 • 7

DavidHuggingFace/Heimer-dpo-TinyLlama-1.1B-AWQ

Text Generation • Updated Jul 1, 2024 • 4

davidsvaughn/feedback-wizard-4bit-awq

Text Generation • Updated Jul 1, 2024 • 14

internlm/internlm2_5-7b-chat-4bit

Text Generation • Updated Jul 2, 2024 • 51 • 5

Weni/ZeroShot-Agents-Llama3-4.0.42-ORPO-AWQ

Text Generation • Updated Jul 2, 2024 • 4