Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

433

Full-text search

Active filters: pretrained

MaziyarPanahi/Mistral-7B-v0.2-GGUF

Text Generation • Updated Mar 28 • 127 • 3

FriendliAI/Mistral-7B-Instruct-v0.2-fp8

Text Generation • Updated Apr 18 • 17 • 11

ProCreations/Qwen1.5-0.5B-Q4_K_M-GGUF

Text Generation • Updated Mar 29 • 3

ProCreations/Qwen1.5-4B-Q5_0-GGUF

Text Generation • Updated Mar 29 • 2

mlx-community/Qwen1.5-MoE-A2.7B-4bit

Text Generation • Updated Apr 2 • 4

Qwen/Qwen1.5-32B

Text Generation • Updated Apr 5 • 11.4k • 81

mlx-community/Qwen1.5-MoE-A2.7B-Chat-4bit

Text Generation • Updated Apr 2 • 7 • 5

jesusoctavioas/wikisql-4bit-1k

Text Generation • Updated Apr 3 • 7

Tweeties/tweety-7b-italian-v24a

Text Generation • Updated May 13 • 12 • 2

MarsupialAI/Qwen1.5-32B_iMatrix_GGUF

Text Generation • Updated May 11 • 47 • 1

mlx-community/Qwen1.5-32B-4bit

Text Generation • Updated Apr 5 • 4 • 1

mlx-community/Qwen1.5-32B-8bit

Text Generation • Updated Apr 5 • 4

LoneStriker/Qwen1.5-32B-3.0bpw-h6-exl2

Text Generation • Updated Apr 6 • 3

LoneStriker/Qwen1.5-32B-4.0bpw-h6-exl2

Text Generation • Updated Apr 6 • 6

LoneStriker/Qwen1.5-32B-4.65bpw-h6-exl2

Text Generation • Updated Apr 6 • 5

LoneStriker/Qwen1.5-32B-5.0bpw-h6-exl2

Text Generation • Updated Apr 6 • 4

LoneStriker/Qwen1.5-32B-6.0bpw-h6-exl2

Text Generation • Updated Apr 6 • 4

LoneStriker/Qwen1.5-32B-8.0bpw-h8-exl2

Text Generation • Updated Apr 6 • 5

teneriffa/Qwen1.5-32B-Q4_0-GGUF

Text Generation • Updated Apr 6 • 12

OpenLLM-France/Claire-7B-EN-0.1

Text Generation • Updated Sep 4 • 24 • 1

mlx-community/Qwen1.5-0.5B-4bit

Text Generation • Updated Apr 8 • 6

CryogenicPlanet/mistral-jax

Text Generation • Updated Apr 9

pere/mistral-maxtext-export-test

Text Generation • Updated Apr 12 • 6

jeremy02au/Qwen1.5-1.8B-GPTQ

Text Generation • Updated Apr 11 • 5

dicta-il/dictalm2.0-AWQ

Text Generation • Updated Jul 10 • 46

dicta-il/dictalm2.0-GPTQ

Text Generation • Updated Jul 10 • 51

mlx-community/Qwen1.5-72B-4bit

Text Generation • Updated Apr 13 • 14

Qwen/CodeQwen1.5-7B

Text Generation • Updated May 13 • 2.4k • 91

RaphaelMourad/Mistral-DNA-v1-138M-bacteria

Text Generation • Updated Aug 4 • 593 • 3

DavidAU/roleplay-model-v2-Q6_K-GGUF

Updated Apr 16 • 18