Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

Misc with no match

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

151

Full-text search

Active filters: llama-3.1

mradermacher/openbuddy-llama3.1-8b-v22.1-131k-i1-GGUF

Updated Aug 2 • 612

Cran-May/openbuddy-llama3.1-8b-v22.2-131k-Q4_K_M-GGUF

Text Generation • Updated Jul 29 • 7 • 1

mradermacher/Configurable-Llama-3.1-8B-Instruct-i1-GGUF

Updated Aug 2 • 301

ModelCloud/Meta-Llama-3.1-405B-Instruct-gptq-4bit

Text Generation • Updated Jul 30 • 7 • 2

Kalei/Meta-Llama-3.1-70B-Instruct-AWQ-INT4-Custom

Text Generation • Updated Jul 31 • 7

hierholzer/Llama-3.1-70B-Instruct-GGUF

Text Generation • Updated Aug 19 • 226 • 3

adrlau/Llama3.1-8B-Fireplace2-Q4_K_M-GGUF

Text Generation • Updated Aug 2 • 8

anhbn/Meta-Llama-3.1-70B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7 • 4

DimensionSTP/Llama-3.1-8B-Instruct-open-Korean

Text Generation • Updated Aug 7 • 12

UCLA-EMC/Meta-Llama-3.1-8B-AWQ-INT4

Text Generation • Updated Aug 30 • 38

ValiantLabs/Llama3.1-8B-Enigma

Text Generation • Updated Oct 3 • 243 • 8

UCLA-EMC/Meta-Llama-3.1-8B-Instruct-AWQ-INT4-32-2.17B

Text Generation • Updated Aug 30 • 4 • 1

akjindal53244/Llama-3.1-Storm-8B-FP8-Dynamic

Text Generation • Updated Aug 21 • 548 • 14

reach-vb/Meta-Llama-3.1-8B-Instruct-AWQ-INT4-fix

Text Generation • Updated Aug 14 • 6

ValiantLabs/Llama3.1-8B-Cobalt

Text Generation • Updated Oct 3 • 401 • 6

bartowski/Llama3.1-8B-Enigma-GGUF

Text Generation • Updated Aug 16 • 331 • 1

bartowski/Llama3.1-8B-Cobalt-GGUF

Text Generation • Updated Aug 17 • 188 • 2

Cran-May/openbuddy-llama3.1-8b-v22.3-131k-IQ4_XS-GGUF

Text Generation • Updated Aug 18 • 5

JamePeng2023/openbuddy-llama3.1-8b-v22.3-131k-GGUF

Text Generation • Updated Aug 19 • 41

QuantFactory/Llama3.1-8B-Enigma-GGUF

Text Generation • Updated Aug 28 • 177 • 1

Cran-May/openbuddy-llama3.1-8b-v22.3-131k-Q4_K_S-GGUF

Text Generation • Updated Aug 19 • 11

Cran-May/openbuddy-llama3.1-8b-v22.3-131k-Q4_K_M-GGUF

Text Generation • Updated Aug 19 • 6

OpenBuddy/openbuddy-llama3.1-8b-v22.3-131k-Q4_K_M-GGUF

Text Generation • Updated Aug 19 • 16

mudler/Llama-3.1-Storm-8B-Q4_K_M-GGUF

Text Generation • Updated Aug 19 • 50

bartowski/Llama-3.1-Storm-8B-GGUF

Text Generation • Updated Aug 20 • 1.41k • 6

voxmenthe/Llama-3.1-Storm-8B

Text Generation • Updated Aug 20 • 9

mradermacher/Llama-3.1-Storm-8B-GGUF

Updated Aug 20 • 402 • 2

mradermacher/Llama-3.1-Storm-8B-i1-GGUF

Updated Aug 20 • 874 • 3

legraphista/Llama-3.1-Storm-8B-IMat-GGUF

Text Generation • Updated Aug 20 • 728

OpenBuddy/openbuddy-llama3.1-70b-v22.1-131k

Text Generation • Updated Aug 22 • 5 • 1