Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Mixture of Experts

Carbon Emissions

Models

4,677

Full-text search

Active filters: it

FlorianJc/ghost-8b-beta-vllm-fp8

Text Generation • Updated Jul 25 • 13

BigHuggyD/mistralai_Mistral-Large-Instruct-2407_exl2_7.0bpw_h8

Text Generation • Updated Aug 14 • 11

Marlon81/Llama-3.1-SauerkrautLM-8b-Instruct-Q4_K_M-GGUF

Updated Jul 25 • 3

kkwagh999/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Jul 25 • 5

FlorianJc/Meta-Llama-3.1-8B-Instruct-vllm-fp8

Text Generation • Updated Jul 25 • 634

BigHuggyD/mistralai_Mistral-Large-Instruct-2407_exl2_6.5bpw_h8

Text Generation • Updated Aug 14 • 1

DevBM/Llama-3.1-8B-Instruct

Text Generation • Updated Jul 25 • 5

pmathis89/Meta-Llama-3.1-8B-Instruct-Q6_K-GGUF

Text Generation • Updated Jul 25 • 5

LoneStriker/Mistral-Large-Instruct-2407-2.65bpw-h6-exl2

Text Generation • Updated Jul 26 • 8

LoneStriker/Mistral-Large-Instruct-2407-3.0bpw-h6-exl2

Text Generation • Updated Jul 26 • 10

LoneStriker/Mistral-Large-Instruct-2407-3.5bpw-h6-exl2

Text Generation • Updated Jul 26 • 19

LoneStriker/Mistral-Large-Instruct-2407-4.0bpw-h6-exl2

Text Generation • Updated Jul 26 • 12

LoneStriker/Mistral-Large-Instruct-2407-5.0bpw-h6-exl2

Text Generation • Updated Jul 26 • 21

nihaomur/Meta-Llama-3.1-8B-Instruct-Q5_K_M.gguf

Text Generation • Updated Jul 26 • 35

BigHuggyD/mistralai_Mistral-Large-Instruct-2407_exl2_6.0bpw_h8

Text Generation • Updated Aug 14 • 5

QuantFactory/mini-magnum-12b-v1.1-GGUF

Updated Jul 26 • 7.06k • 2

QuantFactory/Llama-3.1-SauerkrautLM-8b-Instruct-GGUF

Updated Jul 26 • 219 • 2

Morgen0052/Meta-Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • Updated Jul 26 • 8

LoneStriker/Mistral-Large-Instruct-2407-6.0bpw-h6-exl2

Text Generation • Updated Jul 26 • 384

Kondara/falcon-11B-Q4_K_M-GGUF

Updated Jul 26 • 7

LoneStriker/Mistral-Large-Instruct-2407-8.0bpw-h8-exl2

Text Generation • Updated Jul 26 • 18 • 1

BigHuggyD/mistralai_Mistral-Large-Instruct-2407_exl2_5.5bpw_h8

Text Generation • Updated Aug 14 • 9

QuantFactory/SauerkrautLM-Nemo-12b-Instruct-GGUF

Updated Jul 26 • 368 • 3

Ransss/mini-magnum-12b-v1.1-Q8_0-GGUF

Updated Jul 26 • 4

v3ray/Llama-3-1-70B-Instruct-base

Text Generation • Updated Jul 26 • 159

bullerwins/Mistral-Large-Instruct-2407-exl2_4.0bpw

Text Generation • Updated Jul 27 • 3

trokhymovych/TRank_readability

Text Classification • Updated Jul 26 • 3

bullerwins/Mistral-Large-Instruct-2407-exl2_4.5bpw

Text Generation • Updated Jul 27 • 2

BigHuggyD/mistralai_Mistral-Large-Instruct-2407_exl2_5.0bpw_h8

Text Generation • Updated Aug 14 • 6

QuantFactory/ghost-8b-beta-GGUF

Text Generation • Updated Jul 26 • 105 • 1