Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

2,535

Full-text search

Active filters: facebook

matrixportal/Llama-3.2-3B-Instruct-Q2_K-GGUF

Text Generation • Updated 6 days ago • 24

matrixportal/Llama-2-7b-chat-hf-Q4_K_M-GGUF

Text Generation • Updated 6 days ago • 2

naonnaon/Llama-3.2-1B-Instruct-IQ4_XS-GGUF

Updated 5 days ago • 24

matrixportal/Llama-3.1-8B-Instruct-IQ4_NL-GGUF

Text Generation • Updated 5 days ago • 21

mlx-community/Meta-Llama-3.1-8B-Instruct-3bit

Text Generation • Updated 5 days ago • 14

mav23/Llama-2-70B-fp16-GGUF

Text Generation • Updated 5 days ago • 271

matrixportal/Llama-3.1-8B-Instruct-IQ3_M-GGUF

Text Generation • Updated 5 days ago • 42

ckoozzzu/dl6

Text Generation • Updated 4 days ago • 134

Maites/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • Updated 4 days ago • 3

Maites/Llama-3.2-1B-Instruct-Q8_0-GGUF

Text Generation • Updated 4 days ago • 6

Triangle104/Meta-Llama-3.1-8B-Instruct-Q4_K_S-GGUF

Updated 3 days ago • 21

Triangle104/Meta-Llama-3.1-8B-Instruct-Q4_K_M-GGUF

Updated 3 days ago • 21

Triangle104/Meta-Llama-3.1-8B-Instruct-Q5_K_S-GGUF

Updated 3 days ago • 20

Triangle104/Meta-Llama-3.1-8B-Instruct-Q5_K_M-GGUF

Updated 3 days ago • 21

Triangle104/Meta-Llama-3.1-8B-Instruct-Q6_K-GGUF

Updated 3 days ago • 21

Triangle104/Meta-Llama-3.1-8B-Instruct-Q8_0-GGUF

Updated 3 days ago • 23

Maites/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated 3 days ago • 7

tensorblock/new1-GGUF

Text Generation • Updated 3 days ago • 255

Almheiri/Llama-3.2-1B-Instruct-QLORA_INT4_EO8

Text Generation • Updated 3 days ago • 50

tensorblock/EZO-Llama-3.2-3B-Instruct-dpoE-GGUF

Text Generation • Updated 3 days ago • 276

AIDSC/Llama-3.1-8B

Text Generation • Updated 1 day ago • 10

AIDSC/Llama-3.1-8B-Instruct

Text Generation • Updated 1 day ago • 12

mrcuddle/Lumimaid-v0.2-Llama-3.2-11B-Vision

Image-Text-to-Text • Updated 1 day ago • 29

bartowski/Open-Insurance-LLM-Llama3-8B-GGUF

Text Generation • Updated 2 days ago • 586

tensorblock/Hf2-GGUF

Text Generation • Updated 2 days ago • 241

tensorblock/deval-GGUF

Text Generation • Updated 1 day ago • 255

AnshuPatel-Vikalp/Llama-2-7b-chat-finetune

Text Generation • Updated 1 day ago • 25

tensorblock/new3-GGUF

Text Generation • Updated 1 day ago • 234

shashikanth-a/Meta-Llama-3.1-8B-4bit

Text Generation • Updated about 21 hours ago

shashikanth-a/Meta-Llama-3.1-8B-Instruct-4bit

Text Generation • Updated about 21 hours ago