Edit Models filters

Model Tree

meta-llama/Llama-3.2-3B-Instruct

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

152

Full-text search

Active filters: meta-llama/Llama-3.2-3B-Instruct

jxtngx/Meta-Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 25 • 70

legraphista/Llama-3.2-3B-Instruct-IMat-GGUF

Text Generation • Updated Sep 25 • 834 • 1

neuralmagic/Llama-3.2-3B-Instruct-quantized.w8a8

Text Generation • Updated Oct 16 • 4.7k • 1

mukel/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 26 • 183

second-state/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 26 • 1.28k • 1

gaianet/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 25 • 385 • 1

baslak/Llama-3.2-3B-Instruct-ONNX-Q4

Updated Sep 25 • 13

baslak/Llama-3.2-3B-Instruct-ONNX-Q4-F16

DevQuasar/Llama-3.2-3B-Instruct-GGUF

Updated Sep 26 • 27

MCZK/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 26 • 395 • 1

mlc-ai/Llama-3.2-3B-Instruct-q4f16_0-MLC

Updated Sep 26 • 2.07k

SandLogicTechnologies/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 26 • 31

Solshine/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 26 • 13 • 1

beethogedeon/Llama-3.2-3B-Instruct-Q4_K_S-GGUF

Text Generation • Updated Sep 26 • 10 • 1

SanctumAI/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Sep 26 • 29.3k • 1

jimjimjimmyjim/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 26 • 9

numen-tech/Llama-3.2-3B-Instruct-w4a16g128asym

Text Generation • Updated Sep 26

paultimothymooney/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 26 • 9

brunopio/Llama-3.2-3B-Instruct-nbits4-GS64-Axis1-HQQ

Updated Sep 26 • 3

brunopio/Llama-3.2-3B-Instruct-nbits4-GSNone-Axis0-HQQ

Updated Sep 26 • 2

Solshine/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 26 • 20 • 1

joshmiller656/Llama3.2-3B-Instruct-AWQ-INT4

Updated Sep 26 • 128 • 1

pingzhou/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 26 • 5

rohanprichard/Llama-3.2-3B-Instruct-MLC

Updated Sep 27 • 3

Kondara/Llama-3.2-3B-Instruct-Q6_K-GGUF

Text Generation • Updated Sep 27 • 23

argearriojas/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 27 • 6

mayanksharma3/Llama-3.2-3B-Instruct-Q4_0-GGUF

Text Generation • Updated Sep 27 • 82

kingabzpro/llama-3.2-3b-it-Ecommerce-ChatBot

Text Generation • Updated Oct 1 • 229 • 3

BitStreamX/Llama-3.2-3B-Instruct-Q5_K_M-GGUF

Text Generation • Updated 25 days ago • 152

pipilok/Llama-3.2-3B-Instruct-Q4_0_4_8-GGUF

Text Generation • Updated 21 days ago • 179