Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

4-bit precision

text-generation-inference

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

195

Full-text search

Active filters: quantization

legraphista/Llama-Guard-3-1B-IMat-GGUF

Text Generation • Updated Sep 25 • 533

vhab10/llama_3.1_8b_Q4_K_M-gguf

Text Generation • Updated Oct 6 • 14

hagsaeng/MachinLearningBootCamp_QAclassifier_Gemma-2B

Text Classification • Updated Oct 3

ejbejaranos/Bitnet-LLama3-8B-Now2B

Updated Oct 7 • 3 • 3

mehdibukhari/llama3.18B-Fine-tunedByMehdi

avans06/Meta-Llama-3.1-8B-Instruct-ct2-int8_float16

Text Generation • Updated Oct 10 • 16

mcavus/glm-4v-9b-gptq-4bit-dynamo

Updated Oct 10 • 9 • 1

avans06/Meta-Llama-3.2-8B-Instruct-ct2-int8_float16

Text Generation • Updated Oct 13 • 45

harishnair04/Gemma-medtr-2b-sft

Text Generation • Updated 14 days ago • 35

harishnair04/Gemma-medtr-2b-sft-v2

Text Generation • Updated 7 days ago • 23

mradermacher/Gemma-medtr-2b-sft-v2-GGUF

Updated 6 days ago • 269

north/nb-llama-3.2-1B-Q4_K_M-GGUF

Updated 1 day ago • 22

north/nb-llama-3.2-3B-Q4_K_M-GGUF

Updated 1 day ago • 3

north/nb-llama-3.1-8B-Q4_K_M-GGUF

Updated 1 day ago • 20

neuralmagic/Sparse-Llama-3.1-8B-evolcodealpaca-2of4-quantized.w4a16

Text Generation • Updated about 12 hours ago