Edit Models filters

text-generation-inference

4-bit precision

AutoTrain Compatible

Inference Endpoints

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

1,372

Full-text search

Active filters: quantized

MaziyarPanahi/firefunction-v2-GGUF

Text Generation • Updated 6 days ago • 47.1k • 13

legraphista/glm-4-9b-chat-1m-GGUF

Text Generation • Updated 6 days ago • 13.6k • 5

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated May 14 • 58.2k • 146

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22 • 558k • 44

Lewdiculous/Kunocchini-7b-128k-test-GGUF-Imatrix

Text Generation • Updated May 4 • 872 • 24

argmaxinc/whisperkit-coreml

Updated 1 day ago • 1.95k • 55

legraphista/glm-4-9b-chat-IMat-GGUF

Text Generation • Updated 6 days ago • 16.6k • 2

legraphista/glm-4-9b-chat-GGUF

Text Generation • Updated 6 days ago • 12.5k • 2

neuralmagic/bge-large-en-v1.5-quant

Feature Extraction • Updated Nov 13, 2023 • 32.7k • 21

afrideva/TinyLlama-1.1B-intermediate-1.5T-PTBR-Instruct-v3-8k-GGUF

Text Generation • Updated Nov 10, 2023 • 180 • 4

afrideva/phi-2-uncensored-GGUF

Text Generation • Updated Dec 21, 2023 • 401 • 8

afrideva/llama2_xs_460M_uncensored-GGUF

Text Generation • Updated Dec 21, 2023 • 168 • 1

MaziyarPanahi/em_german_leo_mistral-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • Updated Jan 26 • 183 • 2

MaziyarPanahi/Noromaid-7b-v0.1.1-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • Updated Jan 26 • 158 • 1

MaziyarPanahi/Noromaid-7b-v0.2-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • Updated Jan 29 • 163 • 1

argmaxinc/whisperkit-coreml_01-30-24

Automatic Speech Recognition • Updated Mar 8 • 76

MaziyarPanahi/Noromaid-7b-v0.1.1-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • Updated Jan 29 • 156 • 1

MaziyarPanahi/Kunoichi-7B-GGUF

Text Generation • Updated Feb 4 • 259 • 1

MaziyarPanahi/BioMistral-7B-GGUF

Text Generation • Updated Feb 19 • 904 • 38

MaziyarPanahi/gemma-7b-GGUF

Text Generation • Updated Feb 29 • 755 • 10

MaziyarPanahi/gemma-7b-it-GGUF

Text Generation • Updated Feb 27 • 289 • 7

Lewdiculous/Pasta-Lake-7b-GGUF

Text Generation • Updated Feb 25 • 114 • 5

Lewdiculous/Kunocchini-1.2-7b-longtext-GGUF-Imatrix

Text Generation • Updated Feb 27 • 186 • 4

Lewdiculous/Kunoichi-DPO-v2-7B-GGUF-Imatrix

Text Generation • Updated May 4 • 1.66k • 30

Lewdiculous/Loyal-Toppy-Bruins-Maid-7B-DARE-GGUF-Imatrix

Text Generation • Updated Feb 27 • 253 • 13

FantasiaFoundry/GGUF-Quantization-Script

Text Generation • Updated 13 days ago • 43

Lewdiculous/BuRP_7B-GGUF-IQ-Imatrix

Updated May 4 • 628 • 19

Lewdiculous/kuno-kunoichi-v1-DPO-v2-SLERP-7B-GGUF-IQ-Imatrix

Updated Mar 14 • 305 • 10

Lewdiculous/Model-Requests

Updated 12 days ago • 30

MaziyarPanahi/BioMedGPT-LM-7B-GGUF

Text Generation • Updated Mar 17 • 217 • 4