Edit Models filters

Inference status

Misc

Carbon Emissions

text-generation-inference

Misc with no match

Inference Endpoints

AutoTrain Compatible

4-bit precision

text-embeddings-inference

8-bit precision

Mixture of Experts

Models

140

Full-text search

Active filters: q5_k_m

afrideva/llama2_xs_460M_uncensored-GGUF

Text Generation • Updated Dec 21, 2023 • 76 • 1

afrideva/phi-2-chat-turkish-GGUF

Text Generation • Updated Dec 21, 2023 • 73 • 2

afrideva/phi-2-chat-GGUF

Text Generation • Updated Dec 21, 2023 • 60

afrideva/LMCocktail-phi-2-v1-GGUF

Text Generation • Updated Dec 21, 2023 • 75

afrideva/Llama-160M-Chat-v1-GGUF

Text Generation • Updated Dec 21, 2023 • 89 • 2

afrideva/llama-160m-GGUF

Text Generation • Updated Dec 21, 2023 • 88

afrideva/phi-1_5_dolly_instruction_polish-GGUF

Text Generation • Updated Dec 22, 2023 • 99 • 2

afrideva/phi-2-sft-dpo-gpt4_en-ep1-GGUF

Text Generation • Updated Dec 22, 2023 • 99 • 2

afrideva/phi-2_LogiCoT_finetuned-GGUF

Text Generation • Updated Dec 22, 2023 • 44

afrideva/open-llama-3b-v2-instruct-GGUF

Text Generation • Updated Dec 24, 2023 • 106 • 1

afrideva/phi-2_dolly_instruction_polish-GGUF

Text Generation • Updated Dec 24, 2023 • 67 • 2

afrideva/smol-3b-GGUF

Text Generation • Updated Dec 25, 2023 • 49

afrideva/Astrea-RP-v1-3B-GGUF

Text Generation • Updated Dec 26, 2023 • 123 • 2

afrideva/MiniChat-2-3B-GGUF

Text Generation • Updated Dec 27, 2023 • 41 • 1

afrideva/Mixtral-GQA-400m-v2-GGUF

Text Generation • Updated Dec 27, 2023 • 70 • 1

afrideva/smol_llama-220M-GQA-GGUF

Text Generation • Updated Dec 27, 2023 • 109

afrideva/tinycodellama-1.3b-3k-GGUF

Text Generation • Updated Dec 27, 2023 • 36

afrideva/RocketZephyr-3b-GGUF

Text Generation • Updated Dec 27, 2023 • 26 • 1

afrideva/TinyLlama-1.1B-intermediate-step-1431k-3T-GGUF

Text Generation • Updated Dec 28, 2023 • 75 • 1

afrideva/tinycodellama-1.3b-5k-GGUF

Text Generation • Updated Dec 28, 2023 • 36

afrideva/gpt2-turkish-128-token-GGUF

Text Generation • Updated Dec 28, 2023 • 53

afrideva/gpt2-small-danish-GGUF

Text Generation • Updated Dec 28, 2023 • 76

afrideva/DialoGPT-medium-Oshiwambo-Bot-GGUF

Text Generation • Updated Dec 28, 2023 • 29

afrideva/Smol-Llama-101M-Chat-v1-GGUF

Text Generation • Updated Dec 29, 2023 • 97 • 3

afrideva/japanese-mistral-300m-base-GGUF

Text Generation • Updated Dec 29, 2023 • 45

afrideva/japanese-mistral-300m-instruction-GGUF

Text Generation • Updated Dec 29, 2023 • 48

afrideva/phi-2-code-instruct-GGUF

Text Generation • Updated Jan 16 • 49 • 1

afrideva/Llama-68M-Chat-v1-GGUF

Text Generation • Updated Jan 17 • 70 • 1

afrideva/Walter-Phi-GGUF

Text Generation • Updated Jan 17 • 53 • 1

afrideva/dolphin-2_6-phi-2_oasst2_chatML_V2-GGUF

Text Generation • Updated Jan 19 • 69 • 2