Under 10b iq4_nl gguf - a hellork Collection

hellork 's Collections

text-to-image <=8B gguf

LLAVA Vision Models

Under 10b iq4_xs gguf

Under 10b iq4_nl gguf

Under 10b iq4_nl gguf

updated Feb 9

Under 10B GGUFs Non-linear Quantized to try on 4GiB VRAM. Leaderboard https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard

hellork/Qwen2-7B-Instruct-IQ4_NL-GGUF

Text Generation • Updated Sep 17, 2024 • 8
SixOpen/Nous-Capybara-7B-V1.9-IQ4_NL-GGUF

Updated May 31, 2024 • 7
SixOpen/Phi-3-mini-4k-instruct-IQ4_NL-imat.gguf

Text Generation • Updated May 22, 2024 • 36
n3shelter/Peach-9B-8k-Roleplay-IQ4_XS-GGUF

Text Generation • Updated Aug 11, 2024 • 9 • 1
aifeifei798/llama3-8B-DarkIdol-2.0-Uncensored-IQ4_NL-GGUF

Updated Jul 1, 2024 • 37 • 1
Trisert/Meta-Llama-3.1-8B-Instruct-IQ4_NL-GGUF

Text Generation • Updated Aug 18, 2024 • 19 • 1
Jianping746/Llama3.1-8B-Chinese-Chat-IQ4_XS-GGUF

Text Generation • Updated Jul 27, 2024 • 14
DarqueDante/Llama-3.1-8B-Stheno-v3.4-IQ4_XS-GGUF

Updated Aug 19, 2024 • 8
herrkobold/SauerkrautLM-1.5b-IQ4_XS-GGUF

Updated Jul 24, 2024 • 38
GrimsenClory/Meta-Llama-3.1-8B-Instruct-IQ4_XS-GGUF

Text Generation • Updated Jul 26, 2024 • 36
Niansuh/Llama-3-Groq-8B-Tool-Use-IQ4_NL-GGUF

Updated Jul 23, 2024 • 29
Cran-May/openbuddy-llama3.1-8b-v22.3-131k-IQ4_XS-GGUF

Text Generation • Updated Aug 18, 2024 • 1
matrixportal/Meta-Llama-3.1-8B-Instruct-IQ4_NL-GGUF

Text Generation • Updated Aug 2, 2024 • 34
askmyteapot/Meta-Llama-3-70B-Instruct-abliterated-v3.5-IQ4_XS

Updated Jun 3, 2024 • 41
Amensia/Qwen2-1.5B-Instruct-IQ4_NL-GGUF

Text Generation • Updated Aug 7, 2024 • 5
float-trip/drama-llama-3-iq4_xs

Updated Apr 27, 2024 • 1
NikolayKozloff/Dorna-Llama3-8B-Instruct-IQ4_XS-GGUF

Updated Jun 12, 2024 • 21 • 1
Cran-May/Gemma-2-9B-Chinese-Chat-IQ4_XS-GGUF

Text Generation • Updated Jul 2, 2024 • 59
SixOpen/Meta-Llama-3-8B-Instruct-IQ4_NL-GGUF

Text Generation • Updated Jun 11, 2024 • 41
NikolayKozloff/Dorna-Llama3-8B-Instruct-IQ4_NL-GGUF

Updated Jun 12, 2024 • 37 • 1
gate369/Phi-3-mini-128k-instruct-IQ4_XS-GGUF

Text Generation • Updated Jun 12, 2024 • 12
Alex01837178373/gemma-2-9b-it-abliterated-IQ4_NL-GGUF

Updated Jul 15, 2024 • 16
lucasdozie/gemma-2-2b-it-IQ4_NL-GGUF

Text Generation • Updated Aug 14, 2024 • 5
hanchungshin/Meta-Llama-3.1-8B-Instruct-IQ4_NL-GGUF

Text Generation • Updated Aug 7, 2024 • 35
ElMater06/Mistral-7B-Instruct-v0.3-IQ4_NL-GGUF

Updated Jun 19, 2024 • 21 • 1
NikolayKozloff/L3-8B-Lunaris-v1-IQ4_NL-GGUF

Updated Jun 28, 2024 • 42 • 1
NikolayKozloff/Llama-3-Instruct-Neurona-8b-v2-IQ4_NL-GGUF

Text Generation • Updated Jul 2, 2024 • 42 • 1
NikolayKozloff/llama3-turbcat-instruct-8b-IQ4_NL-GGUF

Updated Jun 21, 2024 • 22 • 1
NikolayKozloff/tabula-8b-IQ4_NL-GGUF

Updated Jun 23, 2024 • 5 • 1
qnixsynapse/Meta-Llama-3-8B-Instruct-IQ4_XS-GGUF

Text Generation • Updated Jul 12, 2024 • 114
qnixsynapse/gemma-2-9b-it-IQ4_XS-GGUF

Text Generation • Updated Jul 16, 2024 • 8
Joseph717171/Llama-3.1-SuperNova-Lite-8.0B-OQ8_0-F32.EF32.IQ4_K-Q8_0-GGUF

Updated Jan 21 • 429 • 2
DarwinAnim8or/mergekit-model_stock-ffibbcs-IQ4_NL-GGUF

Updated Aug 26, 2024 • 17 • 1
bunnycore/Llama-3.1-8B-OmniMatrix-IQ4_NL-GGUF

Updated Sep 13, 2024 • 27 • 1
bunnycore/HyperLlama-3.1-8B-IQ4_NL-GGUF

Updated Sep 4, 2024 • 5 • 1
DarwinAnim8or/mergekit-model_stock-ffibbcs-IQ4_XS-GGUF

Updated Aug 28, 2024 • 24 • 1
sehiro/EvoLLM-JP-A-v1-7B-IQ4_XS-GGUF

Updated Sep 15, 2024 • 9 • 1
Joseph717171/Gemma-2-2b-it-OQ8_0-F32.EF32.IQ4_K_M-8_0-GGUF

Updated Sep 23, 2024 • 108 • 1
utterlygreat/omost-dolphin-2.9-llama3-8b-IQ4_XS-GGUF

Updated Jul 10, 2024 • 20
bunnycore/Crazy-Qwen2-7b-IQ4_NL-GGUF

Updated Sep 1, 2024 • 4
mradermacher/FinMatcha-3B-Instruct-i1-GGUF

Updated Dec 13, 2024 • 265
tiiuae/Falcon3-7B-Instruct

Text Generation • Updated Jan 10 • 53.7k • 63