Under 10b iq4_nl gguf
Collection
Under 10B GGUFs Non-linear Quantized to try on 4GiB VRAM. Leaderboard https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard
โข
41 items
โข
Updated
โข
2