Unsloth 4-bit Dynamic Quants Collection Unsloths Dynamic 4bit Quants selectively skips quantizing certain parameters; greatly improving accuracy while only using <10% more VRAM than BnB 4bit • 7 items • Updated 8 days ago • 20
Llama 3.3 (All Versions) Collection Meta's new Llama 3.3 (70B) model in all formats. Includes GGUF, 4-bit bnb and original versions. • 3 items • Updated 15 days ago • 27
view post Post 1410 I uploaded GGUFs, 4bit bitsandbytes and full 16bit precision weights for Llama 3.3 70B Instruct are here: unsloth/llama-33-all-versions-67535d7d994794b9d7cf5e9fYou can also finetune Llama 3.3 70B in under 48GB of VRAM with Unsloth! GGUFs: unsloth/Llama-3.3-70B-Instruct-GGUFBnB 4bit: unsloth/Llama-3.3-70B-Instruct-bnb-4bit16bit: unsloth/Llama-3.3-70B-Instruct See translation 1 reply · 👍 4 4 🤗 4 4 + Reply