Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Sign Up
yanghaojin 
posted an update May 26
Post
896
Dear community,

Please check our recent blog post, "GPU Poor Savior: Revolutionizing Low-Bit Open Source LLMs and Cost-Effective Edge Computing". A cheaper and more efficient SFT scheme for quantized LLMs is provided.

https://huggingface.co/blog/NicoNico/green-bit-llm

In this post