Hugging Face's logo
Nicholas Kluge Corrêa's picture
75 6 27

Nicholas Kluge Corrêa PRO

nicholasKluge
metacritical's profile picture Althayr's profile picture cnmoro's profile picture
·
https://nkluge-correa.github.io/

AI & ML interests

AI Ethics and AI Safety

Recent Activity

updated a model about 22 hours ago
nicholasKluge/Aira-OPT-125M
new activity 9 days ago
AiresPucrs/bert-base-wikitext:Adding `safetensors` variant of this model
reacted to samuellimabraz's post with 👍 10 days ago
I wrote a article on Parameter-Efficient Fine-Tuning (PEFT), exploring techniques for efficient fine-tuning in LLMs, their implementations, and variations. The study is based on the article "Scaling Down to Scale Up: A Guide to Parameter-Efficient Fine-Tuning" and the PEFT library integrated with Hugging Face's Transformers. Article: https://huggingface.co/blog/samuellimabraz/peft-methods Notebook: https://colab.research.google.com/drive/1B9RsKLMa8SwTxLsxRT8g9OedK10zfBEP?usp=sharing Collection: https://huggingface.co/collections/samuellimabraz/service-summary-6793ccfe774073328ea9f8df Analyzed methods: - Adapters: Soft Prompts (Prompt Tuning, Prefix Tuning, P-tuning), IA³. - Reparameterization: LoRA, QLoRA, LoHa, LoKr, X-LoRA, Intrinsic SAID, and variations of initializations (PiSSA, OLoRA, rsLoRA, DoRA). - Selective Tuning: BitFit, DiffPruning, FAR, FishMask. I'm starting out in generative AI, I have more experience with computer vision and robotics. Just sharing here 🤗
View all activity

Organizations

AI Robotics Ethics Society (PUCRS)'s profile picture Tucano's profile picture

Collections 2

Papers 4