Pretam Ray's picture

2 4 7

Pretam Ray

Pretam

·

raypretam

AI & ML interests

NLP

Recent Activity

published a model 20 days ago

Pretam/t5-small-finetuned-xsum

upvoted an article 8 months ago

Making LLMs even more accessible with bitsandbytes, 4-bit quantization and QLoRA

reacted to vladbogo's post with 👍 11 months ago

A recent paper titled "ShortGPT: Layers in Large Language Models are More Redundant Than You Expect" proposes a simple and effective approach to pruning Large Language Models (LLMs) by removing redundant layers. Key points: * Discovers significant redundancy across layers in LLMs, with some layers playing a negligible role for the final performance. * Defines a new metric called Block Influence (BI) to quantify the importance of each layer in an LLM. * Removes layers with low BI scores, achieving up to 25% reduction in parameters and computation while maintaining 92% of the LLM's performance. Congrats to the authors for their work! Paper: https://huggingface.co/papers/2403.03853

View all activity

Organizations

Pretam's activity

liked a Space 12 months ago

Promptsource

Explore and create prompts for datasets

liked a model 12 months ago

CohereForAI/aya-101

Text2Text Generation • Updated Mar 31, 2024 • 3.82k • 632

liked a model about 1 year ago

facebook/xlm-v-base

Fill-Mask • Updated Feb 8, 2023 • 9.97k • 39

liked a model almost 2 years ago

THUDM/chatglm-6b

Updated Aug 4, 2024 • 4.51k • 2.85k

liked a Space about 2 years ago

Aiornot

liked a model about 2 years ago

ai4bharat/IndicBART

Text2Text Generation • Updated Aug 7, 2022 • 2.79k • • 30

liked a model over 2 years ago

hakurei/waifu-diffusion

Text-to-Image • Updated Jul 5, 2023 • 5.92k • • 2.42k