Neilblaze (Pratyay Banerjee)

upvoted 2 papers 11 days ago

An Image is Worth 32 Tokens for Reconstruction and Generation

Paper • 2406.07550 • Published 18 days ago • 53

Transformers meet Neural Algorithmic Reasoners

Paper • 2406.09308 • Published 16 days ago • 43

upvoted 2 papers 15 days ago

VideoMamba: State Space Model for Efficient Video Understanding

Paper • 2403.06977 • Published Mar 11 • 24

VideoPrism: A Foundational Visual Encoder for Video Understanding

Paper • 2402.13217 • Published Feb 20 • 19

upvoted 7 papers 17 days ago

Similarity is Not All You Need: Endowing Retrieval Augmented Generation with Multi Layered Thoughts

Paper • 2405.19893 • Published 30 days ago • 26

Kaleido Diffusion: Improving Conditional Diffusion Models with Autoregressive Latent Modeling

Paper • 2405.21048 • Published 29 days ago • 11

Parrot: Multilingual Visual Instruction Tuning

Paper • 2406.02539 • Published 25 days ago • 35

ShareGPT4Video: Improving Video Understanding and Generation with Better Captions

Paper • 2406.04325 • Published 23 days ago • 69

upvoted a collection 21 days ago

MoEs papers reading list

Collection

44 items • Updated 16 days ago • 127

upvoted a paper 22 days ago

RecurrentGemma: Moving Past Transformers for Efficient Open Language Models

Paper • 2404.07839 • Published Apr 11 • 40

upvoted an article about 1 month ago

Article

PaliGemma – Google's Cutting-Edge Open Vision Language Model

May 14

• 156

upvoted 3 papers about 1 month ago

LoRA Learns Less and Forgets Less

Paper • 2405.09673 • Published May 15 • 79

FIFO-Diffusion: Generating Infinite Videos from Text without Training

Paper • 2405.11473 • Published May 19 • 53

Your Transformer is Secretly Linear

Paper • 2405.12250 • Published May 19 • 143

upvoted 2 papers about 2 months ago

StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generation

Paper • 2405.01434 • Published May 2 • 49

PLLaVA : Parameter-free LLaVA Extension from Images to Videos for Video Dense Captioning

Paper • 2404.16994 • Published Apr 25 • 33

upvoted 2 articles 2 months ago

Article

Welcome Llama 3 - Meta's new open LLM

Apr 18

• 253

Article

Introducing Idefics2: A Powerful 8B Vision-Language Model for the community

Apr 15

• 144

upvoted 3 papers 2 months ago

ControlNet++: Improving Conditional Controls with Efficient Consistency Feedback

Paper • 2404.07987 • Published Apr 11 • 46

TransformerFAM: Feedback attention is working memory

Paper • 2404.09173 • Published Apr 14 • 42

Seeing and Hearing: Open-domain Visual-Audio Generation with Diffusion Latent Aligners

Paper • 2402.17723 • Published Feb 27 • 16

upvoted an article 3 months ago

Article

CodeGemma - an official Google release for code LLMs

Apr 9

• 98

upvoted 6 papers 3 months ago

Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models

Paper • 2403.18814 • Published Mar 27 • 42

Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction

Paper • 2404.02905 • Published Apr 3 • 61

Ferret-UI: Grounded Mobile UI Understanding with Multimodal LLMs

Paper • 2404.05719 • Published Apr 8 • 57

Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention

Paper • 2404.07143 • Published Apr 10 • 97

Fast High-Resolution Image Synthesis with Latent Adversarial Diffusion Distillation

Paper • 2403.12015 • Published Mar 18 • 60

AnimateDiff-Lightning: Cross-Model Diffusion Distillation

Paper • 2403.12706 • Published Mar 19 • 17

upvoted 8 papers 4 months ago

A Human-Inspired Reading Agent with Gist Memory of Very Long Contexts

Paper • 2402.09727 • Published Feb 15 • 35

FiT: Flexible Vision Transformer for Diffusion Model

Paper • 2402.12376 • Published Feb 19 • 48

The FinBen: An Holistic Financial Benchmark for Large Language Models

Paper • 2402.12659 • Published Feb 20 • 13

Improving Robustness for Joint Optimization of Camera Poses and Decomposed Low-Rank Tensorial Radiance Fields

Paper • 2402.13252 • Published Feb 20 • 17

Synthetic Data (Almost) from Scratch: Generalized Instruction Tuning for Language Models

Paper • 2402.13064 • Published Feb 20 • 46

Neural Network Diffusion

Paper • 2402.13144 • Published Feb 20 • 94

SDXL-Lightning: Progressive Adversarial Diffusion Distillation

Paper • 2402.13929 • Published Feb 21 • 26

Coercing LLMs to do and reveal (almost) anything

Paper • 2402.14020 • Published Feb 21 • 12

upvoted 2 papers 5 months ago

Diffuse to Choose: Enriching Image Conditioned Inpainting in Latent Diffusion Models for Virtual Try-All

Paper • 2401.13795 • Published Jan 24 • 64

Masked Audio Generation using a Single Non-Autoregressive Transformer

Paper • 2401.04577 • Published Jan 9 • 39

upvoted 3 papers 6 months ago

City-on-Web: Real-time Neural Rendering of Large-scale Scenes on the Web

Paper • 2312.16457 • Published Dec 27, 2023 • 13

Unsupervised Universal Image Segmentation

Paper • 2312.17243 • Published Dec 28, 2023 • 18

Generative Image Dynamics

Paper • 2309.07906 • Published Sep 14, 2023 • 52

upvoted 7 papers 7 months ago

Drivable 3D Gaussian Avatars

Paper • 2311.08581 • Published Nov 14, 2023 • 44

The Chosen One: Consistent Characters in Text-to-Image Diffusion Models

Paper • 2311.10093 • Published Nov 16, 2023 • 55

AutoStory: Generating Diverse Storytelling Images with Minimal Human Effort

Paper • 2311.11243 • Published Nov 19, 2023 • 14

Make Pixels Dance: High-Dynamic Video Generation

Paper • 2311.10982 • Published Nov 18, 2023 • 65

NeuroPrompts: An Adaptive Framework to Optimize Prompts for Text-to-Image Generation

Paper • 2311.12229 • Published Nov 20, 2023 • 26

MagicDance: Realistic Human Dance Video Generation with Motions & Facial Expressions Transfer

Paper • 2311.12052 • Published Nov 18, 2023 • 29

FusionFrames: Efficient Architectural Aspects for Text-to-Video Generation Pipeline

Paper • 2311.13073 • Published Nov 22, 2023 • 53

upvoted 2 collections 7 months ago

Seamless Communication

Collection

A significant step towards removing language barriers through expressive, fast and high-quality AI translation. • 16 items • Updated Jan 16 • 129

Latent Consistency Model Demos

Collection

Latent Consistency Models for Stable Diffusion • 8 items • Updated Nov 12, 2023 • 24

upvoted a paper 9 months ago

In-Context Pretraining: Language Modeling Beyond Document Boundaries

Paper • 2310.10638 • Published Oct 16, 2023 • 26

upvoted 6 papers 10 months ago

ProPainter: Improving Propagation and Transformer for Video Inpainting

Paper • 2309.03897 • Published Sep 7, 2023 • 24

Large Language Models as Optimizers

Paper • 2309.03409 • Published Sep 7, 2023 • 72

NExT-GPT: Any-to-Any Multimodal LLM

Paper • 2309.05519 • Published Sep 11, 2023 • 75

PhotoVerse: Tuning-Free Image Customization with Text-to-Image Diffusion Models

Paper • 2309.05793 • Published Sep 11, 2023 • 50

InstructDiffusion: A Generalist Modeling Interface for Vision Tasks

Paper • 2309.03895 • Published Sep 7, 2023 • 11

SportsSloMo: A New Benchmark and Baselines for Human-centric Video Frame Interpolation

Paper • 2308.16876 • Published Aug 31, 2023 • 6

Pratyay Banerjee

AI & ML interests

Organizations

Neilblaze's activity

PaliGemma – Google's Cutting-Edge Open Vision Language Model

Welcome Llama 3 - Meta's new open LLM

Introducing Idefics2: A Powerful 8B Vision-Language Model for the community

CodeGemma - an official Google release for code LLMs