Collections

-

Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generation

Paper • 2410.13848 • Published Oct 17, 2024 • 32
DreamVideo-2: Zero-Shot Subject-Driven Video Customization with Precise Motion Control

Paper • 2410.13830 • Published Oct 17, 2024 • 24
VisionZip: Longer is Better but Not Necessary in Vision Language Models

Paper • 2412.04467 • Published Dec 5, 2024 • 105

1

LongVILA: Scaling Long-Context Visual Language Models for Long Videos

Paper • 2408.10188 • Published Aug 19, 2024 • 51
xGen-MM (BLIP-3): A Family of Open Large Multimodal Models

Paper • 2408.08872 • Published Aug 16, 2024 • 98
Building and better understanding vision-language models: insights and future directions

Paper • 2408.12637 • Published Aug 22, 2024 • 124
Show-o: One Single Transformer to Unify Multimodal Understanding and Generation

Paper • 2408.12528 • Published Aug 22, 2024 • 51

Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generation

DreamVideo-2: Zero-Shot Subject-Driven Video Customization with Precise Motion Control

VisionZip: Longer is Better but Not Necessary in Vision Language Models

LongVILA: Scaling Long-Context Visual Language Models for Long Videos

xGen-MM (BLIP-3): A Family of Open Large Multimodal Models

Building and better understanding vision-language models: insights and future directions

Show-o: One Single Transformer to Unify Multimodal Understanding and Generation

LLM Pruning and Distillation in Practice: The Minitron Approach

TableBench: A Comprehensive and Complex Benchmark for Table Question Answering

To Code, or Not To Code? Exploring Impact of Code in Pre-training

Open-FinLLMs: Open Multimodal Large Language Models for Financial Applications

A Closer Look into Mixture-of-Experts in Large Language Models

VisionZip: Longer is Better but Not Necessary in Vision Language Models

p-MoD: Building Mixture-of-Depths MLLMs via Progressive Ratio Decay

ReMoE: Fully Differentiable Mixture-of-Experts with ReLU Routing

Multimodal Pathway: Improve Transformers with Irrelevant Data from Other Modalities

CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs

xGen-VideoSyn-1: High-fidelity Text-to-Video Synthesis with Compressed Representations

Law of Vision Representation in MLLMs

iVideoGPT: Interactive VideoGPTs are Scalable World Models

Meteor: Mamba-based Traversal of Rationale for Large Language and Vision Models

An Introduction to Vision-Language Modeling

Matryoshka Multimodal Models

What matters when building vision-language models?

An Introduction to Vision-Language Modeling

DeMamba: AI-Generated Video Detection on Million-Scale GenVideo Benchmark

Scaling Up Your Kernels: Large Kernel Design in ConvNets towards Universal Representations

MobileCLIP: Fast Image-Text Models through Multi-Modal Reinforced Training

DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model

A Study of Autoregressive Decoders for Multi-Tasking in Computer Vision

Sigmoid Loss for Language Image Pre-Training

LoRA+: Efficient Low Rank Adaptation of Large Models

The FinBen: An Holistic Financial Benchmark for Large Language Models

TofuEval: Evaluating Hallucinations of LLMs on Topic-Focused Dialogue Summarization

TrustLLM: Trustworthiness in Large Language Models

EVA-CLIP-18B: Scaling CLIP to 18 Billion Parameters

Vision Superalignment: Weak-to-Strong Generalization for Vision Foundation Models

ScreenAI: A Vision-Language Model for UI and Infographics Understanding

EfficientViT-SAM: Accelerated Segment Anything Model Without Performance Loss