Spaces:
Running
on
Zero
A newer version of the Gradio SDK is available:
5.13.1
title: Intrinsic
emoji: 🐢
colorFrom: blue
colorTo: red
sdk: gradio
sdk_version: 5.0.1
app_file: app.py
pinned: false
license: cc-by-nc-sa-4.0
Intrinsic Image Decomposition
This space contains a demo for the following papers:
Colorful Diffuse Intrinsic Image Decomposition in the Wild, Chris Careaga and Yağız Aksoy, ACM Transactions on Graphics, 2024
Project | Paper | Supplementary | HF
Intrinsic Image Decomposition via Ordinal Shading, Chris Careaga and Yağız Aksoy, ACM Transactions on Graphics, 2023
Project | Paper | Video | Supplementary | Data | HF
We propose a method for generating high-resolution intrinsic image decompositions for in-the-wild images. Our method consists of multiple stages. We first estimate a grayscale shading layer using our ordinal shading pipeline. We then estimate low-resolution chromaticity information to account for colorful illumination effects while maintaining global consistency. Using this initial colorful decomposition, we estimate a high-resolution, sparse albedo layer. We show that our decomposition allows us to train a diffuse shading estimation network using only a single rendered indoor dataset.
Our estimated components unlock multiple illumination-aware editing operations such as per-pixel white balancing and specularity removal:
