Abstract:Lighting is a determining factor in photography that affects the style, expression of emotion, and even quality of images. Creating or finding satisfying lighting conditions, in reality, is laborious and time-consuming, so it is of great value to develop a technology to manipulate illumination in an image as post-processing. Although previous works have explored techniques based on the physical viewpoint for relighting images, extensive supervisions and prior knowledge are necessary to generate reasonable images, restricting the generalization ability of these works. In contrast, we take the viewpoint of image-to-image translation and implicitly merge ideas of the conventional physical viewpoint. In this paper, we present an Illumination-Aware Network (IAN) which follows the guidance from hierarchical sampling to progressively relight a scene from a single image with high efficiency. In addition, an Illumination-Aware Residual Block (IARB) is designed to approximate the physical rendering process and to extract precise descriptors of light sources for further manipulations. We also introduce a depth-guided geometry encoder for acquiring valuable geometry- and structure-related representations once the depth information is available. Experimental results show that our proposed method produces better quantitative and qualitative relighting results than previous state-of-the-art methods. The code and models are publicly available on

Single-image reflectance estimation for relighting by iterative soft grouping

An Approximate Shading Model with Detail Decomposition for Object Relighting

An Approximate Shading Model For Object Relighting

Segmentation-based reflectance recovery

A real-time global relighting algorithm

Image-based Relighting from a Sparse Set of Outdoor Images.

Improving reflectance estimation by BRDF-consistent region clustering

Photometric Stereo for General BRDFs via Reflection Sparsity Modeling

Estimating Illumination Parameters in Real Space with Application to Image Relighting

A New Radiosity Approach by Procedural Refinements for Realistic Image Sythesis

Relighting Abstracted Image Via Salient Edge-Guided Luminance Field Optimization.

Interactive Relighting with Dynamic BRDFs

Relighting with the Reflected Irradiance Field: Representation, Sampling and Reconstruction

Interactive Image Based Relighting With Physical Light Acquisition

ReDDLE-Net: Reflectance Decomposition for Directional Light Estimation

Face Re-Lighting From A Single Image Under Harsh Lighting Conditions

Designing An Illumination-Aware Network for Deep Image Relighting

Relighting with real incident light source

SVBRDF Reconstruction by Transferring Lighting Knowledge

LEIFR-Net: light estimation for implicit face relight network

Face Image Relighting Using Locally Constrained Global Optimization