Abstract:Intrinsic image analysis plays an important role for image understanding, since it can provide accurate reflectance, shape and illumination information of the scene. However, intrinsic image analysis is an ill-posed problem which need to apply extra constrains for the decomposition of reflectance image and shading image from a single image. Recently deep neural networks are introduced for intrinsic image analysis, which can produce two intrinsic components simultaneously. In fact, the mutually exclusive relationship between reflectance image and shading image is not only a constraint for decomposition but also can improve the decomposition results. However, this relationship is always omitted in the current networks. In order to address this problem, we propose a novel deep network called as Cascaded Quotient Network (CasQNet) for intrinsic image decomposition. The CasQNet consists of two sub-networks: a Pyramid Mini-U-Net (PyNet) that specifically extracts the reflectance image in multi-scale and a Shading Optimization Network (SoNet) that optimizes the resulting shading. These two sub-networks are cascaded by a quotient operation, which directly enforces the mutually exclusive relationship between reflectance image and shading image in the network architecture. In PyNet, the task of reconstructing reflectance image is achieved by a series of nested multi-scale U-Nets, which simplified the learning task for each U-Net. SoNet is designed to address the unsmooth and blur problems of extreme points caused by the quotient operation. PyNet and SoNet are trained alternately and finally jointed in cascaded structure. Furthermore, we combine multiple loss functions, which consist of data loss, correlation loss and reconstruction loss, for improving the learning effectiveness. To evaluate our proposed algorithm, extensive experiments are performed on three datasets, i.e., ShapeNet, BOLD Surface and MIT Intrinsic Image datasets. Qualitative and quantitative results show that our model achieves the best performance compared to the state-of-the-art methods.

Non-Local Color Compensation Network for Intrinsic Image Decomposition

Intrinsic Image Transformation via Scale Space Decomposition

FDN: Feature Decoupling Network for Head Pose Estimation.

Unsupervised Intrinsic Image Decomposition Using Internal Self-Similarity Cues.

CasQNet: Intrinsic Image Decomposition Based on Cascaded Quotient Network

Deep Intrinsic Image Decomposition Using Joint Parallel Learning.

Sparse Intrinsic Decomposition and Applications.

Self-Supervised Intrinsic Image Decomposition Network Considering Reflectance Consistency

Intrinsic image extraction based on deconvolutional neural networks

Intrinsic Image Decomposition Using Color Invariant Edge

Hyperspectral Image Reconstruction from RGB Input Through Highlighting Intrinsic Properties

Intrinsic Image Decomposition via Ordinal Shading

Revisiting Deep Intrinsic Image Decompositions.

Intrinsic Image Decomposition Using Point Cloud Representation

PIE-Net: Photometric Invariant Edge Guided Network for Intrinsic Image Decomposition

A Decomposition-based Network for Non-uniform Illuminated Retinal Image Enhancement

Learning Intrinsic Image Decomposition by Deep Neural Network with Perceptual Loss

Color Naming Guided Intrinsic Image Decomposition.

Hyperspectral Intrinsic Image Decomposition Based on Physical Prior-Driven Unsupervised Learning

Enhanced Residual Dense Intrinsic Network for Intrinsic Image Decomposition

Reflectance Edge Guided Networks for Detail-Preserving Intrinsic Image Decomposition.