Abstract:Single-image layer separation targets to decompose the observed image into two independent components in terms of different application demands. It is known that many vision and multimedia applications can be (re)formulated as a separation problem. Due to the fundamentally ill-posed natural of these separations, existing methods are inclined to investigate model priors on the separated components elaborately. Nevertheless, it is knotty to optimize the cost function with complicated model regularizations. Effectiveness is greatly conceded by the settled iteration mechanism, and the adaption cannot be guaranteed due to the poor data fitting. What is more, for a universal framework, the most taxing point is that one type of visual cue cannot be shared with different tasks. To partly overcome the weaknesses mentioned earlier, we delve into a generic optimization unrolling technique to incorporate deep architectures into iterations for adaptive image layer separation. First, we propose a general energy model with implicit priors, which is based on maximum a posterior, and employ the extensively accepted alternating direction method of multiplier to determine our elementary iteration mechanism. By unrolling with one general residual architecture prior and one task-specific prior, we attain a straightforward, flexible, and data-dependent image separation framework successfully. We apply our method to four different tasks, including single-image-rain streak removal, high-dynamic-range tone mapping, low-light image enhancement, and single-image reflection removal. Extensive experiments demonstrate that the proposed method is applicable to multiple tasks and outperforms the state of the arts by a large margin qualitatively and quantitatively.

Unrolled Optimization with Deep Priors for Intrinsic Image Decomposition

Revisiting Deep Intrinsic Image Decompositions.

Revisiting Deep Image Smoothing and Intrinsic Image Decomposition.

Unrolling Plug-and-Play Network for Hyperspectral Unmixing

A Deep Optimization Approach for Image Deconvolution.

Knowledge-Driven Deep Unrolling for Robust Image Layer Separation.

A Deep Unfolding Network Based on Intrinsic Image Decomposition for Pansharpening

Sparse Intrinsic Decomposition and Applications.

Intrinsic Image Decomposition by Pursuing Reflectance Image.

Deep Intrinsic Image Decomposition Using Joint Parallel Learning.

Learning Deep Optimizer For Blind Image Deconvolution

Unsupervised Intrinsic Image Decomposition Using Internal Self-Similarity Cues.

Enhanced Residual Dense Intrinsic Network for Intrinsic Image Decomposition

Learning Relighting and Intrinsic Decomposition in Neural Radiance Fields

Single Image Layer Separation via Deep Admm Unrolling

Deep Proximal Unrolling: Algorithmic Framework, Convergence Analysis and Applications.

Reflectance Edge Guided Networks for Detail-Preserving Intrinsic Image Decomposition.

DPDU-Net: Double Prior Deep Unrolling Network for Pansharpening

Intrinsic Face Image Decomposition With Human Face Priors

Single Scene Image Editing Based on Deep Intrinsic Decomposition

Sequential Deep Unrolling with Flow Priors for Robust Video Deraining.