Abstract:Shadow removal is to restore shadow regions to their shadow-free counterparts while leaving non-shadow regions unchanged. State-of-the-art shadow removal methods train deep neural networks on collected shadow & shadow-free image pairs, which are desired to complete two distinct tasks via shared weights, i.e., data restoration for shadow regions and identical mapping for non-shadow regions. We find that these two tasks exhibit poor compatibility, and using shared weights for these two tasks could lead to the model being optimized towards only one task instead of both during the training process. Note that such a key issue is not identified by existing deep learning-based shadow removal methods. To address this problem, we propose to handle these two tasks separately and leverage the identical mapping results to guide the shadow restoration in an iterative manner. Specifically, our method consists of three components: an identical mapping branch (IMB) for non-shadow regions processing, an iterative de-shadow branch (IDB) for shadow regions restoration based on identical results, and a smart aggregation block (SAB). The IMB aims to reconstruct an image that is identical to the input one, which can benefit the restoration of the non-shadow regions without explicitly distinguishing between shadow and non-shadow regions. Utilizing the multi-scale features extracted by the IMB, the IDB can effectively transfer information from non-shadow regions to shadow regions progressively, facilitating the process of shadow removal. The SAB is designed to adaptive integrate features from both IMB and IDB. Moreover, it generates a finely tuned soft shadow mask that guides the process of removing shadows. Extensive experiments demonstrate our method outperforms all the state-of-the-art shadow removal approaches on the widely used shadow removal datasets.

Single-Image Shadow Removal Using Deep Learning: A Comprehensive Survey

Unveiling Deep Shadows: A Survey on Image and Video Shadow Detection, Removal, and Generation in the Era of Deep Learning

From Synthesis to Removal: A Deep Learning-Based Framework for Shadow Removal in High-Resolution Remote Sensing Images

Image shadow removal via multi-scale deep Retinex decomposition

Shadow Removal by a Lightness-Guided Network With Training on Unpaired Data

Depth-Aware Shadow Removal

Efficient Model-Driven Network for Shadow Removal

Shadow Removal Via Global Residual Free Unet and Shadow Generation

Learning Restoration is Not Enough: Transfering Identical Mapping for Single-Image Shadow Removal

UnShadowNet: Illumination critic guided contrastive learning for shadow removal

ShadowFormer: Global Context Helps Image Shadow Removal

Learning to Remove Shadows from a Single Image

Structure-Informed Shadow Removal Networks

SoftShadow: Leveraging Penumbra-Aware Soft Masks for Shadow Removal

A Survey of Single Image Rain Removal Based on Deep Learning

Effective Shadow Removal Via Multi-Scale Image Decomposition

Diff-Shadow: Global-guided Diffusion Model for Shadow Removal

Deep Learning-Based Light-Field Image Restoration and Enhancement:A Survey(Invited)

S2Net: Shadow Mask-Based Semantic-Aware Network for Single-Image Shadow Removal

Shadow-Aware Dynamic Convolution for Shadow Removal.

Single-image shadow detection and removal using paired regions