Abstract:Shadow generation aims to generate a plausible shadow for the inserted foreground object in a composite image. Besides the composite image and the associated mask of the inserted foreground object, existing methods also require a mask of all background objects as well as their shadows as an auxiliary input, which is laborious in practical applications. Meanwhile, most existing methods use a linear illumination transformation to darken the shadow region, which is prone to produce unrealistic shadows especially when background illumination is complex. To address these problems, this paper proposes an automatic shadow generation method, which avoids the laborious acquisition of the background object masks while harmonizing the shadow region to achieve plausible shadow effects. Specifically, to implicitly exploit background illumination to infer the shadow shape of the inserted foreground object, we first propose a Hierarchy Attention U-Net (HAU-Net) to sequentially build global interactions between the foreground object and background across spatial and channel dimensions. Since the spatial-variant property of the shadow, we formulate shadow harmonization as an exposure fusion problem and propose an Illumination-Aware Fusion Network (IFNet), which uses an improved illumination model with a double linear transformation to produce multiple under-exposure images of the shadow region. IFNet then learns pixel-wise fusion kernels that consider the local smoothness of the shadow to fuse the composite image with these under-exposure images to generate the realistic shadow of the foreground object. Extensive experiments on the DESOBA and Shadow-AR datasets demonstrate that our method achieves state-of-the-art performance for shadow generation on both the BOS and BOS-free test images.

Shadow Generation with Decomposed Mask Prediction and Attentive Shadow Filling

Shadow Generation for Composite Image in Real-World Scenes

Shadow Generation for Composite Image Using Diffusion model

Automatic Shadow Generation Via Exposure Fusion

Attention Res-Unet: an Efficient Shadow Detection Algorithm

When Masked Image Modeling Meets Source-free Unsupervised Domain Adaptation: Dual-Level Masked Network for Semantic Segmentation

Image Composition Method Based on a Spatial Position Analysis Network

DESOBAv2: Towards Large-scale Real-world Dataset for Shadow Generation

Towards Ghost-free Shadow Removal via Dual Hierarchical Aggregation Network and Shadow Matting GAN

Foreground Harmonization and Shadow Generation for Composite Image

Shadow-Aware Dynamic Convolution for Shadow Removal.

ShadowMover: Automatically Projecting Real Shadows onto Virtual Object

Shadow-aware Decomposed Transformer Network for Shadow Detection and Removal

A Shadow Detection Algorithm Based on Multiscale Spatial Attention Mechanism for Aerial Remote Sensing Images

Bijective Mapping Network for Shadow Removal

SoftShadow: Leveraging Penumbra-Aware Soft Masks for Shadow Removal

Depth-Aware Shadow Removal

Densely Cascaded Shadow Detection Network Via Deeply Supervised Parallel Fusion

SSN: Soft Shadow Network for Image Compositing

Mask-ShadowNet: Toward Shadow Removal Via Masked Adaptive Instance Normalization

A Shadow Detection Method for Retaining Key Objects in Complex Scenes.