Abstract:Images captured outdoors are often affected by rainy days, resulting in a severe deterioration in the visual quality of the captured images and a decrease in the performance of related applications. Therefore, single image deraining has attracted attention as a challenging research topic. Nowadays, there are two common deraining architectures in single image deraining. The first one is to restore the rain-free image by deducting rain streaks learned by the model from the rain image, but the background structure is easily mistaken for rain streaks and subtracted. The other one is to directly learn the clean background structure through the model using rain images, but it is difficult to completely remove the rain streaks due to the complexity of the information in images with rain. Therefore, current methods cannot balance rain streak removal and rain-free image background restoration in a single architecture and achieve good results. To address this issue, we propose a novel framework, namely, Context-Detail-Aware United Network (CDaUNet), which combines the above two architectures in this study. More specifically, we divide the restoration of the background structure of rain-free images and the learning of rain streaks into two independent sub-networks. The proposed Structure-Aware Rain Removal Network (SaRRN) is to learn the background structure in images to reconstruct clean rain-free images, whereas Detail-Aware Rain Streak Learning Network (DaRLN) is proposed to learn the details of rain streaks in images. Finally, we fuse the results generated by the two sub-networks through our designed Dual Architecture Fusion Network (DAFN) to reconstruct original rain images to effectively fuse the results of the two sub-networks. The experimental results show that CDaUNet achieves satisfactory performance in comparison with the state-of-the-art approaches included in rain streak removal and rain-free image structure restoration architectures on both synthetic and real image datasets, confirming the effectiveness of our method.

UniCoRN: A Unified Conditional Image Repainting Network

Conditional Image Repainting.

UCTGAN: Diverse Image Inpainting Based on Unsupervised Cross-Space Translation

Image Inpainting Based on Interactive Separation Network and Progressive Reconstruction Algorithm

LuminAIRe: Illumination-Aware Conditional Image Repainting for Lighting-Realistic Generation

Improving reference-based image colorization for line arts via feature aggregation and contrastive learning

Interactive Separation Network for Image Inpainting

Uni-paint: A Unified Framework for Multimodal Image Inpainting with Pretrained Diffusion Model

UniReal: Universal Image Generation and Editing via Learning Real-world Dynamics

An Adaptive Iterative Inpainting Method with More Information Exploration

UPainting: Unified Text-to-Image Diffusion Generation with Cross-modal Guidance

C3Net: Compound Conditioned ControlNet for Multimodal Content Generation

Learning Contextual Transformer Network for Image Inpainting

Cross-Stitched Multi-task Dual Recursive Networks for Unified Single Image Deraining and Desnowing

UniPaint: Unified Space-time Video Inpainting via Mixture-of-Experts

CoRRN: Cooperative Reflection Removal Network

High-Resolution Image Harmonization via Collaborative Dual Transformations

UNet-like network fused swin transformer and CNN for semantic image synthesis

Image Inpainting with Contrastive Relation Network

Image Inpainting via Correlated Multi-Resolution Feature Projection

Context-detail-aware United Network for Single Image Deraining