Abstract:Images captured outdoors are often affected by rainy days, resulting in a severe deterioration in the visual quality of the captured images and a decrease in the performance of related applications. Therefore, single image deraining has attracted attention as a challenging research topic. Nowadays, there are two common deraining architectures in single image deraining. The first one is to restore the rain-free image by deducting rain streaks learned by the model from the rain image, but the background structure is easily mistaken for rain streaks and subtracted. The other one is to directly learn the clean background structure through the model using rain images, but it is difficult to completely remove the rain streaks due to the complexity of the information in images with rain. Therefore, current methods cannot balance rain streak removal and rain-free image background restoration in a single architecture and achieve good results. To address this issue, we propose a novel framework, namely, Context-Detail-Aware United Network (CDaUNet), which combines the above two architectures in this study. More specifically, we divide the restoration of the background structure of rain-free images and the learning of rain streaks into two independent sub-networks. The proposed Structure-Aware Rain Removal Network (SaRRN) is to learn the background structure in images to reconstruct clean rain-free images, whereas Detail-Aware Rain Streak Learning Network (DaRLN) is proposed to learn the details of rain streaks in images. Finally, we fuse the results generated by the two sub-networks through our designed Dual Architecture Fusion Network (DAFN) to reconstruct original rain images to effectively fuse the results of the two sub-networks. The experimental results show that CDaUNet achieves satisfactory performance in comparison with the state-of-the-art approaches included in rain streak removal and rain-free image structure restoration architectures on both synthetic and real image datasets, confirming the effectiveness of our method.

DAWN: Direction-aware Attention Wavelet Network for Image Deraining

Combining multiscale learning and attention mechanism densely connected network for single image deraining

Enhanced Attentive Generative Adversarial Network for Single-Image Deraining.

Single image deraining via wide rectangular regional blocks and dual attention complementary enhancement network

DRD-Net: Detail-recovery Image Deraining via Context Aggregation Networks

Residual Contextual Hourglass Network for Single-Image Deraining

Rain-Free and Residue Hand-in-Hand: A Progressive Coupled Network for Real-Time Image Deraining

Macroscopic-and-Microscopic Rain Streaks Disentanglement Network for Single-Image Deraining

Spatial Attentive Single-Image Deraining With a High Quality Real Rain Dataset

Combined with Pyramid Split Attention and Multi-Scale Feature Learning Network for Single Image Deraining

A deraining with detail-recovery network via context aggregation

MDeRainNet: An Efficient Neural Network for Rain Streak Removal from Macro-pixel Images

Scale-Free Single Image Deraining Via Visibility-Enhanced Recurrent Wavelet Learning

Direction-aware Feature-level Frequency Decomposition for Single Image Deraining

Decomposition Makes Better Rain Removal: An Improved Attention-Guided Deraining Network

Context-detail-aware United Network for Single Image Deraining

Subband Differentiated Learning Network for Rain Streak Removal

A Prior Guided Wavelet-Spatial Dual Attention Transformer Framework for Heavy Rain Image Restoration

Feature decoupling and reorganization network for single image deraining

A Coarse-to-Fine Multi-stream Hybrid Deraining Network for Single Image Deraining

Cross-domain attention-guided domain adaptive method for image real rain removal