Abstract:In computer vision tasks, the ability to remove rain from a single image is a crucial element to enhance the effectiveness of subsequent high-level tasks in rainy conditions. Recently, numerous data-driven single-image deraining techniques have emerged, primarily relying on paired images (i.e., in a supervised manner). However, when dealing with real deraining tasks, it is common to encounter unpaired images. In such scenarios, removing rain streaks in an unsupervised manner becomes a challenging task, as there are no constraints between images, resulting in suboptimal restoration results. In this paper, we introduce a new unsupervised single-image deraining method called SE-RRACycleGAN, which does not require a paired dataset for training and can effectively leverage the constrained transfer learning capability and cyclic structures inherent in CycleGAN. Since rain removal is closely associated with the analysis of texture features in an input image, we proposed a novel recurrent rain attentive module (RRAM) to enhance rain-related information detection by simultaneously considering both rainy and rain-free images. We also utilize the squeeze-and-excitation enhancement technique to the generator network to effectively capture spatial contextual information among channels. Finally, content loss is introduced to enhance the visual similarity between the input and generated images. Our method excels at removing numerous rain streaks, preserving a smooth background, and closely resembling the ground truth compared to other approaches, based on both quantitative and qualitative results, without the need for paired training images. Extensive experiments on synthetic and real-world datasets demonstrate that our approach shows superiority over most unsupervised state-of-the-art techniques, particularly on the Rain12 dataset (achieving a PSNR of 34.60 and an SSIM of 0.954) and real rainy images (achieving a PSNR of 34.17 and an SSIM of 0.953), and is highly competitive when compared to supervised methods. Moreover, the performance of our model is evaluated using RMSE, FSIM, MAE, and the correlation coefficient, achieving remarkable results that indicate a high degree of accuracy in rain removal and strong preservation of the original image's structural details.

Removing Rain Based On A Cycle Generative Adversarial Network

Enhanced Attentive Generative Adversarial Network for Single-Image Deraining.

Cycle-attention-derain: unsupervised rain removal with CycleGAN

Rain Streak Removal Via Dual Graph Convolutional Network

Image De-Raining Using a Conditional Generative Adversarial Network

SE-RRACycleGAN: Unsupervised Single-Image Deraining Using Squeeze-and-Excitation-Based Recurrent Rain-Attentive CycleGAN

Image Deraining Using Multi-Scale Aggregated Generator Network

DerainCycleGAN: Rain Attentive CycleGAN for Single Image Deraining and Rainmaking

Rain Streak Removal for Single Image via Kernel Guided CNN

DTDN: Dual-task De-raining Network

Removing Rain from Single Image Using Atrous U-Net and GAN

Rain-component-aware capsule-GAN for single image de-raining

Rain Streaks Removal for Single Image via Kernel-Guided Convolutional Neural Network

Single Image Deraining using Scale-Aware Multi-Stage Recurrent Network

A neural network approach to remove rain using reconstruction and feature losses

Combining multiscale learning and attention mechanism densely connected network for single image deraining

Gradient Information Guided Deraining with A Novel Network and Adversarial Training

No rain in the world: A novel residual deep attention network for single image rain removal

Single image rain removal using recurrent scale-guide networks

Recurrent Squeeze-and-Excitation Context Aggregation Net for Single Image Deraining

Removing Rain from Single Images Via a Deep Detail Network