Abstract:In computer vision tasks, the ability to remove rain from a single image is a crucial element to enhance the effectiveness of subsequent high-level tasks in rainy conditions. Recently, numerous data-driven single-image deraining techniques have emerged, primarily relying on paired images (i.e., in a supervised manner). However, when dealing with real deraining tasks, it is common to encounter unpaired images. In such scenarios, removing rain streaks in an unsupervised manner becomes a challenging task, as there are no constraints between images, resulting in suboptimal restoration results. In this paper, we introduce a new unsupervised single-image deraining method called SE-RRACycleGAN, which does not require a paired dataset for training and can effectively leverage the constrained transfer learning capability and cyclic structures inherent in CycleGAN. Since rain removal is closely associated with the analysis of texture features in an input image, we proposed a novel recurrent rain attentive module (RRAM) to enhance rain-related information detection by simultaneously considering both rainy and rain-free images. We also utilize the squeeze-and-excitation enhancement technique to the generator network to effectively capture spatial contextual information among channels. Finally, content loss is introduced to enhance the visual similarity between the input and generated images. Our method excels at removing numerous rain streaks, preserving a smooth background, and closely resembling the ground truth compared to other approaches, based on both quantitative and qualitative results, without the need for paired training images. Extensive experiments on synthetic and real-world datasets demonstrate that our approach shows superiority over most unsupervised state-of-the-art techniques, particularly on the Rain12 dataset (achieving a PSNR of 34.60 and an SSIM of 0.954) and real rainy images (achieving a PSNR of 34.17 and an SSIM of 0.953), and is highly competitive when compared to supervised methods. Moreover, the performance of our model is evaluated using RMSE, FSIM, MAE, and the correlation coefficient, achieving remarkable results that indicate a high degree of accuracy in rain removal and strong preservation of the original image's structural details.

Cycle-attention-derain: unsupervised rain removal with CycleGAN

DerainCycleGAN: Rain Attentive CycleGAN for Single Image Deraining and Rainmaking

SE-RRACycleGAN: Unsupervised Single-Image Deraining Using Squeeze-and-Excitation-Based Recurrent Rain-Attentive CycleGAN

Enhanced Attentive Generative Adversarial Network for Single-Image Deraining.

Removing Rain Based On A Cycle Generative Adversarial Network

Combining multiscale learning and attention mechanism densely connected network for single image deraining

Cross-domain attention-guided domain adaptive method for image real rain removal

Deep single image deraining using an asymmetric cyclic generative and adversarial framework

Deep Single Image Deraining using An Asymetric Cycle Generative and Adversarial Framework

Spatial Attentive Single-Image Deraining With a High Quality Real Rain Dataset

Single image deraining via wide rectangular regional blocks and dual attention complementary enhancement network

Removing Raindrops and Rain Streaks in One Go

Single image rain removal using recurrent scale-guide networks

Cycle Contrastive Adversarial Learning for Unsupervised image Deraining

SARain-GAN: Spatial Attention Residual UNet Based Conditional Generative Adversarial Network for Rain Streak Removal

Single image deraining using multi‐stage and multi‐scale joint channel coordinate attention fusion network

No rain in the world: A novel residual deep attention network for single image rain removal

Single Image Deraining: From Model-Based to Data-Driven and Beyond

Recurrent Multi-Frame Deraining: Combining Physics Guidance and Adversarial Learning

Single image deraining using scale constraint iterative update network

High-Level Task-Driven Single Image Deraining: Segmentation in Rainy Days.