Abstract:In computer vision tasks, the ability to remove rain from a single image is a crucial element to enhance the effectiveness of subsequent high-level tasks in rainy conditions. Recently, numerous data-driven single-image deraining techniques have emerged, primarily relying on paired images (i.e., in a supervised manner). However, when dealing with real deraining tasks, it is common to encounter unpaired images. In such scenarios, removing rain streaks in an unsupervised manner becomes a challenging task, as there are no constraints between images, resulting in suboptimal restoration results. In this paper, we introduce a new unsupervised single-image deraining method called SE-RRACycleGAN, which does not require a paired dataset for training and can effectively leverage the constrained transfer learning capability and cyclic structures inherent in CycleGAN. Since rain removal is closely associated with the analysis of texture features in an input image, we proposed a novel recurrent rain attentive module (RRAM) to enhance rain-related information detection by simultaneously considering both rainy and rain-free images. We also utilize the squeeze-and-excitation enhancement technique to the generator network to effectively capture spatial contextual information among channels. Finally, content loss is introduced to enhance the visual similarity between the input and generated images. Our method excels at removing numerous rain streaks, preserving a smooth background, and closely resembling the ground truth compared to other approaches, based on both quantitative and qualitative results, without the need for paired training images. Extensive experiments on synthetic and real-world datasets demonstrate that our approach shows superiority over most unsupervised state-of-the-art techniques, particularly on the Rain12 dataset (achieving a PSNR of 34.60 and an SSIM of 0.954) and real rainy images (achieving a PSNR of 34.17 and an SSIM of 0.953), and is highly competitive when compared to supervised methods. Moreover, the performance of our model is evaluated using RMSE, FSIM, MAE, and the correlation coefficient, achieving remarkable results that indicate a high degree of accuracy in rain removal and strong preservation of the original image's structural details.

UnfairGAN: An Enhanced Generative Adversarial Network for Raindrop Removal from A Single Image

Enhanced Attentive Generative Adversarial Network for Single-Image Deraining.

M2GAN: A Multi-Stage Self-Attention Network for Image Rain Removal on Autonomous Vehicles

Attentive Generative Adversarial Network for Raindrop Removal from A Single Image

Denoising Adversarial Networks for Rain Removal and Reflection Removal.

SARain-GAN: Spatial Attention Residual UNet Based Conditional Generative Adversarial Network for Rain Streak Removal

A Deep Learning-Based Two-Branch Generative Adversarial Network for Image De-Raining

Image De-Raining Using a Conditional Generative Adversarial Network

Removing Rain from Single Image Using Atrous U-Net and GAN

Gradient Information Guided Deraining with A Novel Network and Adversarial Training

Removing Rain Based On A Cycle Generative Adversarial Network

Image Deraining Using Multi-Scale Aggregated Generator Network

DerainCycleGAN: Rain Attentive CycleGAN for Single Image Deraining and Rainmaking

Cycle-attention-derain: unsupervised rain removal with CycleGAN

Cross-domain attention-guided domain adaptive method for image real rain removal

End-to-end Inception-Unet based Generative Adversarial Networks for Snow and Rain Removals

SE-RRACycleGAN: Unsupervised Single-Image Deraining Using Squeeze-and-Excitation-Based Recurrent Rain-Attentive CycleGAN

Residual Adaptive Mask Generative Adversarial Network for Image Raindrop Removal

Unsupervised single image dehazing with generative adversarial network

Deep single image deraining using an asymmetric cyclic generative and adversarial framework

Why current rain denoising models fail on CycleGAN created rain images in autonomous driving