Abstract:Severe weather conditions, such as rain and snow, adversely affect the visual quality of images captured under such conditions, thus rendering them useless for further usage and sharing. In addition, such degraded images drastically affect the performance of vision systems. Hence, it is important to address the problem of single image de-raining. However, the inherent ill-posed nature of the problem presents several challenges. We attempt to leverage powerful generative modeling capabilities of the recently introduced conditional generative adversarial networks (CGAN) by enforcing an additional constraint that the de-rained image must be indistinguishable from its corresponding ground truth clean image. The adversarial loss from GAN provides additional regularization and helps to achieve superior results. In addition to presenting a new approach to de-rain images, we introduce a new refined loss function and architectural novelties in the generator–discriminator pair for achieving improved results. The loss function is aimed at reducing artifacts introduced by GANs and ensure better visual quality. The generator sub-network is constructed using the recently introduced densely connected networks, whereas the discriminator is designed to leverage global and local information to decide if an image is real/fake. Based on this, we propose a novel single image de-raining method called image de-raining conditional generative adversarial network (ID-CGAN) that considers quantitative, visual, and also discriminative performance into the objective function. The experiments evaluated on synthetic and real images show that the proposed method outperforms many recent state-of-the-art single image de-raining methods in terms of quantitative and visual performances. Furthermore, the experimental results evaluated on object detection datasets using the Faster-RCNN also demonstrate the effectiveness of proposed method in improving the detection performance on ima-es degraded by rain.

Generating Clear Images From Images With Distortions Caused by Adverse Weather Using Generative Adversarial Networks

Image De-Raining Using a Conditional Generative Adversarial Network

Enhanced Attentive Generative Adversarial Network for Single-Image Deraining.

Restoring Vision in Adverse Weather Conditions With Patch-Based Denoising Diffusion Models

Why current rain denoising models fail on CycleGAN created rain images in autonomous driving

LiDAR Point Cloud Augmentation for Adverse Conditions Using Conditional Generative Model

Generating Photo-realistic Images from LiDAR Point Clouds with Generative Adversarial Networks

Enhancing Autonomous Vehicle Perception in Adverse Weather through Image Augmentation during Semantic Segmentation Training

A Deep Learning-Based Two-Branch Generative Adversarial Network for Image De-Raining

AdvRain: Adversarial Raindrops to Attack Camera-based Smart Vision Systems

Potential Auto-driving Threat: Universal Rain-removal Attack

Image Deraining Using Multi-Scale Aggregated Generator Network

Attentive Generative Adversarial Network for Raindrop Removal from A Single Image

Mastering adverse weather: a two-stage approach for robust semantic segmentation in autonomous driving

Photographic Visualization of Weather Forecasts with Generative Adversarial Networks

Removing Rain from Single Image Using Atrous U-Net and GAN

ART-SS: An Adaptive Rejection Technique for Semi-Supervised restoration for adverse weather-affected images

A neural network approach to remove rain using reconstruction and feature losses

Adverse Weather Image Translation with Asymmetric and Uncertainty-aware GAN

UnfairGAN: An Enhanced Generative Adversarial Network for Raindrop Removal from A Single Image

Always Clear Days: Degradation Type and Severity Aware All-In-One Adverse Weather Removal