Abstract:Severe weather conditions, such as rain and snow, adversely affect the visual quality of images captured under such conditions, thus rendering them useless for further usage and sharing. In addition, such degraded images drastically affect the performance of vision systems. Hence, it is important to address the problem of single image de-raining. However, the inherent ill-posed nature of the problem presents several challenges. We attempt to leverage powerful generative modeling capabilities of the recently introduced conditional generative adversarial networks (CGAN) by enforcing an additional constraint that the de-rained image must be indistinguishable from its corresponding ground truth clean image. The adversarial loss from GAN provides additional regularization and helps to achieve superior results. In addition to presenting a new approach to de-rain images, we introduce a new refined loss function and architectural novelties in the generator–discriminator pair for achieving improved results. The loss function is aimed at reducing artifacts introduced by GANs and ensure better visual quality. The generator sub-network is constructed using the recently introduced densely connected networks, whereas the discriminator is designed to leverage global and local information to decide if an image is real/fake. Based on this, we propose a novel single image de-raining method called image de-raining conditional generative adversarial network (ID-CGAN) that considers quantitative, visual, and also discriminative performance into the objective function. The experiments evaluated on synthetic and real images show that the proposed method outperforms many recent state-of-the-art single image de-raining methods in terms of quantitative and visual performances. Furthermore, the experimental results evaluated on object detection datasets using the Faster-RCNN also demonstrate the effectiveness of proposed method in improving the detection performance on ima-es degraded by rain.

Modeling Cloud Reflectance Fields using Conditional Generative Adversarial Networks

3D-Aware Image Synthesis Via Learning Structural and Textural Representations

A Spatial Weather Generator Based on Conditional Deep Convolution Generative Adversarial Nets (Cdcgan)

Points2Pix: 3D Point-Cloud to Image Translation using conditional Generative Adversarial Networks

A conditional Generative Adversarial network model for the Weather4Cast 2024 Challenge

Artificial Intelligence Based Cloud Distributor (AI-CD): Probing Low Cloud Distribution with a Conditional Generative Adversarial Network

Retrieving Vertical Cloud Radar Reflectivity from MODIS Cloud Products with CGAN: An Evaluation for Different Cloud Types and Latitudes

Cloud Removal in Satellite Images Using Spatiotemporal Generative Networks

Conditional Denoising of Remote Sensing Imagery Using Cycle-Consistent Deep Generative Models

Hierarchical-level rain image generative model based on GAN

Cloud removal from satellite imagery using multispectral edge-filtered conditional generative adversarial networks

Filmy Cloud Removal on Satellite Imagery with Multispectral Conditional Generative Adversarial Nets

Image De-Raining Using a Conditional Generative Adversarial Network

Further analysis of cGAN: A system for Generative Deep Learning Post-processing of Precipitation

Photographic Visualization of Weather Forecasts with Generative Adversarial Networks

Renewable Scenario Generation under Extreme Meteorological Conditions Via Improved Conditional Generative Adversarial Networks

Design of CGAN Models for Multispectral Reconstruction in Remote Sensing

Conditional Generation from Unconditional Diffusion Models using Denoiser Representations

Local Turbulence Generation Using Conditional Generative Adversarial Networks Toward Reynolds-averaged Navier-Stokes Modeling

Training and Tuning Generative Neural Radiance Fields for Attribute-Conditional 3D-Aware Face Generation

Algorithmic Hallucinations of Near-Surface Winds: Statistical Downscaling with Generative Adversarial Networks to Convection-Permitting Scales