Abstract: In this paper, we address a rain removal problem from a single image, even in the presence of heavy rain and rain streak accumulation. Our core ideas lie in the new rain image models and a novel deep learning architecture. We first modify an existing model comprising a rain streak layer and a background layer, by adding a binary map that locates rain streak regions. Second, we create a new model consisting of a component representing rain streak accumulation (where individual streaks cannot be seen, and thus visually similar to mist or fog), and another component representing various shapes and directions of overlapping rain streaks, which usually happen in heavy rain. Based on the first model, we develop a multi-task deep learning architecture that learns the binary rain streak map, the appearance of rain streaks, and the clean background, which is our ultimate output. The additional binary map is critically beneficial, since its loss function can provide additional strong information to the network. To handle rain streak accumulation (again, a phenomenon visually similar to mist or fog) and various shapes and directions of overlapping rain streaks, we propose a recurrent rain detection and removal network that removes rain streaks and clears up the rain accumulation iteratively and progressively. In each recurrence of our method, a new contextualized dilated network is developed to exploit regional contextual information and outputs better representation for rain detection. The evaluation on real images, particularly on heavy rain, shows the effectiveness of our novel models and architecture, outperforming the state-of-the-art methods significantly. Our codes and data sets will be publicly available.

The Method for Removing Rain in Multiple Images

A New Interactive Enhanced Method for Image with Poor Visibility

Removing rain and snow in a single image using guided filter

A New Cloud Removal Algorithm for Multi-Spectral Images

Single-image de-raining using joint filter and multi-scale deep alternate-connection dense network

Joint rain and atmospheric veil removal from single image

Single Image Rain Removal Based on Deep Learning and Symmetry Transform

See clearly on rainy days: Hybrid multiscale loss guided multi-feature fusion network for single image rain removal

A Rain Removal Method Using Chromatic Property For Image Sequence

An Improved Guidance Image Based Method to Remove Rain and Snow in a Single Image

Single Image De-Raining with High-Low Frequency Guidance

A Hierarchical Approach for Rain or Snow Removing in a Single Color Image

Joint Feature Based Rain Detection and Removal from Videos

Single-Image-Based Rain and Snow Removal Using Multi-guided Filter.

Deep joint rain and haze removal from single images

Single-image-based Rain Streak Removal Using Multidimensional Variational Mode Decomposition and Bilateral Filter.

Multi-Level Memory Compensation Network for Rain Removal via Divide-and-Conquer Strategy

Removing Rain from a Single Image via Discriminative Sparse Coding

A Method for Detection and Removal of Rain in Videos

Deep Joint Rain Detection and Removal from a Single Image

Rain Streaks and Snowflakes Removal for Video Sequences Via Motion Compensation and Matrix Completion