Abstract:Clear images are generally desirable in high-level computer vision algorithms which are mostly deployed outdoors. However, affected by the changeable weather in the real world, images are inevitably contaminated by rain streaks. Deep convolutional neural networks (CNNs) have shown significant potential in rain streaks removal. The performance of most existing CNN-based deraining methods is often enhanced by stacking vanilla convolutional layers and some other methods use dilated convolution which can only model local pixel relations to provide the necessary but limited receptive field. Therefore, long-range contextual information is rarely considered for this specific task, thus, deraining a single image remains challenging problem. To address the above problem, an effective residual deep attention network (RDANet) for single image rain removal is proposed. Specifically, we design a strong basic unit that contains dilated convolution, spatial and channel attention module (SCAM) simultaneously. As contextual information is very important for rain removal, the proposed basic unit can capture global long-distance dependencies among pixels in feature maps and model feature relations across channels. Compared with a single dilated convolution, the spatial and channel attention enhance the feature expression ability of the network. Moreover, some previous works have proven that the no-rain information in a rain image will be missing during deraining. To enrich the detailed information in the clean images, we present a residual feature processing group (RFPG) that contains several source skip connections to inject rainy shallow source information into each basic unit. In summary, our model can effectively handle complicated long rain streaks in spatial and the outputs of the network can retain most of the details of the original rain images. Experiments demonstrate the superiority of our RDANet over state-of-the-art methods in terms of both quantitative metrics and visual quality on both synthetic and real rainy images.

Single image rain streaks removal: a review and an exploration

A Survey on Rain Removal from Video and Single Image

No rain in the world: A novel residual deep attention network for single image rain removal

Structural Residual Learning for Single Image Rain Removal

An investigation of rain streak removal models based on expert experience and deep learning

Clearing the Skies: A Deep Network Architecture for Single-Image Rain Removal

Recurrent Squeeze-and-Excitation Context Aggregation Net for Single Image Deraining

Single image deraining via wide rectangular regional blocks and dual attention complementary enhancement network

Single-Image Deraining via Recurrent Residual Multiscale Networks

Deep Joint Rain Detection and Removal from a Single Image

Removing Raindrops and Rain Streaks in One Go

A Framework of Single-Image Deraining Method Based on Analysis of Rain Characteristics

Spatial Attentive Single-Image Deraining With a High Quality Real Rain Dataset

Rain Streak Removal for Single Image via Kernel Guided CNN

A Survey of Single Image Rain Removal Based on Deep Learning

Joint Rain Detection and Removal from a Single Image with Contextualized Deep Networks.

Single Image De-Raining with High-Low Frequency Guidance

MDeRainNet: An Efficient Neural Network for Rain Streak Removal from Macro-pixel Images

Scale-Free Single Image Deraining Via Visibility-Enhanced Recurrent Wavelet Learning

Rain Streak Removal Via Dual Graph Convolutional Network