Abstract:Clear images are generally desirable in high-level computer vision algorithms which are mostly deployed outdoors. However, affected by the changeable weather in the real world, images are inevitably contaminated by rain streaks. Deep convolutional neural networks (CNNs) have shown significant potential in rain streaks removal. The performance of most existing CNN-based deraining methods is often enhanced by stacking vanilla convolutional layers and some other methods use dilated convolution which can only model local pixel relations to provide the necessary but limited receptive field. Therefore, long-range contextual information is rarely considered for this specific task, thus, deraining a single image remains challenging problem. To address the above problem, an effective residual deep attention network (RDANet) for single image rain removal is proposed. Specifically, we design a strong basic unit that contains dilated convolution, spatial and channel attention module (SCAM) simultaneously. As contextual information is very important for rain removal, the proposed basic unit can capture global long-distance dependencies among pixels in feature maps and model feature relations across channels. Compared with a single dilated convolution, the spatial and channel attention enhance the feature expression ability of the network. Moreover, some previous works have proven that the no-rain information in a rain image will be missing during deraining. To enrich the detailed information in the clean images, we present a residual feature processing group (RFPG) that contains several source skip connections to inject rainy shallow source information into each basic unit. In summary, our model can effectively handle complicated long rain streaks in spatial and the outputs of the network can retain most of the details of the original rain images. Experiments demonstrate the superiority of our RDANet over state-of-the-art methods in terms of both quantitative metrics and visual quality on both synthetic and real rainy images.

TA-DNN—two stage attention-based deep neural network for single image rain removal

Combining multiscale learning and attention mechanism densely connected network for single image deraining

A Model-driven Deep Neural Network for Single Image Rain Removal

DTDN: Dual-task De-raining Network

No rain in the world: A novel residual deep attention network for single image rain removal

Single-image raindrop removal using concurrent channel-spatial attention and long-short skip connections

New Single Image Rain Removal Algorithm Based on Dual Parallel Branch Residual Overlay Network

RAiA-Net: A Multi-Stage Network With Refined Attention in Attention Module for Single Image Deraining

Enhanced Attentive Generative Adversarial Network for Single-Image Deraining.

Combined with Pyramid Split Attention and Multi-Scale Feature Learning Network for Single Image Deraining

DPAFNet:Dual Path Attention Fusion Network for Single Image Deraining

Rainy day image semantic segmentation based on two-stage progressive network

Joint Rain Detection and Removal from a Single Image with Contextualized Deep Networks.

Deep Joint Rain Detection and Removal from a Single Image

NASNet: A Neuron Attention Stage-by-Stage Net for Single Image Deraining

Recurrent Squeeze-and-Excitation Context Aggregation Net for Single Image Deraining

Single Image Deraining using Scale-Aware Multi-Stage Recurrent Network

Rain Removal from a Single Image Using Refined Inception ResNet v2

Single Image Deraining Via Scale-space Invariant Attention Neural Network.

MDeRainNet: An Efficient Neural Network for Rain Streak Removal from Macro-pixel Images