Abstract:As a common weather, rain streaks adversely degrade the image quality. Hence, removing rains from an image has become an important issue in the field. To handle such an ill-posed single image deraining task, in this paper, we specifically build a novel deep architecture, called rain convolutional dictionary network (RCDNet), which embeds the intrinsic priors of rain streaks and has clear interpretability. In specific, we first establish a RCD model for representing rain streaks and utilize the proximal gradient descent technique to design an iterative algorithm only containing simple operators for solving the model. By unfolding it, we then build the RCDNet in which every network module has clear physical meanings and corresponds to each operation involved in the algorithm. This good interpretability greatly facilitates an easy visualization and analysis on what happens inside the network and why it works well in inference process. Moreover, taking into account the domain gap issue in real scenarios, we further design a novel dynamic RCDNet, where the rain kernels can be dynamically inferred corresponding to input rainy images and then help shrink the space for rain layer estimation with few rain maps so as to ensure a fine generalization performance in the inconsistent scenarios of rain types between training and testing data. By end-to-end training such an interpretable network, all involved rain kernels and proximal operators can be automatically extracted, faithfully characterizing the features of both rain and clean background layers, and thus naturally lead to better deraining performance. Comprehensive experiments substantiate the superiority of our method, especially on its well generality to diverse testing scenarios and good interpretability for all its modules. Code is available in \emph{\url{<a class="link-external link-https" href="https://github.com/hongwang01/DRCDNet" rel="external noopener nofollow">this https URL</a>}}.

Semi-supervised Single Image Deraining with Discrete Wavelet Transform.

Semi-Supervised Image Deraining Using Knowledge Distillation

DAWN: Direction-aware Attention Wavelet Network for Image Deraining

Spatial Attentive Single-Image Deraining With a High Quality Real Rain Dataset

Combining multiscale learning and attention mechanism densely connected network for single image deraining

A Coarse-to-Fine Multi-stream Hybrid Deraining Network for Single Image Deraining

Online-updated High-order Collaborative Networks for Single Image Deraining

Detail-recovery Image Deraining via Dual Sample-augmented Contrastive Learning

Physical Model Guided Deep Image Deraining

Single Image Deraining: From Model-Based to Data-Driven and Beyond

An Efficient Single Image De-Raining Model With Decoupled Deep Networks

Macroscopic-and-Microscopic Rain Streaks Disentanglement Network for Single-Image Deraining

Combined with Pyramid Split Attention and Multi-Scale Feature Learning Network for Single Image Deraining

High-Level Task-Driven Single Image Deraining: Segmentation in Rainy Days.

Scale-Free Single Image Deraining Via Visibility-Enhanced Recurrent Wavelet Learning

Single-Image Deraining via Recurrent Residual Multiscale Networks

Semi-Supervised Video Deraining with Dynamical Rain Generator

An Effective Two-Branch Model-Based Deep Network for Single Image Deraining

Single image deraining via wide rectangular regional blocks and dual attention complementary enhancement network

RCDNet: An Interpretable Rain Convolutional Dictionary Network for Single Image Deraining

A Model-driven Deep Neural Network for Single Image Rain Removal