Abstract:As a common weather, rain streaks adversely degrade the image quality. Hence, removing rains from an image has become an important issue in the field. To handle such an ill-posed single image deraining task, in this paper, we specifically build a novel deep architecture, called rain convolutional dictionary network (RCDNet), which embeds the intrinsic priors of rain streaks and has clear interpretability. In specific, we first establish a RCD model for representing rain streaks and utilize the proximal gradient descent technique to design an iterative algorithm only containing simple operators for solving the model. By unfolding it, we then build the RCDNet in which every network module has clear physical meanings and corresponds to each operation involved in the algorithm. This good interpretability greatly facilitates an easy visualization and analysis on what happens inside the network and why it works well in inference process. Moreover, taking into account the domain gap issue in real scenarios, we further design a novel dynamic RCDNet, where the rain kernels can be dynamically inferred corresponding to input rainy images and then help shrink the space for rain layer estimation with few rain maps so as to ensure a fine generalization performance in the inconsistent scenarios of rain types between training and testing data. By end-to-end training such an interpretable network, all involved rain kernels and proximal operators can be automatically extracted, faithfully characterizing the features of both rain and clean background layers, and thus naturally lead to better deraining performance. Comprehensive experiments substantiate the superiority of our method, especially on its well generality to diverse testing scenarios and good interpretability for all its modules. Code is available in \emph{\url{<a class="link-external link-https" href="https://github.com/hongwang01/DRCDNet" rel="external noopener nofollow">this https URL</a>}}.

Rain removal via shrinkage of sparse codes and learned rain dictionary

Rain Removal via Shrinkage-Based Sparse Coding and Learned Rain Dictionary

Rain Detection and Removal Via Shrinkage-based Sparse Coding and Learned Rain Dictionary

Rain structure transfer using an exemplar rain image for synthetic rain image generation

Rain Streaks and Snowflakes Removal for Video Sequences Via Motion Compensation and Matrix Completion

Learning Dual Convolutional Dictionaries for Image De-raining

Rain Removal By Image Quasi-Sparsity Priors

Deep Joint Rain Detection and Removal from a Single Image

Scale-Free Single Image Deraining Via Visibility-Enhanced Recurrent Wavelet Learning

Joint Rain Detection and Removal via Iterative Region Dependent Multi-Task Learning.

A deraining with detail-recovery network via context aggregation

RCDNet: An Interpretable Rain Convolutional Dictionary Network for Single Image Deraining

Erase Or Fill? Deep Joint Recurrent Rain Removal And Reconstruction In Videos

MDeRainNet: An Efficient Neural Network for Rain Streak Removal from Macro-pixel Images

Closing the Loop: Joint Rain Generation and Removal via Disentangled Image Translation

Direction and Residual Awareness Curriculum Learning Network for Rain Streaks Removal

Joint Rain Detection and Removal from a Single Image with Contextualized Deep Networks.

Single Image Rain Removal Boosting Via Directional Gradient

Single image deraining via wide rectangular regional blocks and dual attention complementary enhancement network

Recurrent Squeeze-and-Excitation Context Aggregation Net for Single Image Deraining