Abstract:Deraining is a significant and fundamental computer vision task, aiming to remove the rain streaks and accumulations in an image or video captured under a rainy day. Existing deraining methods usually make heuristic assumptions of the rain model, which compels them to employ complex optimization or iterative refinement for high recovery quality. This, however, leads to time-consuming methods and affects the effectiveness for addressing rain patterns deviated from from the assumptions. In this paper, we propose a simple yet efficient deraining method by formulating deraining as a predictive filtering problem without complex rain model assumptions. Specifically, we identify spatially-variant predictive filtering (SPFilt) that adaptively predicts proper kernels via a deep network to filter different individual pixels. Since the filtering can be implemented via well-accelerated convolution, our method can be significantly efficient. We further propose the EfDeRain+ that contains three main contributions to address residual rain traces, multi-scale, and diverse rain patterns without harming the efficiency. First, we propose the uncertainty-aware cascaded predictive filtering (UC-PFilt) that can identify the difficulties of reconstructing clean pixels via predicted kernels and remove the residual rain traces effectively. Second, we design the weight-sharing multi-scale dilated filtering (WS-MS-DFilt) to handle multi-scale rain streaks without harming the efficiency. Third, to eliminate the gap across diverse rain patterns, we propose a novel data augmentation method (i.e., RainMix) to train our deep models. By combining all contributions with sophisticated analysis on different variants, our final method outperforms baseline methods on four single-image deraining datasets and one video deraining dataset in terms of both recovery quality and speed.

Beyond Synthetic Data: A Blind Deraining Quality Assessment Metric Towards Authentic Rain Image

Subjective and Objective De-Raining Quality Assessment Towards Authentic Rain Image

Enhanced Attentive Generative Adversarial Network for Single-Image Deraining.

Spatial Attentive Single-Image Deraining With a High Quality Real Rain Dataset

Towards Unified Deep Image Deraining: A Survey and A New Benchmark

Cross-domain attention-guided domain adaptive method for image real rain removal

DAWN: Direction-aware Attention Wavelet Network for Image Deraining

Residual Contextual Hourglass Network for Single-Image Deraining

Q-DNN: A Quality-Aware Deep Neural Network for Blind Assessment of Enhanced Images.

Visibility and Distortion Measurement for No-Reference Dehazed Image Quality Assessment via Complex Contourlet Transform

Not Just Streaks: Towards Ground Truth for Single Image Deraining

High-Level Task-Driven Single Image Deraining: Segmentation in Rainy Days.

Uncertainty-Aware Cascaded Dilation Filtering for High-Efficiency Deraining

From Sky to the Ground: A Large-scale Benchmark and Simple Baseline Towards Real Rain Removal

Beyond Monocular Deraining: Parallel Stereo Deraining Network Via Semantic Prior

DRD-Net: Detail-recovery Image Deraining via Context Aggregation Networks

Decomposition Makes Better Rain Removal: An Improved Attention-Guided Deraining Network

Deep Superpixel-Based Network For Blind Image Quality Assessment

Single Image Deraining: From Model-Based to Data-Driven and Beyond

Single Image Deraining Via Detail-Guided Efficient Channel Attention Network

Rethinking Image Deraining Via Text-guided Detail Reconstruction