Abstract:In this paper, we propose a deep neural network for single image reflection removal. More specifically, we design a convolutional-grid module and take it as the building block of a feature fusion pyramid. The module leverages the combination effect of the grid topology to create a rich ensemble of receptive fields. Embedding the modules into a pyramidal architecture further expands the coverage of receptive fields. Another benefit of the pyramid is to fuse the multi-scale features learned by the modules locating at the ascending and descending pathways. The rich diversity of features helps the neural network analyze the contexts around overlapping objects at various spatial ranges and harvest the cues for layer separation. The proposed work also exploits useful semantic cues from the hyper-column descriptors generated by a pre-trained VGG-19 model to reduce the ambiguity of layer separation. In light of the low correlation between background and reflection layers, we design a channel-correlation based conditional discriminator to penalize residual reflection. The discriminator uses channel-wise attention to screen the features that can distinguish real background images from estimated ones. This paper also presents a task-driven regularization strategy. The high sensitivity of semantic segmentation to reflection is exploited for assessing the completeness of reflection removal. Training with this regularization strategy can boost the performance of both reflection removal and high-level task. The comparison against state-of-the-art algorithms on four public benchmark datasets demonstrates that this work exhibits superior performance in handling the complex reflections in wild scenarios. The proposed network architecture is also applicable to haze removal, which is another ill-posed layer separation problem, and has shown encouraging performance.

Single Image Glare Removal Using Deep Convolutional Networks

Single Image Glare Removal Using Deep Convolutional Networks

Single image veiling glare removal

Deep Trident Decomposition Network for Single License Plate Image Glare Removal

Night Time Haze and Glow Removal using Deep Dilated Convolutional Network

Single Image Reflection Removal Using Deep Encoder-Decoder Network

GR-GAN: A unified adversarial framework for single image glare removal and denoising

Deep Retinex Network for Single Image Dehazing

You Only Look Yourself: Unsupervised and Untrained Single Image Dehazing Neural Network

Image Reflection Removal via Contextual Feature Fusion Pyramid and Task-Driven Regularization

From Coarse to Fine: A Two-Stage Network for Dense Haze removal

Single-image dehazing via depth-guided deep retinex decomposition

Rendering the Image of Glare Effect Based on Paired and Unpaired Dual Generative Adversarial Network

Fast User-Guided Single Image Reflection Removal Via Edge-Aware Cascaded Networks

A Generic Deep Architecture for Single Image Reflection Removal and Image Smoothing.

Single image mixed dehazing method based on numerical iterative model and DehazeNet

Single image reflection removal via learning with multi-image constraints

An end-to-end deep learning approach for real-time single image dehazing

Lightweight single image dehazing network with residual feature attention

Proximal Dehaze-Net: A Prior Learning-Based Deep Network For Single Image Dehazing

Improved Multiple-Image-Based Reflection Removal Algorithm Using Deep Neural Networks