Abstract:Single image reflection removal is inherently ambiguous, as both the reflection and transmission components requiring separation may follow natural image statistics. Existing methods attempt to address the issue by using various types of low-level and physics-based cues as sources of reflection signals. However, these cues are not universally applicable, since they are only observable in specific capture scenarios. This leads to a significant performance drop when test images do not align with their assumptions. In this paper, we aim to explore a novel flexible interactive reflection removal approach that leverages various forms of sparse human guidance, such as points and bounding boxes, as auxiliary high-level prior to achieve robust reflection removal. However, incorporating the raw user guidance naively into the existing reflection removal network does not result in performance gains. To this end, we innovatively transform raw user input into a unified form -- reflection masks using an Interactive Segmentation Foundation Model. Such a design absorbs the quintessence of the foundational segmentation model and flexible human guidance, thereby mitigating the challenges of reflection separations. Furthermore, to fully utilize user guidance and reduce user annotation costs, we design a mask-guided reflection removal network, comprising our proposed self-adaptive prompt block. This block adaptively incorporates user guidance as anchors and refines transmission features via cross-attention mechanisms. Extensive results on real-world images validate that our method demonstrates state-of-the-art performance on various datasets with the help of flexible and sparse user guidance. Our code and dataset will be publicly available here <a class="link-external link-https" href="https://github.com/ShawnChenn/FlexibleReflectionRemoval" rel="external noopener nofollow">this https URL</a>.

Reflection Separation Using Patch-Wise Sparse and Low-Rank Decomposition

Single Image Reflection Removal with Absorption Effect

Chromaticity-based separation of reflection components in a single image

PAR<SUP>2</SUP>Net: End-to-End Panoramic Image Reflection Removal

Panoramic Image Reflection Removal

Sparsity based reflection removal using external patch search

Toward a General Model for Reflection Recovery and Single Image Enhancement.

Robust Separation of Reflection from Multiple Images

Simple and Efficient Method for Specularity Removal in an Image

Reflection Scene Separation From A Single Image

Efficient Blind Separation Of Reflection Layers With Nonparametric Transformations

Towards Flexible Interactive Reflection Removal with Human Guidance

Region-Aware Reflection Removal with Unified Content and Gradient Priors

Location-aware Single Image Reflection Removal

Reflection Separation Using a Pair of Unpolarized and Polarized Images.

Revisiting Single Image Reflection Removal In the Wild

Unsupervised Single-Image Reflection Separation Using Perceptual Deep Image Priors

Semantic Guided Single Image Reflection Removal

Single image reflection removal via self-attention and local discrimination

Single image reflection removal via learning with multi-image constraints