Abstract:Single image reflection removal is inherently ambiguous, as both the reflection and transmission components requiring separation may follow natural image statistics. Existing methods attempt to address the issue by using various types of low-level and physics-based cues as sources of reflection signals. However, these cues are not universally applicable, since they are only observable in specific capture scenarios. This leads to a significant performance drop when test images do not align with their assumptions. In this paper, we aim to explore a novel flexible interactive reflection removal approach that leverages various forms of sparse human guidance, such as points and bounding boxes, as auxiliary high-level prior to achieve robust reflection removal. However, incorporating the raw user guidance naively into the existing reflection removal network does not result in performance gains. To this end, we innovatively transform raw user input into a unified form -- reflection masks using an Interactive Segmentation Foundation Model. Such a design absorbs the quintessence of the foundational segmentation model and flexible human guidance, thereby mitigating the challenges of reflection separations. Furthermore, to fully utilize user guidance and reduce user annotation costs, we design a mask-guided reflection removal network, comprising our proposed self-adaptive prompt block. This block adaptively incorporates user guidance as anchors and refines transmission features via cross-attention mechanisms. Extensive results on real-world images validate that our method demonstrates state-of-the-art performance on various datasets with the help of flexible and sparse user guidance. Our code and dataset will be publicly available here <a class="link-external link-https" href="https://github.com/ShawnChenn/FlexibleReflectionRemoval" rel="external noopener nofollow">this https URL</a>.

Specular Reflection Removal for Human Detection under Aquatic Environment

Robust Human Detection Within a Highly Dynamic Aquatic Environment in Real Time

Novel Region-Based Modeling for Human Detection Within Highly Dynamic Aquatic Environment

Human Detection and Tracking within Hostile Aquatic Environments

A Bayesian Framework for Robust Human Detection and Occlusion Handling Using Human Shape Model

Random Walks Colour Histogram Modification for Human Tracking.

Human Detection Based on Head and Shoulder Feature in Intelligent Surveillance System

A Framework for Foreground Detection in Complex Environments

Upper Body Human Detection and Segmentation in Low Contrast Video

An automatic drowning detection surveillance system for challenging outdoor pool environments

Pose Estimation for Swimmers in Video Surveillance

Human detection using depth information

Underwater Object Detection Based on Enhanced YOLO

Personnel Detection in Dark Aquatic Environments Based on Infrared Thermal Imaging Technology and an Improved YOLOv5s Model

Visual Detection And Feature Recognition Of Underwater Target Using A Novel Model-Based Method

Saliency Detection of Underwater Target Based on Spatial Probability

Towards Flexible Interactive Reflection Removal with Human Guidance

Underwater image enhancement by maximum-likelihood based adaptive color correction and robust scattering removal

Specular Detection and Removal for a Grayscale Image Based on the Markov Random Field

Human Detection for Night Surveillance using Adaptive Background Subtracted Image

Bayesian retinex underwater image enhancement