Abstract:We propose a simple yet effective reflection-free cue for robust reflection removal from a pair of flash and ambient (no-flash) images. The reflection-free cue exploits a flash-only image obtained by subtracting the ambient image from the corresponding flash image in raw data space. The flash-only image is equivalent to an image taken in a dark environment with only a flash on. This flash-only image is visually reflection-free and thus can provide robust cues to infer the reflection in the ambient image. Since the flash-only image usually has artifacts, we further propose a dedicated model that not only utilizes the reflection-free cue but also avoids introducing artifacts, which helps accurately estimate reflection and transmission. Our experiments on real-world images with various types of reflection demonstrate the effectiveness of our model with reflection-free flash-only cues: our model outperforms state-of-the-art reflection removal approaches by more than 5.23dB in PSNR. We extend our approach to handheld photography to address the misalignment between the flash and no-flash pair. With misaligned training data and the alignment module, our aligned model outperforms our previous version by more than 3.19dB in PSNR on a misaligned dataset. We also study using linear RGB images as training data. Our source code and dataset are publicly available at <a class="link-external link-https" href="https://github.com/ChenyangLEI/flash-reflection-removal" rel="external noopener nofollow">this https URL</a>.

Flash Matting.

Easy Matting - A Stroke Based Approach for Continuous Image Matting

Automatic blur region segmentation approach using image matting

Patch-Based Approach for the Fusion of Low-Light Image Pairs

Energy Matting

Deep Quantised Portrait Matting

A Markov Random Field Model-Based Approach to Natural Image Matting

A Late Fusion CNN for Digital Matting

MRF matting on complex images

A Survey on Natural Image Matting with Closed-Form Solutions.

Fast Natural Image Matting in Perceptual Color Space

Image Matting from a Physical Perspective

Adaptive Background Matting Using Background Matching

Coarse Semantic Guided Alpha Matting Via Simultaneous Foreground and Background Estimation

Attention-guided Temporally Coherent Video Object Matting

Flash-Splat: 3D Reflection Removal with Flash Cues and Gaussian Splats

A Survey on Digital Matting

Quick matting: A matting method based on pixel spread and propagation

Robust Reflection Removal with Flash-only Cues in the Wild

Oriented Poisson Matting

Matting Anything