Abstract:In this paper, we propose an image matting framework called Salient Image Matting to estimate the per-pixel opacity value of the most salient foreground in an image. To deal with a large amount of semantic diversity in images, a trimap is conventionally required as it provides important guidance about object semantics to the matting process. However, creating a good trimap is often expensive and timeconsuming. The SIM framework simultaneously deals with the challenge of learning a wide range of semantics and salient object types in a fully automatic and an end to end manner. Specifically, our framework is able to produce accurate alpha mattes for a wide range of foreground objects and cases where the foreground class, such as human, appears in a very different context than the train data directly from an RGB input. This is done by employing a salient object detection model to produce a trimap of the most salient object in the image in order to guide the matting model about higher-level object semantics. Our framework leverages large amounts of coarse annotations coupled with a heuristic trimap generation scheme to train the trimap prediction network so it can produce trimaps for arbitrary foregrounds. Moreover, we introduce a multi-scale fusion architecture for the task of matting to better capture finer, low-level opacity semantics. With high-level guidance provided by the trimap network, our framework requires only a fraction of expensive matting data as compared to other automatic methods while being able to produce alpha mattes for a diverse range of inputs. We demonstrate our framework on a range of diverse images and experimental results show our framework compares favourably against state of art matting methods without the need for a trimap

Alpha Estimation in Perceptual Color Space

Fast Natural Image Matting in Perceptual Color Space

Skin Detection Using Color, Texture and Space Information

Estimation of Spectral Reflectance of Object Surfaces with the Consideration of Perceptual Color Space

Estimation of Illuminant Chromaticity by Linear Fitting Approach

Estimation of Skin Pigment Concentration by Simulating Skin Color

Colorimetric Characterization of Scanner by Measures of Perceptual Color Error.

Spectral Characterization of A Color Scanner by Adaptive Estimation

Unsupervised Salient Object Segmentation From Color Images

A Closed-Form Solution to Natural Image Matting

Coarse Semantic Guided Alpha Matting Via Simultaneous Foreground and Background Estimation

Interactive space-time video matting approach

Perceptually Based Approach To Color Quantization

Estimation of the Perceptual Color Gamut on Displays.

Image matting trimap optimization by ant colony algorithm

Perceptually-based color difference for complex images

Salient Image Matting

New Algorithm for Calculating Perceived Colour Difference of Images

Disentangled Image Matting

Adaptive Color Quantization Based on Perceptive Edge Protection.