Abstract:Extracting accurate foregrounds from natural images benefits many downstream applications such as film production and augmented reality. However, the furry characteristics and various appearance of the foregrounds, e.g., animal and portrait, challenge existing matting methods, which usually require extra user inputs such as trimap or scribbles. To resolve these problems, we study the distinct roles of semantics and details for image matting and decompose the task into two parallel sub-tasks: high-level semantic segmentation and low-level details matting. Specifically, we propose a novel Glance and Focus Matting network (GFM), which employs a shared encoder and two separate decoders to learn both tasks in a collaborative manner for end-to-end natural image matting. Besides, due to the limitation of available natural images in the matting task, previous methods typically adopt composite images for training and evaluation, which result in limited generalization ability on real-world images. In this paper, we investigate the domain gap issue between composite images and real-world images systematically by conducting comprehensive analyses of various discrepancies between the foreground and background images. We find that a carefully designed composition route RSSN that aims to reduce the discrepancies can lead to a better model with remarkable generalization ability. Furthermore, we provide a benchmark containing 2,000 high-resolution real-world animal images and 10,000 portrait images along with their manually labeled alpha mattes to serve as a test bed for evaluating matting model's generalization ability on real-world images. Comprehensive empirical studies have demonstrated that GFM outperforms state-of-the-art methods and effectively reduces the generalization error. The code and the datasets will be released at <a class="link-external link-https" href="https://github.com/JizhiziLi/GFM" rel="external noopener nofollow">this https URL</a>.

Refined-mask Guided Multi-Stream Blending Network

Towards Mask-robust Face Recognition.

Joint Generative Image Deblurring Aided by Edge Attention Prior and Dynamic Kernel Selection

Bridging Composite and Real: Towards End-to-end Deep Image Matting

Lightweight MIMO-WNet for Single Image Deblurring

A Double Feature Fusion Network with Progressive Learning for Sharper Inpainting

Mask Guided Matting via Progressive Refinement Network

Real-time portrait image retouching extended from DualBLN

Image Composition Method Based on a Spatial Position Analysis Network

MSMG-Net: Multi-scale Multi-grained Supervised Metworks for Multi-task Image Manipulation Detection and Localization

DB-BlendMask: Decomposed Attention and Balanced BlendMask for Instance Segmentation of High-Resolution Remote Sensing Images

Facial image deblurring network for robust illuminance adaptation and key structure restoration

Mutual-Guided Dynamic Network for Image Fusion

Multi-scale network for single image deblurring based on ensemble learning module

Optimal-Landmark-Guided Image Blending for Face Morphing Attacks

Multi-guided-based image matting via boundary detection

BaMBNet: A Blur-aware Multi-branch Network for Defocus Deblurring

Image Deblurring Using Multi-Stream Bottom-Top-Bottom Attention Network and Global Information-Based Fusion and Reconstruction Network

Barbershop: GAN-based Image Compositing using Segmentation Masks

Multi-Stream Refining Network for Person Re-Identification

MSNet: A Multistage Network for Lightweight Image Dehazing with Content-Guided Attention and Adaptive Encoding