Abstract:Image matting is widely studied for accurate foreground extraction. Most algorithms, including deep-learning based solutions, require a carefully edited trimap. Recent works attempt to combine the segmentation stage and matting stage in one CNN model, but errors occurring at the segmentation stage lead to unsatisfactory matte. We propose a user-guided approach for practical human matting. More precisely, we provide a good automatic initial matting and a natural way of interaction that reduces the workload of drawing trimaps and allows users to guide the matting in ambiguous situation. We also combine the segmentation and matting stage in an end-to-end CNN architecture and introduce a residual-learning module to support convenient stroke-based interaction. The proposed model learns to propagate the input trimap and modify the deep image features, which can efficiently correct the segmentation errors. Our model supports arbitrary forms of trimaps from carefully edited to totally unknown maps. Our model also allows users to choose from different foreground estimations according to their preference. We collected a large human matting dataset consisting of 12K real-world human images with complex background and human-object relations. The proposed model is trained on the new dataset with a novel trimap generation strategy that enables the model to tackle different test situations and highly improves the interaction efficiency. Our method outperforms other state-of-the-art automatic methods and achieve competitive accuracy when high-quality trimaps are provided. Experiments indicate that our interactive matting strategy is superior to separately estimating the trimap and alpha matte using two models.

Quick automatic head image matting method based on segmentation and propagation

Deep Quantised Portrait Matting

Automatic blur region segmentation approach using image matting

Automatic foreground extraction of head shoulder images

Text-Guided Portrait Image Matting

An Automatic Matting Method Based on Moving Saliency Objects

Easy Matting - A Stroke Based Approach for Continuous Image Matting

Semantic-guided Automatic Natural Image Matting with Trimap Generation Network and Light-weight Non-local Attention

Improved Algorithm on Natural Image Matting

User-Guided Deep Human Image Matting Using Arbitrary Trimaps

Attention-guided Temporally Coherent Video Object Matting

Deep Image Matting: A Comprehensive Survey

SGM-Net: Semantic Guided Matting Net

Human head-shoulder segmentation

Automatic Matting Based on Fusion of Blur Estimation and Saliency Detection

PP-Matting: High-Accuracy Natural Image Matting

Automatic Trimap Generation for Image Matting

Semantic Human Matting

High-Resolution Deep Image Matting

Towards Label-Efficient Human Matting: A Simple Baseline for Weakly Semi-Supervised Trimap-Free Human Matting

Confidence-driven Image Co-Matting.