Abstract:Image matting is widely studied for accurate foreground extraction. Most algorithms, including deep-learning based solutions, require a carefully edited trimap. Recent works attempt to combine the segmentation stage and matting stage in one CNN model, but errors occurring at the segmentation stage lead to unsatisfactory matte. We propose a user-guided approach for practical human matting. More precisely, we provide a good automatic initial matting and a natural way of interaction that reduces the workload of drawing trimaps and allows users to guide the matting in ambiguous situation. We also combine the segmentation and matting stage in an end-to-end CNN architecture and introduce a residual-learning module to support convenient stroke-based interaction. The proposed model learns to propagate the input trimap and modify the deep image features, which can efficiently correct the segmentation errors. Our model supports arbitrary forms of trimaps from carefully edited to totally unknown maps. Our model also allows users to choose from different foreground estimations according to their preference. We collected a large human matting dataset consisting of 12K real-world human images with complex background and human-object relations. The proposed model is trained on the new dataset with a novel trimap generation strategy that enables the model to tackle different test situations and highly improves the interaction efficiency. Our method outperforms other state-of-the-art automatic methods and achieve competitive accuracy when high-quality trimaps are provided. Experiments indicate that our interactive matting strategy is superior to separately estimating the trimap and alpha matte using two models.

Iterative Transductive Learning for Automatic Image Segmentation and Matting with RGB-D Data

Iterative Transductive Learning For Alpha Matting

RGB×D: Learning Depth-Weighted RGB Patches for RGB-D Indoor Semantic Segmentation

ADRNet-S*: Asymmetric Depth Registration Network via Contrastive Knowledge Distillation for RGB-D Mirror Segmentation

DFormer: Rethinking RGBD Representation Learning for Semantic Segmentation

Deep Image Matting: A Comprehensive Survey

3D Matting: A Soft Segmentation Method Applied in Computed Tomography

User-Guided Deep Human Image Matting Using Arbitrary Trimaps

Depth Matters: Exploring Deep Interactions of RGB-D for Semantic Segmentation in Traffic Scenes

Deep Interactive Image Matting With Feature Propagation

Joint Multiview Segmentation And Localization Of Rgb-D Images Using Depth-Induced Silhouette Consistency

Disentangled Pre-training for Image Matting

Deep Learning of Unified Region, Edge, and Contour Models for Automated Image Segmentation

High-Resolution Deep Image Matting

Multi-guided-based image matting via boundary detection

Improving Deep Image Matting via Local Smoothness Assumption

Joint Object Segmentation and Depth Upsampling

Depth-aware CNN for RGB-D Segmentation

Semantic-guided Automatic Natural Image Matting with Trimap Generation Network and Light-weight Non-local Attention

RGB-D Human Matting: A Real-World Benchmark Dataset and A Baseline Method

Interactive RGB-D Image Segmentation Using Hierarchical Graph Cut and Geodesic Distance