Abstract:Image instance segmentation involves labeling pixels of images with classes and instances, which is one of the pivotal technologies in many domains, such as natural scenes understanding, intelligent driving, augmented reality and medical image analysis. With the power of deep learning, instance segmentation methods that use this technique have recently achieved remarkable progress. In this survey, we mainly discuss the representative 2D instance segmentation methods based on deep neural networks. Firstly, we summarize current fully-, weakly- and semi-supervised instance segmentation methods, and divide existing fully-supervised methods into three sub-categories depending on the number of stages. Based on our investigation, we conclude that currently, two-stage methods dominate the frontier of general instance segmentation; single-stage methods can achieve a better speed-accuracy trade-off, and multi-stage methods can achieve higher accuracy. Secondly, we introduce eleven datasets and three evaluation metrics for evaluating instance segmentation methods that can help researchers decide which one to choose to meet their needs and goals. Then the innovation and quantitative results of state-of-the-art general instance segmentation methods and specific instance segmentation methods (including salient instance segmentation, person instance segmentation, and amodal instance segmentation) are reviewed. In what follows, the common backbone networks are reviewed to better explain the reasons that why deep neural networks-based instance segmentation methods can achieve excellent performance. Finally, the future research directions and potential applications of instance segmentation are discussed, which can facilitates researchers to realize the existing technical difficulties and recent research hotspots.

Deep Learning for Visual Segmentation: A Review

A Review on Deep Learning Techniques Applied to Semantic Segmentation

Image Segmentation Using Deep Learning: A Survey

Deep learning for video object segmentation: a review

Deep Learning based 3D Segmentation: A Survey

A Survey on Deep Learning Technique for Video Segmentation

Deep semi-supervised learning for medical image segmentation: A review

A review of semantic segmentation using deep neural networks

A Brief Survey on Semantic Segmentation with Deep Learning

A Review of Deep-Learning-Based Medical Image Segmentation Methods

Intelligent Image Semantic Segmentation: A Review Through Deep Learning Techniques for Remote Sensing Image Analysis

Deep-Learning-Based Approaches for Semantic Segmentation of Natural Scene Images: A Review

Review the state-of-the-art technologies of semantic segmentation based on deep learning

Deep learning for visual understanding: A review

A Comprehensive Review of Modern Object Segmentation Approaches

Prediction of Neonatal Metabolic Acidosis in Women with a Singleton Term Pregnancy in Cephalic Presentation: An External Validation Study

A review of remote sensing image segmentation by deep learning methods

Deep Learning Techniques for Video Instance Segmentation: A Survey

A review on 2D instance segmentation based on deep neural networks

Techniques and Challenges of Image Segmentation: A Review