Abstract:Image instance segmentation involves labeling pixels of images with classes and instances, which is one of the pivotal technologies in many domains, such as natural scenes understanding, intelligent driving, augmented reality and medical image analysis. With the power of deep learning, instance segmentation methods that use this technique have recently achieved remarkable progress. In this survey, we mainly discuss the representative 2D instance segmentation methods based on deep neural networks. Firstly, we summarize current fully-, weakly- and semi-supervised instance segmentation methods, and divide existing fully-supervised methods into three sub-categories depending on the number of stages. Based on our investigation, we conclude that currently, two-stage methods dominate the frontier of general instance segmentation; single-stage methods can achieve a better speed-accuracy trade-off, and multi-stage methods can achieve higher accuracy. Secondly, we introduce eleven datasets and three evaluation metrics for evaluating instance segmentation methods that can help researchers decide which one to choose to meet their needs and goals. Then the innovation and quantitative results of state-of-the-art general instance segmentation methods and specific instance segmentation methods (including salient instance segmentation, person instance segmentation, and amodal instance segmentation) are reviewed. In what follows, the common backbone networks are reviewed to better explain the reasons that why deep neural networks-based instance segmentation methods can achieve excellent performance. Finally, the future research directions and potential applications of instance segmentation are discussed, which can facilitates researchers to realize the existing technical difficulties and recent research hotspots.

Review of object instance segmentation based on deep learning

A review on 2D instance segmentation based on deep neural networks

A Survey on Object Instance Segmentation

A Comprehensive Review of Modern Object Segmentation Approaches

A Review on Deep Learning Approaches to Image Classification and Object Segmentation

A review of semantic segmentation using deep neural networks

Review of Research on the Instance Segmentation of Cell Images

A review of remote sensing image segmentation by deep learning methods

A Review on Deep Learning Techniques Applied to Semantic Segmentation

Deep learning for video object segmentation: a review

Deep Learning-Based 3D Instance and Semantic Segmentation: A Review

Deep Learning for Visual Segmentation: A Review

Review the state-of-the-art technologies of semantic segmentation based on deep learning

A Review of Deep-Learning-Based Medical Image Segmentation Methods

Deep learning-based instance segmentation architectures in agriculture: A review of the scopes and challenges

Intelligent Image Semantic Segmentation: A Review Through Deep Learning Techniques for Remote Sensing Image Analysis

Deep Learning Techniques for Video Instance Segmentation: A Survey

A review of point cloud segmentation for understanding 3D indoor scenes

Deep-Learning-Based Approaches for Semantic Segmentation of Natural Scene Images: A Review

Deep learning implementation of image segmentation in agricultural applications: a comprehensive review

Research Progress Analysis of Point Cloud Segmentation Based on Deep Learning