Abstract:Image instance segmentation involves labeling pixels of images with classes and instances, which is one of the pivotal technologies in many domains, such as natural scenes understanding, intelligent driving, augmented reality and medical image analysis. With the power of deep learning, instance segmentation methods that use this technique have recently achieved remarkable progress. In this survey, we mainly discuss the representative 2D instance segmentation methods based on deep neural networks. Firstly, we summarize current fully-, weakly- and semi-supervised instance segmentation methods, and divide existing fully-supervised methods into three sub-categories depending on the number of stages. Based on our investigation, we conclude that currently, two-stage methods dominate the frontier of general instance segmentation; single-stage methods can achieve a better speed-accuracy trade-off, and multi-stage methods can achieve higher accuracy. Secondly, we introduce eleven datasets and three evaluation metrics for evaluating instance segmentation methods that can help researchers decide which one to choose to meet their needs and goals. Then the innovation and quantitative results of state-of-the-art general instance segmentation methods and specific instance segmentation methods (including salient instance segmentation, person instance segmentation, and amodal instance segmentation) are reviewed. In what follows, the common backbone networks are reviewed to better explain the reasons that why deep neural networks-based instance segmentation methods can achieve excellent performance. Finally, the future research directions and potential applications of instance segmentation are discussed, which can facilitates researchers to realize the existing technical difficulties and recent research hotspots.

A review of semantic segmentation using deep neural networks

A Review on Deep Learning Techniques Applied to Semantic Segmentation

Review the state-of-the-art technologies of semantic segmentation based on deep learning

Deep-Learning-Based Approaches for Semantic Segmentation of Natural Scene Images: A Review

A Brief Survey on Semantic Segmentation with Deep Learning

A Review on Semantic Segmentation from a Modern Perspective

Methods and datasets on semantic segmentation: A review

Intelligent Image Semantic Segmentation: A Review Through Deep Learning Techniques for Remote Sensing Image Analysis

A Review on Progress in Semantic Image Segmentation and Its Application to Medical Images

Deep Semantic Segmentation of Natural and Medical Images: A Review

Image Segmentation Using Deep Learning: A Survey

A Comprehensive Review of Modern Object Segmentation Approaches

A review on 2D instance segmentation based on deep neural networks

Recent Progress in Semantic Image Segmentation

Deep learning for video object segmentation: a review

A Survey of Image Semantic Segmentation Algorithm Based on Deep Learning

Deep learning for visual understanding: A review

A Comparative Review on Enhancing Visual Simultaneous Localization and Mapping with Deep Semantic Segmentation

Medical Image Segmentation Using Deep Learning: Review

A Review on Recent Deep Learning-Based Semantic Segmentation for Urban Greenness Measurement

A Survey on Deep Learning-based Architectures for Semantic Segmentation on 2D images