Abstract:The standard approach to image instance segmentation is to perform the object detection first, and then segment the object from the detection bounding-box. More recently, deep learning methods like Mask R-CNN perform them jointly. However, little research takes into account the uniqueness of the "human" category, which can be well defined by the pose skeleton. Moreover, the human pose skeleton can be used to better distinguish instances with heavy occlusion than using bounding-boxes. In this paper, we present a brand new pose-based instance segmentation framework for humans which separates instances based on human pose, rather than proposal region detection. We demonstrate that our pose-based framework can achieve better accuracy than the state-of-art detection-based approach on the human instance segmentation problem, and can moreover better handle occlusion. Furthermore, there are few public datasets containing many heavily occluded humans along with comprehensive annotations, which makes this a challenging problem seldom noticed by researchers. Therefore, in this paper we introduce a new benchmark "Occluded Human (OCHuman)", which focuses on occluded humans with comprehensive annotations including bounding-box, human pose and instance masks. This dataset contains 8110 detailed annotated human instances within 4731 images. With an average 0.67 MaxIoU for each person, OCHuman is the most complex and challenging dataset related to human instance segmentation. Through this dataset, we want to emphasize occlusion as a challenging problem for researchers to study.

Segmenting Human From Photo Images Based on a Coarse-to-Fine Scheme

Upper Body Human Detection and Segmentation in Low Contrast Video

Based on network probabilistic graph human pose segmentation algorithm

Random Walks Colour Histogram Modification for Human Tracking.

FAST SEGMENTATION OF HUMAN BODY COMPONENTS BASED ON FACE DETECTION AND KEY POINT RECOGNITION

Real-time Detection and Tracking Algorithm Based on the Color and Character of Human Face

Human Segmentation Based on Disparity Map and GrabCut

Robust Human Body Segmentation Based on Part Appearance and Spatial Constraint

Real-Time Human Segmentation Using Pose Skeleton Map

Human Articulated Body Recognition Method in High-Resolution Monitoring Images

Human head-shoulder segmentation

Human Part Segmentation in Depth Images with Annotated Part Positions

Pose2Seg: Detection Free Human Instance Segmentation

Low-Level Image Features Based Human Body Detection Using Hidden Markov Model

An Efficient Face Detection Method in Color Images

Face Detection Based on Vector Quantization in Color Images

Human Segmentation for Classroom Video: dealing with the small size overlapped and distorted human

A Semi-Supervised Color Image Segmentation Method

Automatic Segmentation of Head-and-Shoulder Images by Combining Edge Feature and Shape Prior

Person Re-identification Based on Body Segmentation.