Abstract:Human parsing, especially in the wild, has attracted a lot of attention due to its great potential in many real-world applications. The Pyramid Spatial Parsing (PSP) module has shown superior performances in scene and human parsing tasks. However, the basic AvgPool operation in PSP equally aggregates spatial clues of a local region, and thus mixes up influences of different human parts presented in this region. It results in failures in capturing useful contexts relevant to parsing different parts. To address this problem, a suitable mechanism to collect spatial clues aligning with different human parts is proposed in this paper. We employ a Gather-Excite (GE) operation, a replacement of the AvgPool-Upsample operation in a pyramidical structure, to accurately reflect relevant human parts of various scales. The GE operation contains two steps: the gather operation that adaptively aggregates spatial clues to relevant human parts, and the excite operation that generates new feature maps with the gathered contextual information. This results in a novel Pyramidical Gather-Excite Context (PGEC) module to solve the multi-scale problem and parse person at various scales. The PGEC module is composed of multiple GE operations with different spatial extents and aggregates local and global spatial clues for better modeling multi-scale contextual information in parallel. Moreover, we integrate the PGEC module with fine-grained details, edge preserving module and deep supervision to formulate a novel PGEC Network (PGECNet) for human parsing. The proposed PGECNet has achieved state-of-the-art performance on four single-person human parsing datasets (i.e., LIP, PPSS, ATR and Fashion Clothing) and two multi-person human parsing datasets (i.e., PASCAL-Person-Part and CIHP). The experimental results show that the proposed PGEC is superior to the PSP and ASPP modules especially in single-human parsing task. The source code is publicly available at https://github.com/31sy/PGECNet.

Self-supervised Structure-Sensitive Learning for Human Parsing

Learning hierarchical poselets for human parsing

Discriminative Hierarchical Part-Based Models for Human Parsing and Action Recognition.

Self-Learning with Rectification Strategy for Human Parsing

Deep Learning Technique for Human Parsing: A Survey and Outlook

Look into Person: Joint Body Parsing & Pose Estimation Network and A New Benchmark

Self-Correction for Human Parsing

From Simple to Complex Scenes: Learning Robust Feature Representations for Accurate Human Parsing

Learning Semantic Neural Tree for Human Parsing

Improving Human Parsing by Extracting Global Information Using the Non-Local Operation

Kinematic Skeleton Graph Augmented Network for Human Parsing

Semantic Human Parsing via Scalable Semantic Transfer over Multiple Label Domains

AIParsing: Anchor-Free Instance-Level Human Parsing.

A New Dataset and Boundary-Attention Semantic Segmentation for Face Parsing

Toward Accurate Human Parsing Through Edge Guided Diffusion

Deep Hierarchical Human Semantic Parsing

Understanding Humans in Crowded Scenes: Deep Nested Adversarial Learning and A New Benchmark for Multi-Human Parsing

Differentiable Multi-Granularity Human Parsing

Look Into Multi-Person: A New Benchmark For Pose Estimation And Human Parsing

Human Parsing With Pyramidical Gather-Excite Context

Differentiable Multi-Granularity Human Representation Learning for Instance-Aware Human Semantic Parsing