Abstract:Human parsing, especially in the wild, has attracted a lot of attention due to its great potential in many real-world applications. The Pyramid Spatial Parsing (PSP) module has shown superior performances in scene and human parsing tasks. However, the basic AvgPool operation in PSP equally aggregates spatial clues of a local region, and thus mixes up influences of different human parts presented in this region. It results in failures in capturing useful contexts relevant to parsing different parts. To address this problem, a suitable mechanism to collect spatial clues aligning with different human parts is proposed in this paper. We employ a Gather-Excite (GE) operation, a replacement of the AvgPool-Upsample operation in a pyramidical structure, to accurately reflect relevant human parts of various scales. The GE operation contains two steps: the gather operation that adaptively aggregates spatial clues to relevant human parts, and the excite operation that generates new feature maps with the gathered contextual information. This results in a novel Pyramidical Gather-Excite Context (PGEC) module to solve the multi-scale problem and parse person at various scales. The PGEC module is composed of multiple GE operations with different spatial extents and aggregates local and global spatial clues for better modeling multi-scale contextual information in parallel. Moreover, we integrate the PGEC module with fine-grained details, edge preserving module and deep supervision to formulate a novel PGEC Network (PGECNet) for human parsing. The proposed PGECNet has achieved state-of-the-art performance on four single-person human parsing datasets (i.e., LIP, PPSS, ATR and Fashion Clothing) and two multi-person human parsing datasets (i.e., PASCAL-Person-Part and CIHP). The experimental results show that the proposed PGEC is superior to the PSP and ASPP modules especially in single-human parsing task. The source code is publicly available at https://github.com/31sy/PGECNet.

Improving Human Parsing by Extracting Global Information Using the Non-Local Operation

Part Decomposition and Refinement Network for Human Parsing

Heterogeneous Interactive Attention Network for Human Parsing.

Attention-guided Progressive Partition Network for Human Parsing

Instance-level Human Parsing Via Part Grouping Network.

Classification Assisted Segmentation Network For Human Parsing

From Simple to Complex Scenes: Learning Robust Feature Representations for Accurate Human Parsing

Hybrid Resolution Network Using Edge Guided Region Mutual Information Loss for Human Parsing

Toward Accurate Human Parsing Through Edge Guided Diffusion

Learning Semantic Neural Tree for Human Parsing

Graphonomy: Universal Human Parsing Via Graph Transfer Learning

Self-supervised Structure-Sensitive Learning for Human Parsing

Devil in the Details: Towards Accurate Single and Multiple Human Parsing

AIParsing: Anchor-Free Instance-Level Human Parsing.

Renovating Parsing R-CNN for Accurate Multiple Human Parsing

Hierarchical Information Passing Based Noise-Tolerant Hybrid Learning for Semi-Supervised Human Parsing.

Human Parsing with Edge Enhancement.

Self-Learning with Rectification Strategy for Human Parsing

Look into Person: Self-supervised Structure-sensitive Learning and A New Benchmark for Human Parsing

Human Parsing With Pyramidical Gather-Excite Context