Abstract:Human parsing, especially in the wild, has attracted a lot of attention due to its great potential in many real-world applications. The Pyramid Spatial Parsing (PSP) module has shown superior performances in scene and human parsing tasks. However, the basic AvgPool operation in PSP equally aggregates spatial clues of a local region, and thus mixes up influences of different human parts presented in this region. It results in failures in capturing useful contexts relevant to parsing different parts. To address this problem, a suitable mechanism to collect spatial clues aligning with different human parts is proposed in this paper. We employ a Gather-Excite (GE) operation, a replacement of the AvgPool-Upsample operation in a pyramidical structure, to accurately reflect relevant human parts of various scales. The GE operation contains two steps: the gather operation that adaptively aggregates spatial clues to relevant human parts, and the excite operation that generates new feature maps with the gathered contextual information. This results in a novel Pyramidical Gather-Excite Context (PGEC) module to solve the multi-scale problem and parse person at various scales. The PGEC module is composed of multiple GE operations with different spatial extents and aggregates local and global spatial clues for better modeling multi-scale contextual information in parallel. Moreover, we integrate the PGEC module with fine-grained details, edge preserving module and deep supervision to formulate a novel PGEC Network (PGECNet) for human parsing. The proposed PGECNet has achieved state-of-the-art performance on four single-person human parsing datasets (i.e., LIP, PPSS, ATR and Fashion Clothing) and two multi-person human parsing datasets (i.e., PASCAL-Person-Part and CIHP). The experimental results show that the proposed PGEC is superior to the PSP and ASPP modules especially in single-human parsing task. The source code is publicly available at https://github.com/31sy/PGECNet.

A Generalized Earley Parser for Human Activity Parsing and Prediction.

Generalized Earley Parser: Bridging Symbolic Grammars and Sequence Data for Future Prediction

Discriminative Hierarchical Part-Based Models for Human Parsing and Action Recognition.

Activity Grammars for Temporal Action Segmentation

Predicting Human Activities Using Stochastic Grammar.

Learning and Parsing Video Events with Goal and Intent Prediction

Inferring Social Roles In Long Timespan Video Sequence

Semantic Sequence Analysis for Human Activity Prediction.

Image Parsing Via Stochastic Scene Grammar

Unsupervised Learning of Event AND-OR Grammar and Semantics from Video

An Extended Grammar System for Learning and Recognizing Complex Visual Events

Joint Video and Text Parsing for Understanding Events and Answering Queries

Toward Accurate Human Parsing Through Edge Guided Diffusion

Improving Human Parsing by Extracting Global Information Using the Non-Local Operation

Human Activities Prediction by Learning Combinatorial Sparse Representations.

Event Detection As Graph Parsing

Human Parsing Using Stochastic And-or Grammars and Rich Appearances

Human Parsing With Pyramidical Gather-Excite Context

Deep Learning Technique for Human Parsing: A Survey and Outlook

Sequence-to-Action: End-to-End Semantic Graph Generation for Semantic Parsing

Unsupervised Hierarchical Dynamic Parsing and Encoding for Action Recognition